=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-635707 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-635707 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (5m0.39116723s)
-- stdout --
* [old-k8s-version-635707] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19377
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19377-383955/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19377-383955/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-635707" primary control-plane node in "old-k8s-version-635707" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0805 12:48:21.700131 443495 out.go:291] Setting OutFile to fd 1 ...
I0805 12:48:21.700452 443495 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0805 12:48:21.700465 443495 out.go:304] Setting ErrFile to fd 2...
I0805 12:48:21.700471 443495 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0805 12:48:21.700778 443495 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19377-383955/.minikube/bin
I0805 12:48:21.701583 443495 out.go:298] Setting JSON to false
I0805 12:48:21.703146 443495 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-11","uptime":9049,"bootTime":1722853053,"procs":267,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0805 12:48:21.703229 443495 start.go:139] virtualization: kvm guest
I0805 12:48:21.705564 443495 out.go:177] * [old-k8s-version-635707] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0805 12:48:21.707048 443495 out.go:177] - MINIKUBE_LOCATION=19377
I0805 12:48:21.707107 443495 notify.go:220] Checking for updates...
I0805 12:48:21.709814 443495 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0805 12:48:21.711170 443495 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19377-383955/kubeconfig
I0805 12:48:21.712397 443495 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19377-383955/.minikube
I0805 12:48:21.713707 443495 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0805 12:48:21.714903 443495 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0805 12:48:21.716627 443495 config.go:182] Loaded profile config "bridge-119870": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0805 12:48:21.716801 443495 config.go:182] Loaded profile config "enable-default-cni-119870": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0805 12:48:21.716937 443495 config.go:182] Loaded profile config "flannel-119870": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0805 12:48:21.717064 443495 driver.go:392] Setting default libvirt URI to qemu:///system
I0805 12:48:21.758158 443495 out.go:177] * Using the kvm2 driver based on user configuration
I0805 12:48:21.759381 443495 start.go:297] selected driver: kvm2
I0805 12:48:21.759397 443495 start.go:901] validating driver "kvm2" against <nil>
I0805 12:48:21.759414 443495 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0805 12:48:21.760452 443495 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0805 12:48:21.760556 443495 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19377-383955/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0805 12:48:21.778909 443495 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0805 12:48:21.778988 443495 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0805 12:48:21.779310 443495 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0805 12:48:21.779349 443495 cni.go:84] Creating CNI manager for ""
I0805 12:48:21.779360 443495 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0805 12:48:21.779373 443495 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0805 12:48:21.779465 443495 start.go:340] cluster config:
{Name:old-k8s-version-635707 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-635707 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0805 12:48:21.779612 443495 iso.go:125] acquiring lock: {Name:mk78a4988ea0dfb86bb6f7367e362683a39fd912 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0805 12:48:21.781673 443495 out.go:177] * Starting "old-k8s-version-635707" primary control-plane node in "old-k8s-version-635707" cluster
I0805 12:48:21.783037 443495 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0805 12:48:21.783087 443495 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19377-383955/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0805 12:48:21.783097 443495 cache.go:56] Caching tarball of preloaded images
I0805 12:48:21.783223 443495 preload.go:172] Found /home/jenkins/minikube-integration/19377-383955/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0805 12:48:21.783239 443495 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0805 12:48:21.783366 443495 profile.go:143] Saving config to /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/config.json ...
I0805 12:48:21.783393 443495 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/config.json: {Name:mk18f1e956ba5ca62d9c39c96470550d6f89a2f3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 12:48:21.783560 443495 start.go:360] acquireMachinesLock for old-k8s-version-635707: {Name:mk3babe91d55c30c0b650587cdec6489eb3a7ed6 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0805 12:48:49.377124 443495 start.go:364] duration metric: took 27.593508877s to acquireMachinesLock for "old-k8s-version-635707"
I0805 12:48:49.377215 443495 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-635707 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-635707 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0805 12:48:49.377342 443495 start.go:125] createHost starting for "" (driver="kvm2")
I0805 12:48:49.379197 443495 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0805 12:48:49.379396 443495 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0805 12:48:49.379456 443495 main.go:141] libmachine: Launching plugin server for driver kvm2
I0805 12:48:49.396921 443495 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42047
I0805 12:48:49.397441 443495 main.go:141] libmachine: () Calling .GetVersion
I0805 12:48:49.398096 443495 main.go:141] libmachine: Using API Version 1
I0805 12:48:49.398118 443495 main.go:141] libmachine: () Calling .SetConfigRaw
I0805 12:48:49.398483 443495 main.go:141] libmachine: () Calling .GetMachineName
I0805 12:48:49.398666 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetMachineName
I0805 12:48:49.398805 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .DriverName
I0805 12:48:49.398973 443495 start.go:159] libmachine.API.Create for "old-k8s-version-635707" (driver="kvm2")
I0805 12:48:49.399000 443495 client.go:168] LocalClient.Create starting
I0805 12:48:49.399044 443495 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19377-383955/.minikube/certs/ca.pem
I0805 12:48:49.399080 443495 main.go:141] libmachine: Decoding PEM data...
I0805 12:48:49.399098 443495 main.go:141] libmachine: Parsing certificate...
I0805 12:48:49.399159 443495 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19377-383955/.minikube/certs/cert.pem
I0805 12:48:49.399178 443495 main.go:141] libmachine: Decoding PEM data...
I0805 12:48:49.399189 443495 main.go:141] libmachine: Parsing certificate...
I0805 12:48:49.399210 443495 main.go:141] libmachine: Running pre-create checks...
I0805 12:48:49.399219 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .PreCreateCheck
I0805 12:48:49.399624 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetConfigRaw
I0805 12:48:49.400067 443495 main.go:141] libmachine: Creating machine...
I0805 12:48:49.400085 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .Create
I0805 12:48:49.400224 443495 main.go:141] libmachine: (old-k8s-version-635707) Creating KVM machine...
I0805 12:48:49.401667 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found existing default KVM network
I0805 12:48:49.403513 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:49.403333 443833 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:bc:32:e2} reservation:<nil>}
I0805 12:48:49.405030 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:49.404938 443833 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:9e:79:d4} reservation:<nil>}
I0805 12:48:49.406736 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:49.406647 443833 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015ff0}
I0805 12:48:49.406791 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | created network xml:
I0805 12:48:49.406804 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | <network>
I0805 12:48:49.406814 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | <name>mk-old-k8s-version-635707</name>
I0805 12:48:49.406821 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | <dns enable='no'/>
I0805 12:48:49.406828 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG |
I0805 12:48:49.406863 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0805 12:48:49.406875 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | <dhcp>
I0805 12:48:49.406891 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0805 12:48:49.406899 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | </dhcp>
I0805 12:48:49.406906 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | </ip>
I0805 12:48:49.406914 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG |
I0805 12:48:49.406921 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | </network>
I0805 12:48:49.406931 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG |
I0805 12:48:49.412575 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | trying to create private KVM network mk-old-k8s-version-635707 192.168.61.0/24...
I0805 12:48:49.505953 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | private KVM network mk-old-k8s-version-635707 192.168.61.0/24 created
I0805 12:48:49.505987 443495 main.go:141] libmachine: (old-k8s-version-635707) Setting up store path in /home/jenkins/minikube-integration/19377-383955/.minikube/machines/old-k8s-version-635707 ...
I0805 12:48:49.506001 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:49.505922 443833 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19377-383955/.minikube
I0805 12:48:49.506017 443495 main.go:141] libmachine: (old-k8s-version-635707) Building disk image from file:///home/jenkins/minikube-integration/19377-383955/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso
I0805 12:48:49.506273 443495 main.go:141] libmachine: (old-k8s-version-635707) Downloading /home/jenkins/minikube-integration/19377-383955/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19377-383955/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...
I0805 12:48:50.036015 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:50.035863 443833 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19377-383955/.minikube/machines/old-k8s-version-635707/id_rsa...
I0805 12:48:50.132025 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:50.131842 443833 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19377-383955/.minikube/machines/old-k8s-version-635707/old-k8s-version-635707.rawdisk...
I0805 12:48:50.132063 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | Writing magic tar header
I0805 12:48:50.132081 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | Writing SSH key tar header
I0805 12:48:50.132095 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:50.132056 443833 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19377-383955/.minikube/machines/old-k8s-version-635707 ...
I0805 12:48:50.132279 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19377-383955/.minikube/machines/old-k8s-version-635707
I0805 12:48:50.132321 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19377-383955/.minikube/machines
I0805 12:48:50.132360 443495 main.go:141] libmachine: (old-k8s-version-635707) Setting executable bit set on /home/jenkins/minikube-integration/19377-383955/.minikube/machines/old-k8s-version-635707 (perms=drwx------)
I0805 12:48:50.132383 443495 main.go:141] libmachine: (old-k8s-version-635707) Setting executable bit set on /home/jenkins/minikube-integration/19377-383955/.minikube/machines (perms=drwxr-xr-x)
I0805 12:48:50.132397 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19377-383955/.minikube
I0805 12:48:50.132419 443495 main.go:141] libmachine: (old-k8s-version-635707) Setting executable bit set on /home/jenkins/minikube-integration/19377-383955/.minikube (perms=drwxr-xr-x)
I0805 12:48:50.132431 443495 main.go:141] libmachine: (old-k8s-version-635707) Setting executable bit set on /home/jenkins/minikube-integration/19377-383955 (perms=drwxrwxr-x)
I0805 12:48:50.132441 443495 main.go:141] libmachine: (old-k8s-version-635707) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0805 12:48:50.132452 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19377-383955
I0805 12:48:50.132477 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0805 12:48:50.132486 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | Checking permissions on dir: /home/jenkins
I0805 12:48:50.132498 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | Checking permissions on dir: /home
I0805 12:48:50.132516 443495 main.go:141] libmachine: (old-k8s-version-635707) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0805 12:48:50.132526 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | Skipping /home - not owner
I0805 12:48:50.132537 443495 main.go:141] libmachine: (old-k8s-version-635707) Creating domain...
I0805 12:48:50.133822 443495 main.go:141] libmachine: (old-k8s-version-635707) define libvirt domain using xml:
I0805 12:48:50.133861 443495 main.go:141] libmachine: (old-k8s-version-635707) <domain type='kvm'>
I0805 12:48:50.133898 443495 main.go:141] libmachine: (old-k8s-version-635707) <name>old-k8s-version-635707</name>
I0805 12:48:50.133926 443495 main.go:141] libmachine: (old-k8s-version-635707) <memory unit='MiB'>2200</memory>
I0805 12:48:50.133940 443495 main.go:141] libmachine: (old-k8s-version-635707) <vcpu>2</vcpu>
I0805 12:48:50.133955 443495 main.go:141] libmachine: (old-k8s-version-635707) <features>
I0805 12:48:50.133968 443495 main.go:141] libmachine: (old-k8s-version-635707) <acpi/>
I0805 12:48:50.133981 443495 main.go:141] libmachine: (old-k8s-version-635707) <apic/>
I0805 12:48:50.133994 443495 main.go:141] libmachine: (old-k8s-version-635707) <pae/>
I0805 12:48:50.134005 443495 main.go:141] libmachine: (old-k8s-version-635707)
I0805 12:48:50.134015 443495 main.go:141] libmachine: (old-k8s-version-635707) </features>
I0805 12:48:50.134027 443495 main.go:141] libmachine: (old-k8s-version-635707) <cpu mode='host-passthrough'>
I0805 12:48:50.134060 443495 main.go:141] libmachine: (old-k8s-version-635707)
I0805 12:48:50.134086 443495 main.go:141] libmachine: (old-k8s-version-635707) </cpu>
I0805 12:48:50.134095 443495 main.go:141] libmachine: (old-k8s-version-635707) <os>
I0805 12:48:50.134106 443495 main.go:141] libmachine: (old-k8s-version-635707) <type>hvm</type>
I0805 12:48:50.134116 443495 main.go:141] libmachine: (old-k8s-version-635707) <boot dev='cdrom'/>
I0805 12:48:50.134127 443495 main.go:141] libmachine: (old-k8s-version-635707) <boot dev='hd'/>
I0805 12:48:50.134139 443495 main.go:141] libmachine: (old-k8s-version-635707) <bootmenu enable='no'/>
I0805 12:48:50.134149 443495 main.go:141] libmachine: (old-k8s-version-635707) </os>
I0805 12:48:50.134157 443495 main.go:141] libmachine: (old-k8s-version-635707) <devices>
I0805 12:48:50.134179 443495 main.go:141] libmachine: (old-k8s-version-635707) <disk type='file' device='cdrom'>
I0805 12:48:50.134194 443495 main.go:141] libmachine: (old-k8s-version-635707) <source file='/home/jenkins/minikube-integration/19377-383955/.minikube/machines/old-k8s-version-635707/boot2docker.iso'/>
I0805 12:48:50.134208 443495 main.go:141] libmachine: (old-k8s-version-635707) <target dev='hdc' bus='scsi'/>
I0805 12:48:50.134218 443495 main.go:141] libmachine: (old-k8s-version-635707) <readonly/>
I0805 12:48:50.134235 443495 main.go:141] libmachine: (old-k8s-version-635707) </disk>
I0805 12:48:50.134264 443495 main.go:141] libmachine: (old-k8s-version-635707) <disk type='file' device='disk'>
I0805 12:48:50.134277 443495 main.go:141] libmachine: (old-k8s-version-635707) <driver name='qemu' type='raw' cache='default' io='threads' />
I0805 12:48:50.134293 443495 main.go:141] libmachine: (old-k8s-version-635707) <source file='/home/jenkins/minikube-integration/19377-383955/.minikube/machines/old-k8s-version-635707/old-k8s-version-635707.rawdisk'/>
I0805 12:48:50.134303 443495 main.go:141] libmachine: (old-k8s-version-635707) <target dev='hda' bus='virtio'/>
I0805 12:48:50.134319 443495 main.go:141] libmachine: (old-k8s-version-635707) </disk>
I0805 12:48:50.134333 443495 main.go:141] libmachine: (old-k8s-version-635707) <interface type='network'>
I0805 12:48:50.134346 443495 main.go:141] libmachine: (old-k8s-version-635707) <source network='mk-old-k8s-version-635707'/>
I0805 12:48:50.134359 443495 main.go:141] libmachine: (old-k8s-version-635707) <model type='virtio'/>
I0805 12:48:50.134369 443495 main.go:141] libmachine: (old-k8s-version-635707) </interface>
I0805 12:48:50.134381 443495 main.go:141] libmachine: (old-k8s-version-635707) <interface type='network'>
I0805 12:48:50.134395 443495 main.go:141] libmachine: (old-k8s-version-635707) <source network='default'/>
I0805 12:48:50.134416 443495 main.go:141] libmachine: (old-k8s-version-635707) <model type='virtio'/>
I0805 12:48:50.134437 443495 main.go:141] libmachine: (old-k8s-version-635707) </interface>
I0805 12:48:50.134448 443495 main.go:141] libmachine: (old-k8s-version-635707) <serial type='pty'>
I0805 12:48:50.134459 443495 main.go:141] libmachine: (old-k8s-version-635707) <target port='0'/>
I0805 12:48:50.134467 443495 main.go:141] libmachine: (old-k8s-version-635707) </serial>
I0805 12:48:50.134481 443495 main.go:141] libmachine: (old-k8s-version-635707) <console type='pty'>
I0805 12:48:50.134493 443495 main.go:141] libmachine: (old-k8s-version-635707) <target type='serial' port='0'/>
I0805 12:48:50.134509 443495 main.go:141] libmachine: (old-k8s-version-635707) </console>
I0805 12:48:50.134554 443495 main.go:141] libmachine: (old-k8s-version-635707) <rng model='virtio'>
I0805 12:48:50.134577 443495 main.go:141] libmachine: (old-k8s-version-635707) <backend model='random'>/dev/random</backend>
I0805 12:48:50.134589 443495 main.go:141] libmachine: (old-k8s-version-635707) </rng>
I0805 12:48:50.134603 443495 main.go:141] libmachine: (old-k8s-version-635707)
I0805 12:48:50.134615 443495 main.go:141] libmachine: (old-k8s-version-635707)
I0805 12:48:50.134622 443495 main.go:141] libmachine: (old-k8s-version-635707) </devices>
I0805 12:48:50.134632 443495 main.go:141] libmachine: (old-k8s-version-635707) </domain>
I0805 12:48:50.134642 443495 main.go:141] libmachine: (old-k8s-version-635707)
I0805 12:48:50.205858 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:f9:a3:3d in network default
I0805 12:48:50.206643 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:48:50.206676 443495 main.go:141] libmachine: (old-k8s-version-635707) Ensuring networks are active...
I0805 12:48:50.207585 443495 main.go:141] libmachine: (old-k8s-version-635707) Ensuring network default is active
I0805 12:48:50.207972 443495 main.go:141] libmachine: (old-k8s-version-635707) Ensuring network mk-old-k8s-version-635707 is active
I0805 12:48:50.208563 443495 main.go:141] libmachine: (old-k8s-version-635707) Getting domain xml...
I0805 12:48:50.209484 443495 main.go:141] libmachine: (old-k8s-version-635707) Creating domain...
I0805 12:48:51.706336 443495 main.go:141] libmachine: (old-k8s-version-635707) Waiting to get IP...
I0805 12:48:51.707234 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:48:51.707705 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | unable to find current IP address of domain old-k8s-version-635707 in network mk-old-k8s-version-635707
I0805 12:48:51.707736 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:51.707685 443833 retry.go:31] will retry after 309.768852ms: waiting for machine to come up
I0805 12:48:52.019604 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:48:52.020220 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | unable to find current IP address of domain old-k8s-version-635707 in network mk-old-k8s-version-635707
I0805 12:48:52.020245 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:52.020165 443833 retry.go:31] will retry after 320.197001ms: waiting for machine to come up
I0805 12:48:52.341689 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:48:52.342374 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | unable to find current IP address of domain old-k8s-version-635707 in network mk-old-k8s-version-635707
I0805 12:48:52.342407 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:52.342282 443833 retry.go:31] will retry after 352.7217ms: waiting for machine to come up
I0805 12:48:52.697181 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:48:52.697866 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | unable to find current IP address of domain old-k8s-version-635707 in network mk-old-k8s-version-635707
I0805 12:48:52.697895 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:52.697762 443833 retry.go:31] will retry after 549.745341ms: waiting for machine to come up
I0805 12:48:53.249633 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:48:53.250322 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | unable to find current IP address of domain old-k8s-version-635707 in network mk-old-k8s-version-635707
I0805 12:48:53.250360 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:53.250269 443833 retry.go:31] will retry after 760.695943ms: waiting for machine to come up
I0805 12:48:54.012402 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:48:54.013044 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | unable to find current IP address of domain old-k8s-version-635707 in network mk-old-k8s-version-635707
I0805 12:48:54.013072 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:54.012985 443833 retry.go:31] will retry after 732.164407ms: waiting for machine to come up
I0805 12:48:54.746760 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:48:54.747199 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | unable to find current IP address of domain old-k8s-version-635707 in network mk-old-k8s-version-635707
I0805 12:48:54.747229 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:54.747146 443833 retry.go:31] will retry after 963.132311ms: waiting for machine to come up
I0805 12:48:55.712482 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:48:55.713100 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | unable to find current IP address of domain old-k8s-version-635707 in network mk-old-k8s-version-635707
I0805 12:48:55.713146 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:55.713073 443833 retry.go:31] will retry after 929.715522ms: waiting for machine to come up
I0805 12:48:56.644419 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:48:56.645014 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | unable to find current IP address of domain old-k8s-version-635707 in network mk-old-k8s-version-635707
I0805 12:48:56.645043 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:56.644959 443833 retry.go:31] will retry after 1.34549505s: waiting for machine to come up
I0805 12:48:57.992662 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:48:57.993231 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | unable to find current IP address of domain old-k8s-version-635707 in network mk-old-k8s-version-635707
I0805 12:48:57.993277 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:48:57.993196 443833 retry.go:31] will retry after 2.112920902s: waiting for machine to come up
I0805 12:49:00.107755 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:00.108476 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | unable to find current IP address of domain old-k8s-version-635707 in network mk-old-k8s-version-635707
I0805 12:49:00.108509 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:49:00.108401 443833 retry.go:31] will retry after 2.083449582s: waiting for machine to come up
I0805 12:49:02.193968 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:02.194579 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | unable to find current IP address of domain old-k8s-version-635707 in network mk-old-k8s-version-635707
I0805 12:49:02.194622 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:49:02.194516 443833 retry.go:31] will retry after 3.021208356s: waiting for machine to come up
I0805 12:49:05.217142 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:05.217847 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | unable to find current IP address of domain old-k8s-version-635707 in network mk-old-k8s-version-635707
I0805 12:49:05.217870 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:49:05.217785 443833 retry.go:31] will retry after 4.472292948s: waiting for machine to come up
I0805 12:49:09.691558 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:09.692116 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | unable to find current IP address of domain old-k8s-version-635707 in network mk-old-k8s-version-635707
I0805 12:49:09.692143 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | I0805 12:49:09.692065 443833 retry.go:31] will retry after 4.225227471s: waiting for machine to come up
I0805 12:49:13.921061 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:13.921703 443495 main.go:141] libmachine: (old-k8s-version-635707) Found IP for machine: 192.168.61.41
I0805 12:49:13.921734 443495 main.go:141] libmachine: (old-k8s-version-635707) Reserving static IP address...
I0805 12:49:13.921749 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has current primary IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:13.922164 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-635707", mac: "52:54:00:2a:da:c5", ip: "192.168.61.41"} in network mk-old-k8s-version-635707
I0805 12:49:14.001866 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | Getting to WaitForSSH function...
I0805 12:49:14.001903 443495 main.go:141] libmachine: (old-k8s-version-635707) Reserved static IP address: 192.168.61.41
I0805 12:49:14.001913 443495 main.go:141] libmachine: (old-k8s-version-635707) Waiting for SSH to be available...
I0805 12:49:14.005203 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.005675 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:minikube Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:14.005715 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.005827 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | Using SSH client type: external
I0805 12:49:14.005871 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | Using SSH private key: /home/jenkins/minikube-integration/19377-383955/.minikube/machines/old-k8s-version-635707/id_rsa (-rw-------)
I0805 12:49:14.005908 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.41 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19377-383955/.minikube/machines/old-k8s-version-635707/id_rsa -p 22] /usr/bin/ssh <nil>}
I0805 12:49:14.005925 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | About to run SSH command:
I0805 12:49:14.005936 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | exit 0
I0805 12:49:14.132334 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | SSH cmd err, output: <nil>:
I0805 12:49:14.132632 443495 main.go:141] libmachine: (old-k8s-version-635707) KVM machine creation complete!
I0805 12:49:14.133071 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetConfigRaw
I0805 12:49:14.133770 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .DriverName
I0805 12:49:14.133997 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .DriverName
I0805 12:49:14.134233 443495 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0805 12:49:14.134254 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetState
I0805 12:49:14.136249 443495 main.go:141] libmachine: Detecting operating system of created instance...
I0805 12:49:14.136270 443495 main.go:141] libmachine: Waiting for SSH to be available...
I0805 12:49:14.136277 443495 main.go:141] libmachine: Getting to WaitForSSH function...
I0805 12:49:14.136287 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHHostname
I0805 12:49:14.139085 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.139611 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:old-k8s-version-635707 Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:14.139632 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.139780 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHPort
I0805 12:49:14.139987 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHKeyPath
I0805 12:49:14.140183 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHKeyPath
I0805 12:49:14.140369 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHUsername
I0805 12:49:14.140580 443495 main.go:141] libmachine: Using SSH client type: native
I0805 12:49:14.140858 443495 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.61.41 22 <nil> <nil>}
I0805 12:49:14.140877 443495 main.go:141] libmachine: About to run SSH command:
exit 0
I0805 12:49:14.252590 443495 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0805 12:49:14.252623 443495 main.go:141] libmachine: Detecting the provisioner...
I0805 12:49:14.252635 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHHostname
I0805 12:49:14.256027 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.256444 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:old-k8s-version-635707 Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:14.256476 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.256715 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHPort
I0805 12:49:14.256951 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHKeyPath
I0805 12:49:14.257255 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHKeyPath
I0805 12:49:14.257426 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHUsername
I0805 12:49:14.257586 443495 main.go:141] libmachine: Using SSH client type: native
I0805 12:49:14.257783 443495 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.61.41 22 <nil> <nil>}
I0805 12:49:14.257797 443495 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0805 12:49:14.369328 443495 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0805 12:49:14.369407 443495 main.go:141] libmachine: found compatible host: buildroot
I0805 12:49:14.369423 443495 main.go:141] libmachine: Provisioning with buildroot...
I0805 12:49:14.369437 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetMachineName
I0805 12:49:14.369736 443495 buildroot.go:166] provisioning hostname "old-k8s-version-635707"
I0805 12:49:14.369770 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetMachineName
I0805 12:49:14.370008 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHHostname
I0805 12:49:14.373592 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.374044 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:old-k8s-version-635707 Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:14.374088 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.374165 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHPort
I0805 12:49:14.374361 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHKeyPath
I0805 12:49:14.374528 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHKeyPath
I0805 12:49:14.374689 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHUsername
I0805 12:49:14.374848 443495 main.go:141] libmachine: Using SSH client type: native
I0805 12:49:14.375062 443495 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.61.41 22 <nil> <nil>}
I0805 12:49:14.375079 443495 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-635707 && echo "old-k8s-version-635707" | sudo tee /etc/hostname
I0805 12:49:14.495616 443495 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-635707
I0805 12:49:14.495656 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHHostname
I0805 12:49:14.499403 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.499923 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:old-k8s-version-635707 Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:14.499971 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.500203 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHPort
I0805 12:49:14.500436 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHKeyPath
I0805 12:49:14.500661 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHKeyPath
I0805 12:49:14.500809 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHUsername
I0805 12:49:14.501000 443495 main.go:141] libmachine: Using SSH client type: native
I0805 12:49:14.501215 443495 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.61.41 22 <nil> <nil>}
I0805 12:49:14.501232 443495 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-635707' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-635707/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-635707' | sudo tee -a /etc/hosts;
fi
fi
I0805 12:49:14.614463 443495 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0805 12:49:14.614500 443495 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19377-383955/.minikube CaCertPath:/home/jenkins/minikube-integration/19377-383955/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19377-383955/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19377-383955/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19377-383955/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19377-383955/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19377-383955/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19377-383955/.minikube}
I0805 12:49:14.614558 443495 buildroot.go:174] setting up certificates
I0805 12:49:14.614576 443495 provision.go:84] configureAuth start
I0805 12:49:14.614593 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetMachineName
I0805 12:49:14.614925 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetIP
I0805 12:49:14.618024 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.618472 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:old-k8s-version-635707 Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:14.618530 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.618639 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHHostname
I0805 12:49:14.621258 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.621639 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:old-k8s-version-635707 Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:14.621705 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.621789 443495 provision.go:143] copyHostCerts
I0805 12:49:14.621873 443495 exec_runner.go:144] found /home/jenkins/minikube-integration/19377-383955/.minikube/ca.pem, removing ...
I0805 12:49:14.621887 443495 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19377-383955/.minikube/ca.pem
I0805 12:49:14.621965 443495 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19377-383955/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19377-383955/.minikube/ca.pem (1082 bytes)
I0805 12:49:14.622116 443495 exec_runner.go:144] found /home/jenkins/minikube-integration/19377-383955/.minikube/cert.pem, removing ...
I0805 12:49:14.622130 443495 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19377-383955/.minikube/cert.pem
I0805 12:49:14.622164 443495 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19377-383955/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19377-383955/.minikube/cert.pem (1123 bytes)
I0805 12:49:14.622263 443495 exec_runner.go:144] found /home/jenkins/minikube-integration/19377-383955/.minikube/key.pem, removing ...
I0805 12:49:14.622274 443495 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19377-383955/.minikube/key.pem
I0805 12:49:14.622301 443495 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19377-383955/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19377-383955/.minikube/key.pem (1675 bytes)
I0805 12:49:14.622397 443495 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19377-383955/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19377-383955/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19377-383955/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-635707 san=[127.0.0.1 192.168.61.41 localhost minikube old-k8s-version-635707]
I0805 12:49:14.683252 443495 provision.go:177] copyRemoteCerts
I0805 12:49:14.683318 443495 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0805 12:49:14.683347 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHHostname
I0805 12:49:14.686283 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.686633 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:old-k8s-version-635707 Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:14.686657 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.686898 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHPort
I0805 12:49:14.687107 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHKeyPath
I0805 12:49:14.687282 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHUsername
I0805 12:49:14.687431 443495 sshutil.go:53] new ssh client: &{IP:192.168.61.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19377-383955/.minikube/machines/old-k8s-version-635707/id_rsa Username:docker}
I0805 12:49:14.779173 443495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19377-383955/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0805 12:49:14.808571 443495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19377-383955/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0805 12:49:14.834519 443495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19377-383955/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0805 12:49:14.862341 443495 provision.go:87] duration metric: took 247.746148ms to configureAuth
I0805 12:49:14.862383 443495 buildroot.go:189] setting minikube options for container-runtime
I0805 12:49:14.862621 443495 config.go:182] Loaded profile config "old-k8s-version-635707": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0805 12:49:14.862722 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHHostname
I0805 12:49:14.865575 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.866078 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:old-k8s-version-635707 Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:14.866111 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:14.866274 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHPort
I0805 12:49:14.866499 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHKeyPath
I0805 12:49:14.866698 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHKeyPath
I0805 12:49:14.866872 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHUsername
I0805 12:49:14.867117 443495 main.go:141] libmachine: Using SSH client type: native
I0805 12:49:14.867324 443495 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.61.41 22 <nil> <nil>}
I0805 12:49:14.867350 443495 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0805 12:49:15.190752 443495 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0805 12:49:15.190784 443495 main.go:141] libmachine: Checking connection to Docker...
I0805 12:49:15.190797 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetURL
I0805 12:49:15.192195 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | Using libvirt version 6000000
I0805 12:49:15.194426 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:15.194770 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:old-k8s-version-635707 Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:15.194810 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:15.195032 443495 main.go:141] libmachine: Docker is up and running!
I0805 12:49:15.195050 443495 main.go:141] libmachine: Reticulating splines...
I0805 12:49:15.195058 443495 client.go:171] duration metric: took 25.796050227s to LocalClient.Create
I0805 12:49:15.195086 443495 start.go:167] duration metric: took 25.796113828s to libmachine.API.Create "old-k8s-version-635707"
I0805 12:49:15.195114 443495 start.go:293] postStartSetup for "old-k8s-version-635707" (driver="kvm2")
I0805 12:49:15.195130 443495 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0805 12:49:15.195154 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .DriverName
I0805 12:49:15.195402 443495 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0805 12:49:15.195428 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHHostname
I0805 12:49:15.197837 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:15.198233 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:old-k8s-version-635707 Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:15.198265 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:15.198419 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHPort
I0805 12:49:15.198620 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHKeyPath
I0805 12:49:15.198770 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHUsername
I0805 12:49:15.198897 443495 sshutil.go:53] new ssh client: &{IP:192.168.61.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19377-383955/.minikube/machines/old-k8s-version-635707/id_rsa Username:docker}
I0805 12:49:15.285119 443495 ssh_runner.go:195] Run: cat /etc/os-release
I0805 12:49:15.289896 443495 info.go:137] Remote host: Buildroot 2023.02.9
I0805 12:49:15.289927 443495 filesync.go:126] Scanning /home/jenkins/minikube-integration/19377-383955/.minikube/addons for local assets ...
I0805 12:49:15.289992 443495 filesync.go:126] Scanning /home/jenkins/minikube-integration/19377-383955/.minikube/files for local assets ...
I0805 12:49:15.290086 443495 filesync.go:149] local asset: /home/jenkins/minikube-integration/19377-383955/.minikube/files/etc/ssl/certs/3912192.pem -> 3912192.pem in /etc/ssl/certs
I0805 12:49:15.290212 443495 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0805 12:49:15.301323 443495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19377-383955/.minikube/files/etc/ssl/certs/3912192.pem --> /etc/ssl/certs/3912192.pem (1708 bytes)
I0805 12:49:15.330646 443495 start.go:296] duration metric: took 135.512925ms for postStartSetup
I0805 12:49:15.330705 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetConfigRaw
I0805 12:49:15.331439 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetIP
I0805 12:49:15.334402 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:15.334800 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:old-k8s-version-635707 Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:15.334845 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:15.335091 443495 profile.go:143] Saving config to /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/config.json ...
I0805 12:49:15.335333 443495 start.go:128] duration metric: took 25.957976771s to createHost
I0805 12:49:15.335363 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHHostname
I0805 12:49:15.338031 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:15.338421 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:old-k8s-version-635707 Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:15.338468 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:15.338616 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHPort
I0805 12:49:15.338805 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHKeyPath
I0805 12:49:15.338973 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHKeyPath
I0805 12:49:15.339118 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHUsername
I0805 12:49:15.339302 443495 main.go:141] libmachine: Using SSH client type: native
I0805 12:49:15.339518 443495 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.61.41 22 <nil> <nil>}
I0805 12:49:15.339531 443495 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0805 12:49:15.445199 443495 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722862155.388531472
I0805 12:49:15.445228 443495 fix.go:216] guest clock: 1722862155.388531472
I0805 12:49:15.445235 443495 fix.go:229] Guest: 2024-08-05 12:49:15.388531472 +0000 UTC Remote: 2024-08-05 12:49:15.335348776 +0000 UTC m=+53.681135104 (delta=53.182696ms)
I0805 12:49:15.445256 443495 fix.go:200] guest clock delta is within tolerance: 53.182696ms
I0805 12:49:15.445262 443495 start.go:83] releasing machines lock for "old-k8s-version-635707", held for 26.068105427s
I0805 12:49:15.445289 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .DriverName
I0805 12:49:15.445612 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetIP
I0805 12:49:15.448895 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:15.449297 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:old-k8s-version-635707 Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:15.449335 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:15.449634 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .DriverName
I0805 12:49:15.450215 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .DriverName
I0805 12:49:15.450448 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .DriverName
I0805 12:49:15.450561 443495 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0805 12:49:15.450618 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHHostname
I0805 12:49:15.450646 443495 ssh_runner.go:195] Run: cat /version.json
I0805 12:49:15.450675 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHHostname
I0805 12:49:15.453956 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:15.454215 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:15.454623 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:old-k8s-version-635707 Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:15.454668 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:15.454900 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:old-k8s-version-635707 Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:15.454963 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:15.455006 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHPort
I0805 12:49:15.455185 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHPort
I0805 12:49:15.455278 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHKeyPath
I0805 12:49:15.455393 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHKeyPath
I0805 12:49:15.455445 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHUsername
I0805 12:49:15.455575 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetSSHUsername
I0805 12:49:15.455618 443495 sshutil.go:53] new ssh client: &{IP:192.168.61.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19377-383955/.minikube/machines/old-k8s-version-635707/id_rsa Username:docker}
I0805 12:49:15.455758 443495 sshutil.go:53] new ssh client: &{IP:192.168.61.41 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19377-383955/.minikube/machines/old-k8s-version-635707/id_rsa Username:docker}
I0805 12:49:15.542082 443495 ssh_runner.go:195] Run: systemctl --version
I0805 12:49:15.569475 443495 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0805 12:49:15.753470 443495 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0805 12:49:15.760409 443495 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0805 12:49:15.760498 443495 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0805 12:49:15.782691 443495 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0805 12:49:15.782722 443495 start.go:495] detecting cgroup driver to use...
I0805 12:49:15.782804 443495 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0805 12:49:15.804272 443495 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0805 12:49:15.821752 443495 docker.go:217] disabling cri-docker service (if available) ...
I0805 12:49:15.821829 443495 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0805 12:49:15.838339 443495 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0805 12:49:15.854221 443495 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0805 12:49:15.998351 443495 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0805 12:49:16.176774 443495 docker.go:233] disabling docker service ...
I0805 12:49:16.176854 443495 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0805 12:49:16.192135 443495 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0805 12:49:16.216154 443495 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0805 12:49:16.387805 443495 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0805 12:49:16.535489 443495 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0805 12:49:16.550750 443495 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0805 12:49:16.571226 443495 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0805 12:49:16.571290 443495 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0805 12:49:16.584982 443495 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0805 12:49:16.585066 443495 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0805 12:49:16.596806 443495 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0805 12:49:16.608698 443495 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0805 12:49:16.624578 443495 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0805 12:49:16.638575 443495 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0805 12:49:16.652059 443495 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0805 12:49:16.652129 443495 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0805 12:49:16.666551 443495 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0805 12:49:16.677716 443495 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0805 12:49:16.819660 443495 ssh_runner.go:195] Run: sudo systemctl restart crio
I0805 12:49:16.979229 443495 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0805 12:49:16.979343 443495 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0805 12:49:16.985615 443495 start.go:563] Will wait 60s for crictl version
I0805 12:49:16.985694 443495 ssh_runner.go:195] Run: which crictl
I0805 12:49:16.990610 443495 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0805 12:49:17.046653 443495 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0805 12:49:17.046750 443495 ssh_runner.go:195] Run: crio --version
I0805 12:49:17.084217 443495 ssh_runner.go:195] Run: crio --version
I0805 12:49:17.118165 443495 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0805 12:49:17.119673 443495 main.go:141] libmachine: (old-k8s-version-635707) Calling .GetIP
I0805 12:49:17.122993 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:17.123505 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2a:da:c5", ip: ""} in network mk-old-k8s-version-635707: {Iface:virbr3 ExpiryTime:2024-08-05 13:49:06 +0000 UTC Type:0 Mac:52:54:00:2a:da:c5 Iaid: IPaddr:192.168.61.41 Prefix:24 Hostname:old-k8s-version-635707 Clientid:01:52:54:00:2a:da:c5}
I0805 12:49:17.123584 443495 main.go:141] libmachine: (old-k8s-version-635707) DBG | domain old-k8s-version-635707 has defined IP address 192.168.61.41 and MAC address 52:54:00:2a:da:c5 in network mk-old-k8s-version-635707
I0805 12:49:17.123880 443495 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0805 12:49:17.129203 443495 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0805 12:49:17.146632 443495 kubeadm.go:883] updating cluster {Name:old-k8s-version-635707 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-635707 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.41 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0805 12:49:17.146768 443495 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0805 12:49:17.146832 443495 ssh_runner.go:195] Run: sudo crictl images --output json
I0805 12:49:17.188061 443495 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0805 12:49:17.188144 443495 ssh_runner.go:195] Run: which lz4
I0805 12:49:17.192320 443495 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0805 12:49:17.196768 443495 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0805 12:49:17.196797 443495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19377-383955/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0805 12:49:18.914207 443495 crio.go:462] duration metric: took 1.721914912s to copy over tarball
I0805 12:49:18.914297 443495 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0805 12:49:21.635846 443495 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.721514429s)
I0805 12:49:21.635895 443495 crio.go:469] duration metric: took 2.721656941s to extract the tarball
I0805 12:49:21.635906 443495 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0805 12:49:21.692883 443495 ssh_runner.go:195] Run: sudo crictl images --output json
I0805 12:49:21.778146 443495 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0805 12:49:21.778182 443495 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0805 12:49:21.778305 443495 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0805 12:49:21.778354 443495 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0805 12:49:21.778457 443495 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0805 12:49:21.778315 443495 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0805 12:49:21.778666 443495 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0805 12:49:21.778315 443495 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0805 12:49:21.778521 443495 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0805 12:49:21.779456 443495 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0805 12:49:21.781832 443495 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0805 12:49:21.781894 443495 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0805 12:49:21.782160 443495 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0805 12:49:21.782381 443495 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0805 12:49:21.782425 443495 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0805 12:49:21.782552 443495 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0805 12:49:21.782634 443495 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0805 12:49:21.783284 443495 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0805 12:49:21.918393 443495 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0805 12:49:21.927262 443495 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0805 12:49:21.927317 443495 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0805 12:49:21.927478 443495 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0805 12:49:21.951443 443495 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0805 12:49:21.954109 443495 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0805 12:49:21.961975 443495 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0805 12:49:21.978965 443495 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0805 12:49:21.979018 443495 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0805 12:49:21.979075 443495 ssh_runner.go:195] Run: which crictl
I0805 12:49:22.097233 443495 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0805 12:49:22.097286 443495 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0805 12:49:22.097343 443495 ssh_runner.go:195] Run: which crictl
I0805 12:49:22.111987 443495 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0805 12:49:22.112035 443495 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0805 12:49:22.112071 443495 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0805 12:49:22.112039 443495 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0805 12:49:22.112136 443495 ssh_runner.go:195] Run: which crictl
I0805 12:49:22.112136 443495 ssh_runner.go:195] Run: which crictl
I0805 12:49:22.112067 443495 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0805 12:49:22.112184 443495 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0805 12:49:22.112207 443495 ssh_runner.go:195] Run: which crictl
I0805 12:49:22.123083 443495 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0805 12:49:22.123100 443495 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0805 12:49:22.123135 443495 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0805 12:49:22.123135 443495 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0805 12:49:22.123168 443495 ssh_runner.go:195] Run: which crictl
I0805 12:49:22.123184 443495 ssh_runner.go:195] Run: which crictl
I0805 12:49:22.123201 443495 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0805 12:49:22.123169 443495 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0805 12:49:22.126673 443495 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0805 12:49:22.126726 443495 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0805 12:49:22.126742 443495 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0805 12:49:22.135250 443495 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0805 12:49:22.135428 443495 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0805 12:49:22.288418 443495 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19377-383955/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0805 12:49:22.288418 443495 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19377-383955/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0805 12:49:22.288464 443495 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19377-383955/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0805 12:49:22.300591 443495 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19377-383955/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0805 12:49:22.300599 443495 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19377-383955/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0805 12:49:22.300622 443495 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19377-383955/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0805 12:49:22.300634 443495 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19377-383955/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0805 12:49:22.660736 443495 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0805 12:49:22.803104 443495 cache_images.go:92] duration metric: took 1.024889827s to LoadCachedImages
W0805 12:49:22.803196 443495 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19377-383955/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19377-383955/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I0805 12:49:22.803212 443495 kubeadm.go:934] updating node { 192.168.61.41 8443 v1.20.0 crio true true} ...
I0805 12:49:22.803434 443495 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-635707 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.41
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-635707 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0805 12:49:22.803540 443495 ssh_runner.go:195] Run: crio config
I0805 12:49:22.862889 443495 cni.go:84] Creating CNI manager for ""
I0805 12:49:22.862910 443495 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0805 12:49:22.862931 443495 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0805 12:49:22.862953 443495 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.41 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-635707 NodeName:old-k8s-version-635707 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.41"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.41 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0805 12:49:22.863114 443495 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.41
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-635707"
kubeletExtraArgs:
node-ip: 192.168.61.41
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.41"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0805 12:49:22.863197 443495 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0805 12:49:22.873685 443495 binaries.go:44] Found k8s binaries, skipping transfer
I0805 12:49:22.873772 443495 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0805 12:49:22.884187 443495 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0805 12:49:22.901705 443495 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0805 12:49:22.919606 443495 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0805 12:49:22.936664 443495 ssh_runner.go:195] Run: grep 192.168.61.41 control-plane.minikube.internal$ /etc/hosts
I0805 12:49:22.940870 443495 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.41 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0805 12:49:22.954239 443495 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0805 12:49:23.084915 443495 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0805 12:49:23.103117 443495 certs.go:68] Setting up /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707 for IP: 192.168.61.41
I0805 12:49:23.103142 443495 certs.go:194] generating shared ca certs ...
I0805 12:49:23.103162 443495 certs.go:226] acquiring lock for ca certs: {Name:mk0abfcaff3883fbb5243c47b487f9200d9166d5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 12:49:23.103347 443495 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19377-383955/.minikube/ca.key
I0805 12:49:23.103487 443495 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19377-383955/.minikube/proxy-client-ca.key
I0805 12:49:23.103511 443495 certs.go:256] generating profile certs ...
I0805 12:49:23.103596 443495 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/client.key
I0805 12:49:23.103618 443495 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/client.crt with IP's: []
I0805 12:49:23.259556 443495 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/client.crt ...
I0805 12:49:23.259591 443495 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/client.crt: {Name:mkd2cc07886911cfe0c2a3c7cae99af56f451879 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 12:49:23.290177 443495 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/client.key ...
I0805 12:49:23.290230 443495 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/client.key: {Name:mk638bc3f2f7f7edd1ec5b5c7e39bc9f72739a3a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 12:49:23.290417 443495 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/apiserver.key.3f42c485
I0805 12:49:23.290451 443495 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/apiserver.crt.3f42c485 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.41]
I0805 12:49:23.666954 443495 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/apiserver.crt.3f42c485 ...
I0805 12:49:23.666989 443495 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/apiserver.crt.3f42c485: {Name:mk494bedf22acce02cf8b48176df345e86c812b0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 12:49:23.667210 443495 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/apiserver.key.3f42c485 ...
I0805 12:49:23.667230 443495 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/apiserver.key.3f42c485: {Name:mk4fea6df141df18cdc2118c267c013c25946e0c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 12:49:23.667334 443495 certs.go:381] copying /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/apiserver.crt.3f42c485 -> /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/apiserver.crt
I0805 12:49:23.667466 443495 certs.go:385] copying /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/apiserver.key.3f42c485 -> /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/apiserver.key
I0805 12:49:23.667560 443495 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/proxy-client.key
I0805 12:49:23.667585 443495 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/proxy-client.crt with IP's: []
I0805 12:49:23.844781 443495 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/proxy-client.crt ...
I0805 12:49:23.844813 443495 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/proxy-client.crt: {Name:mke3573f0b2ace1bfa7259ac246466033f717156 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 12:49:23.845037 443495 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/proxy-client.key ...
I0805 12:49:23.845055 443495 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/proxy-client.key: {Name:mk59b6c8f2ae31e7da99de5261c6ab230ee0b1a0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0805 12:49:23.845298 443495 certs.go:484] found cert: /home/jenkins/minikube-integration/19377-383955/.minikube/certs/391219.pem (1338 bytes)
W0805 12:49:23.845345 443495 certs.go:480] ignoring /home/jenkins/minikube-integration/19377-383955/.minikube/certs/391219_empty.pem, impossibly tiny 0 bytes
I0805 12:49:23.845361 443495 certs.go:484] found cert: /home/jenkins/minikube-integration/19377-383955/.minikube/certs/ca-key.pem (1679 bytes)
I0805 12:49:23.845400 443495 certs.go:484] found cert: /home/jenkins/minikube-integration/19377-383955/.minikube/certs/ca.pem (1082 bytes)
I0805 12:49:23.845431 443495 certs.go:484] found cert: /home/jenkins/minikube-integration/19377-383955/.minikube/certs/cert.pem (1123 bytes)
I0805 12:49:23.845466 443495 certs.go:484] found cert: /home/jenkins/minikube-integration/19377-383955/.minikube/certs/key.pem (1675 bytes)
I0805 12:49:23.845520 443495 certs.go:484] found cert: /home/jenkins/minikube-integration/19377-383955/.minikube/files/etc/ssl/certs/3912192.pem (1708 bytes)
I0805 12:49:23.846568 443495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19377-383955/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0805 12:49:23.883176 443495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19377-383955/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0805 12:49:23.919923 443495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19377-383955/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0805 12:49:23.959988 443495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19377-383955/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0805 12:49:24.001964 443495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0805 12:49:24.070742 443495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0805 12:49:24.104480 443495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0805 12:49:24.151467 443495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19377-383955/.minikube/profiles/old-k8s-version-635707/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0805 12:49:24.199315 443495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19377-383955/.minikube/files/etc/ssl/certs/3912192.pem --> /usr/share/ca-certificates/3912192.pem (1708 bytes)
I0805 12:49:24.235482 443495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19377-383955/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0805 12:49:24.272951 443495 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19377-383955/.minikube/certs/391219.pem --> /usr/share/ca-certificates/391219.pem (1338 bytes)
I0805 12:49:24.305993 443495 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0805 12:49:24.327057 443495 ssh_runner.go:195] Run: openssl version
I0805 12:49:24.336352 443495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3912192.pem && ln -fs /usr/share/ca-certificates/3912192.pem /etc/ssl/certs/3912192.pem"
I0805 12:49:24.355759 443495 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3912192.pem
I0805 12:49:24.362757 443495 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 5 11:39 /usr/share/ca-certificates/3912192.pem
I0805 12:49:24.362833 443495 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3912192.pem
I0805 12:49:24.371407 443495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3912192.pem /etc/ssl/certs/3ec20f2e.0"
I0805 12:49:24.390280 443495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0805 12:49:24.403831 443495 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0805 12:49:24.409152 443495 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 5 11:28 /usr/share/ca-certificates/minikubeCA.pem
I0805 12:49:24.409227 443495 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0805 12:49:24.416464 443495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0805 12:49:24.432553 443495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/391219.pem && ln -fs /usr/share/ca-certificates/391219.pem /etc/ssl/certs/391219.pem"
I0805 12:49:24.445420 443495 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/391219.pem
I0805 12:49:24.450462 443495 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 5 11:39 /usr/share/ca-certificates/391219.pem
I0805 12:49:24.450532 443495 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/391219.pem
I0805 12:49:24.456817 443495 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/391219.pem /etc/ssl/certs/51391683.0"
I0805 12:49:24.472900 443495 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0805 12:49:24.478737 443495 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0805 12:49:24.478803 443495 kubeadm.go:392] StartCluster: {Name:old-k8s-version-635707 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-635707 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.41 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0805 12:49:24.478884 443495 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0805 12:49:24.478948 443495 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0805 12:49:24.530012 443495 cri.go:89] found id: ""
I0805 12:49:24.530078 443495 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0805 12:49:24.541098 443495 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0805 12:49:24.552243 443495 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0805 12:49:24.565729 443495 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0805 12:49:24.565753 443495 kubeadm.go:157] found existing configuration files:
I0805 12:49:24.565799 443495 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0805 12:49:24.576922 443495 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0805 12:49:24.577004 443495 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0805 12:49:24.589785 443495 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0805 12:49:24.601668 443495 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0805 12:49:24.601749 443495 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0805 12:49:24.615884 443495 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0805 12:49:24.626266 443495 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0805 12:49:24.626337 443495 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0805 12:49:24.637036 443495 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0805 12:49:24.647108 443495 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0805 12:49:24.647177 443495 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0805 12:49:24.657482 443495 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0805 12:49:24.839102 443495 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0805 12:49:24.839212 443495 kubeadm.go:310] [preflight] Running pre-flight checks
I0805 12:49:25.013609 443495 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0805 12:49:25.013761 443495 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0805 12:49:25.013913 443495 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0805 12:49:25.244085 443495 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0805 12:49:25.245765 443495 out.go:204] - Generating certificates and keys ...
I0805 12:49:25.245869 443495 kubeadm.go:310] [certs] Using existing ca certificate authority
I0805 12:49:25.245960 443495 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0805 12:49:25.527923 443495 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0805 12:49:25.904978 443495 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0805 12:49:26.523210 443495 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0805 12:49:26.996199 443495 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0805 12:49:27.157988 443495 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0805 12:49:27.158211 443495 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-635707] and IPs [192.168.61.41 127.0.0.1 ::1]
I0805 12:49:27.566009 443495 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0805 12:49:27.566213 443495 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-635707] and IPs [192.168.61.41 127.0.0.1 ::1]
I0805 12:49:27.835335 443495 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0805 12:49:28.256225 443495 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0805 12:49:28.391069 443495 kubeadm.go:310] [certs] Generating "sa" key and public key
I0805 12:49:28.391219 443495 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0805 12:49:28.524686 443495 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0805 12:49:28.609673 443495 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0805 12:49:28.808695 443495 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0805 12:49:29.065039 443495 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0805 12:49:29.089523 443495 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0805 12:49:29.091818 443495 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0805 12:49:29.091937 443495 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0805 12:49:29.236336 443495 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0805 12:49:29.238284 443495 out.go:204] - Booting up control plane ...
I0805 12:49:29.238419 443495 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0805 12:49:29.250371 443495 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0805 12:49:29.251403 443495 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0805 12:49:29.252472 443495 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0805 12:49:29.258920 443495 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0805 12:50:09.202579 443495 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0805 12:50:09.202702 443495 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0805 12:50:09.203106 443495 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0805 12:50:14.203562 443495 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0805 12:50:14.203865 443495 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0805 12:50:24.203093 443495 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0805 12:50:24.203340 443495 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0805 12:50:44.203615 443495 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0805 12:50:44.203986 443495 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0805 12:51:24.205496 443495 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0805 12:51:24.206016 443495 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0805 12:51:24.206042 443495 kubeadm.go:310]
I0805 12:51:24.206156 443495 kubeadm.go:310] Unfortunately, an error has occurred:
I0805 12:51:24.206258 443495 kubeadm.go:310] timed out waiting for the condition
I0805 12:51:24.206269 443495 kubeadm.go:310]
I0805 12:51:24.206346 443495 kubeadm.go:310] This error is likely caused by:
I0805 12:51:24.206430 443495 kubeadm.go:310] - The kubelet is not running
I0805 12:51:24.206698 443495 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0805 12:51:24.206711 443495 kubeadm.go:310]
I0805 12:51:24.206951 443495 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0805 12:51:24.207045 443495 kubeadm.go:310] - 'systemctl status kubelet'
I0805 12:51:24.207160 443495 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0805 12:51:24.207181 443495 kubeadm.go:310]
I0805 12:51:24.207425 443495 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0805 12:51:24.207585 443495 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0805 12:51:24.207601 443495 kubeadm.go:310]
I0805 12:51:24.207818 443495 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0805 12:51:24.208056 443495 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0805 12:51:24.208225 443495 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0805 12:51:24.208669 443495 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0805 12:51:24.208699 443495 kubeadm.go:310]
I0805 12:51:24.209195 443495 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0805 12:51:24.209329 443495 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0805 12:51:24.209483 443495 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0805 12:51:24.209618 443495 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-635707] and IPs [192.168.61.41 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-635707] and IPs [192.168.61.41 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-635707] and IPs [192.168.61.41 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-635707] and IPs [192.168.61.41 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0805 12:51:24.209710 443495 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0805 12:51:25.257742 443495 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.047991794s)
I0805 12:51:25.257838 443495 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0805 12:51:25.271938 443495 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0805 12:51:25.281882 443495 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0805 12:51:25.281907 443495 kubeadm.go:157] found existing configuration files:
I0805 12:51:25.281969 443495 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0805 12:51:25.291153 443495 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0805 12:51:25.291216 443495 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0805 12:51:25.300364 443495 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0805 12:51:25.309291 443495 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0805 12:51:25.309348 443495 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0805 12:51:25.318519 443495 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0805 12:51:25.327319 443495 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0805 12:51:25.327374 443495 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0805 12:51:25.336619 443495 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0805 12:51:25.345353 443495 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0805 12:51:25.345403 443495 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0805 12:51:25.354324 443495 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0805 12:51:25.437786 443495 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0805 12:51:25.437895 443495 kubeadm.go:310] [preflight] Running pre-flight checks
I0805 12:51:25.581908 443495 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0805 12:51:25.582005 443495 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0805 12:51:25.582098 443495 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0805 12:51:25.770315 443495 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0805 12:51:25.773209 443495 out.go:204] - Generating certificates and keys ...
I0805 12:51:25.773325 443495 kubeadm.go:310] [certs] Using existing ca certificate authority
I0805 12:51:25.773407 443495 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0805 12:51:25.773499 443495 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0805 12:51:25.773559 443495 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0805 12:51:25.773639 443495 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0805 12:51:25.773686 443495 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0805 12:51:25.773737 443495 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0805 12:51:25.773788 443495 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0805 12:51:25.773848 443495 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0805 12:51:25.773935 443495 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0805 12:51:25.773977 443495 kubeadm.go:310] [certs] Using the existing "sa" key
I0805 12:51:25.774025 443495 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0805 12:51:26.016866 443495 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0805 12:51:26.098925 443495 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0805 12:51:26.198868 443495 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0805 12:51:26.261939 443495 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0805 12:51:26.282656 443495 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0805 12:51:26.284901 443495 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0805 12:51:26.285114 443495 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0805 12:51:26.434310 443495 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0805 12:51:26.436107 443495 out.go:204] - Booting up control plane ...
I0805 12:51:26.436221 443495 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0805 12:51:26.442907 443495 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0805 12:51:26.443955 443495 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0805 12:51:26.444811 443495 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0805 12:51:26.447065 443495 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0805 12:52:06.447405 443495 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0805 12:52:06.448340 443495 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0805 12:52:06.448526 443495 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0805 12:52:11.448690 443495 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0805 12:52:11.448897 443495 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0805 12:52:21.449466 443495 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0805 12:52:21.449708 443495 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0805 12:52:41.450504 443495 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0805 12:52:41.450728 443495 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0805 12:53:21.452551 443495 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0805 12:53:21.452802 443495 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0805 12:53:21.452829 443495 kubeadm.go:310]
I0805 12:53:21.452904 443495 kubeadm.go:310] Unfortunately, an error has occurred:
I0805 12:53:21.452969 443495 kubeadm.go:310] timed out waiting for the condition
I0805 12:53:21.452979 443495 kubeadm.go:310]
I0805 12:53:21.453019 443495 kubeadm.go:310] This error is likely caused by:
I0805 12:53:21.453074 443495 kubeadm.go:310] - The kubelet is not running
I0805 12:53:21.453221 443495 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0805 12:53:21.453233 443495 kubeadm.go:310]
I0805 12:53:21.453387 443495 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0805 12:53:21.453428 443495 kubeadm.go:310] - 'systemctl status kubelet'
I0805 12:53:21.453475 443495 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0805 12:53:21.453485 443495 kubeadm.go:310]
I0805 12:53:21.453631 443495 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0805 12:53:21.453763 443495 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0805 12:53:21.453778 443495 kubeadm.go:310]
I0805 12:53:21.453923 443495 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0805 12:53:21.454036 443495 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0805 12:53:21.454130 443495 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0805 12:53:21.454201 443495 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0805 12:53:21.454212 443495 kubeadm.go:310]
I0805 12:53:21.454581 443495 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0805 12:53:21.454665 443495 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0805 12:53:21.454833 443495 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0805 12:53:21.454926 443495 kubeadm.go:394] duration metric: took 3m56.976128941s to StartCluster
I0805 12:53:21.454975 443495 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0805 12:53:21.455032 443495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0805 12:53:21.494595 443495 cri.go:89] found id: ""
I0805 12:53:21.494635 443495 logs.go:276] 0 containers: []
W0805 12:53:21.494647 443495 logs.go:278] No container was found matching "kube-apiserver"
I0805 12:53:21.494655 443495 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0805 12:53:21.494727 443495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0805 12:53:21.528772 443495 cri.go:89] found id: ""
I0805 12:53:21.528807 443495 logs.go:276] 0 containers: []
W0805 12:53:21.528817 443495 logs.go:278] No container was found matching "etcd"
I0805 12:53:21.528826 443495 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0805 12:53:21.528890 443495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0805 12:53:21.562837 443495 cri.go:89] found id: ""
I0805 12:53:21.562873 443495 logs.go:276] 0 containers: []
W0805 12:53:21.562883 443495 logs.go:278] No container was found matching "coredns"
I0805 12:53:21.562890 443495 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0805 12:53:21.562965 443495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0805 12:53:21.598188 443495 cri.go:89] found id: ""
I0805 12:53:21.598227 443495 logs.go:276] 0 containers: []
W0805 12:53:21.598238 443495 logs.go:278] No container was found matching "kube-scheduler"
I0805 12:53:21.598246 443495 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0805 12:53:21.598312 443495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0805 12:53:21.632506 443495 cri.go:89] found id: ""
I0805 12:53:21.632535 443495 logs.go:276] 0 containers: []
W0805 12:53:21.632544 443495 logs.go:278] No container was found matching "kube-proxy"
I0805 12:53:21.632551 443495 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0805 12:53:21.632605 443495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0805 12:53:21.667083 443495 cri.go:89] found id: ""
I0805 12:53:21.667122 443495 logs.go:276] 0 containers: []
W0805 12:53:21.667134 443495 logs.go:278] No container was found matching "kube-controller-manager"
I0805 12:53:21.667142 443495 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0805 12:53:21.667209 443495 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0805 12:53:21.702491 443495 cri.go:89] found id: ""
I0805 12:53:21.702518 443495 logs.go:276] 0 containers: []
W0805 12:53:21.702530 443495 logs.go:278] No container was found matching "kindnet"
I0805 12:53:21.702544 443495 logs.go:123] Gathering logs for describe nodes ...
I0805 12:53:21.702561 443495 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0805 12:53:21.817391 443495 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0805 12:53:21.817412 443495 logs.go:123] Gathering logs for CRI-O ...
I0805 12:53:21.817432 443495 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0805 12:53:21.913711 443495 logs.go:123] Gathering logs for container status ...
I0805 12:53:21.913753 443495 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0805 12:53:21.967461 443495 logs.go:123] Gathering logs for kubelet ...
I0805 12:53:21.967492 443495 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0805 12:53:22.015432 443495 logs.go:123] Gathering logs for dmesg ...
I0805 12:53:22.015467 443495 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
W0805 12:53:22.028419 443495 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0805 12:53:22.028458 443495 out.go:239] *
*
W0805 12:53:22.028518 443495 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0805 12:53:22.028540 443495 out.go:239] *
*
W0805 12:53:22.029629 443495 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0805 12:53:22.033000 443495 out.go:177]
W0805 12:53:22.034211 443495 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0805 12:53:22.034254 443495 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0805 12:53:22.034270 443495 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0805 12:53:22.036498 443495 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-635707 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-635707 -n old-k8s-version-635707
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-635707 -n old-k8s-version-635707: exit status 6 (216.31891ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0805 12:53:22.301984 450248 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-635707" does not appear in /home/jenkins/minikube-integration/19377-383955/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-635707" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (300.67s)