=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-564860 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-564860 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (5m27.395553728s)
-- stdout --
* [old-k8s-version-564860] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18703
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18703-76456/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18703-76456/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-564860" primary control-plane node in "old-k8s-version-564860" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0420 01:14:27.698927 134009 out.go:291] Setting OutFile to fd 1 ...
I0420 01:14:27.699197 134009 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0420 01:14:27.699206 134009 out.go:304] Setting ErrFile to fd 2...
I0420 01:14:27.699211 134009 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0420 01:14:27.699394 134009 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18703-76456/.minikube/bin
I0420 01:14:27.699985 134009 out.go:298] Setting JSON to false
I0420 01:14:27.701049 134009 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":14215,"bootTime":1713561453,"procs":349,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0420 01:14:27.701113 134009 start.go:139] virtualization: kvm guest
I0420 01:14:27.703567 134009 out.go:177] * [old-k8s-version-564860] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)
I0420 01:14:27.705181 134009 out.go:177] - MINIKUBE_LOCATION=18703
I0420 01:14:27.706716 134009 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0420 01:14:27.705141 134009 notify.go:220] Checking for updates...
I0420 01:14:27.708213 134009 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18703-76456/kubeconfig
I0420 01:14:27.709597 134009 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18703-76456/.minikube
I0420 01:14:27.710955 134009 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0420 01:14:27.712320 134009 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0420 01:14:27.714054 134009 config.go:182] Loaded profile config "calico-831611": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0420 01:14:27.714153 134009 config.go:182] Loaded profile config "custom-flannel-831611": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0420 01:14:27.714225 134009 config.go:182] Loaded profile config "flannel-831611": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0420 01:14:27.714310 134009 driver.go:392] Setting default libvirt URI to qemu:///system
I0420 01:14:27.752898 134009 out.go:177] * Using the kvm2 driver based on user configuration
I0420 01:14:27.754160 134009 start.go:297] selected driver: kvm2
I0420 01:14:27.754180 134009 start.go:901] validating driver "kvm2" against <nil>
I0420 01:14:27.754204 134009 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0420 01:14:27.755234 134009 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0420 01:14:27.755349 134009 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18703-76456/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0420 01:14:27.772308 134009 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0
I0420 01:14:27.772352 134009 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0420 01:14:27.772542 134009 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0420 01:14:27.772598 134009 cni.go:84] Creating CNI manager for ""
I0420 01:14:27.772609 134009 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0420 01:14:27.772621 134009 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0420 01:14:27.772673 134009 start.go:340] cluster config:
{Name:old-k8s-version-564860 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-564860 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0420 01:14:27.772796 134009 iso.go:125] acquiring lock: {Name:mk84b6faf36a4fd912f40504fcac14cc85cea6d3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0420 01:14:27.774516 134009 out.go:177] * Starting "old-k8s-version-564860" primary control-plane node in "old-k8s-version-564860" cluster
I0420 01:14:27.775713 134009 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0420 01:14:27.775752 134009 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18703-76456/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0420 01:14:27.775766 134009 cache.go:56] Caching tarball of preloaded images
I0420 01:14:27.775848 134009 preload.go:173] Found /home/jenkins/minikube-integration/18703-76456/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0420 01:14:27.775861 134009 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0420 01:14:27.775979 134009 profile.go:143] Saving config to /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/config.json ...
I0420 01:14:27.776007 134009 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/config.json: {Name:mk40da66360b6817556d69b4da034d7fea18ad57 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0420 01:14:27.776152 134009 start.go:360] acquireMachinesLock for old-k8s-version-564860: {Name:mk13b4d07514800a45d583c31ae5b496189ee3e9 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0420 01:15:13.355820 134009 start.go:364] duration metric: took 45.579619767s to acquireMachinesLock for "old-k8s-version-564860"
I0420 01:15:13.355883 134009 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-564860 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.33.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-564860 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0420 01:15:13.356088 134009 start.go:125] createHost starting for "" (driver="kvm2")
I0420 01:15:13.359120 134009 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0420 01:15:13.359379 134009 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0420 01:15:13.359430 134009 main.go:141] libmachine: Launching plugin server for driver kvm2
I0420 01:15:13.378782 134009 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34457
I0420 01:15:13.379249 134009 main.go:141] libmachine: () Calling .GetVersion
I0420 01:15:13.379807 134009 main.go:141] libmachine: Using API Version 1
I0420 01:15:13.379846 134009 main.go:141] libmachine: () Calling .SetConfigRaw
I0420 01:15:13.380199 134009 main.go:141] libmachine: () Calling .GetMachineName
I0420 01:15:13.380386 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetMachineName
I0420 01:15:13.380538 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .DriverName
I0420 01:15:13.380691 134009 start.go:159] libmachine.API.Create for "old-k8s-version-564860" (driver="kvm2")
I0420 01:15:13.380721 134009 client.go:168] LocalClient.Create starting
I0420 01:15:13.380758 134009 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18703-76456/.minikube/certs/ca.pem
I0420 01:15:13.380793 134009 main.go:141] libmachine: Decoding PEM data...
I0420 01:15:13.380821 134009 main.go:141] libmachine: Parsing certificate...
I0420 01:15:13.380904 134009 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18703-76456/.minikube/certs/cert.pem
I0420 01:15:13.380928 134009 main.go:141] libmachine: Decoding PEM data...
I0420 01:15:13.380947 134009 main.go:141] libmachine: Parsing certificate...
I0420 01:15:13.380977 134009 main.go:141] libmachine: Running pre-create checks...
I0420 01:15:13.380991 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .PreCreateCheck
I0420 01:15:13.381290 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetConfigRaw
I0420 01:15:13.381704 134009 main.go:141] libmachine: Creating machine...
I0420 01:15:13.381724 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .Create
I0420 01:15:13.381902 134009 main.go:141] libmachine: (old-k8s-version-564860) Creating KVM machine...
I0420 01:15:13.383187 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found existing default KVM network
I0420 01:15:13.384491 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:13.384330 135812 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:25:52:c1} reservation:<nil>}
I0420 01:15:13.385354 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:13.385238 135812 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:1e:a2:f1} reservation:<nil>}
I0420 01:15:13.386538 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:13.386441 135812 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002ae620}
I0420 01:15:13.386562 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | created network xml:
I0420 01:15:13.386574 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | <network>
I0420 01:15:13.386588 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | <name>mk-old-k8s-version-564860</name>
I0420 01:15:13.386599 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | <dns enable='no'/>
I0420 01:15:13.386606 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG |
I0420 01:15:13.386619 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0420 01:15:13.386634 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | <dhcp>
I0420 01:15:13.386648 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0420 01:15:13.386660 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | </dhcp>
I0420 01:15:13.386687 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | </ip>
I0420 01:15:13.386710 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG |
I0420 01:15:13.386723 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | </network>
I0420 01:15:13.386735 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG |
I0420 01:15:13.392371 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | trying to create private KVM network mk-old-k8s-version-564860 192.168.61.0/24...
I0420 01:15:13.473890 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | private KVM network mk-old-k8s-version-564860 192.168.61.0/24 created
I0420 01:15:13.473921 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:13.473847 135812 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18703-76456/.minikube
I0420 01:15:13.473934 134009 main.go:141] libmachine: (old-k8s-version-564860) Setting up store path in /home/jenkins/minikube-integration/18703-76456/.minikube/machines/old-k8s-version-564860 ...
I0420 01:15:13.473971 134009 main.go:141] libmachine: (old-k8s-version-564860) Building disk image from file:///home/jenkins/minikube-integration/18703-76456/.minikube/cache/iso/amd64/minikube-v1.33.0-amd64.iso
I0420 01:15:13.473988 134009 main.go:141] libmachine: (old-k8s-version-564860) Downloading /home/jenkins/minikube-integration/18703-76456/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18703-76456/.minikube/cache/iso/amd64/minikube-v1.33.0-amd64.iso...
I0420 01:15:13.796165 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:13.796033 135812 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18703-76456/.minikube/machines/old-k8s-version-564860/id_rsa...
I0420 01:15:13.945445 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:13.945236 135812 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18703-76456/.minikube/machines/old-k8s-version-564860/old-k8s-version-564860.rawdisk...
I0420 01:15:13.945486 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | Writing magic tar header
I0420 01:15:13.945507 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | Writing SSH key tar header
I0420 01:15:13.945521 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:13.945399 135812 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18703-76456/.minikube/machines/old-k8s-version-564860 ...
I0420 01:15:13.945544 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18703-76456/.minikube/machines/old-k8s-version-564860
I0420 01:15:13.945642 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18703-76456/.minikube/machines
I0420 01:15:13.945671 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18703-76456/.minikube
I0420 01:15:13.945688 134009 main.go:141] libmachine: (old-k8s-version-564860) Setting executable bit set on /home/jenkins/minikube-integration/18703-76456/.minikube/machines/old-k8s-version-564860 (perms=drwx------)
I0420 01:15:13.945724 134009 main.go:141] libmachine: (old-k8s-version-564860) Setting executable bit set on /home/jenkins/minikube-integration/18703-76456/.minikube/machines (perms=drwxr-xr-x)
I0420 01:15:13.945739 134009 main.go:141] libmachine: (old-k8s-version-564860) Setting executable bit set on /home/jenkins/minikube-integration/18703-76456/.minikube (perms=drwxr-xr-x)
I0420 01:15:13.945754 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18703-76456
I0420 01:15:13.945780 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0420 01:15:13.945799 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | Checking permissions on dir: /home/jenkins
I0420 01:15:13.945832 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | Checking permissions on dir: /home
I0420 01:15:13.945862 134009 main.go:141] libmachine: (old-k8s-version-564860) Setting executable bit set on /home/jenkins/minikube-integration/18703-76456 (perms=drwxrwxr-x)
I0420 01:15:13.945876 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | Skipping /home - not owner
I0420 01:15:13.945897 134009 main.go:141] libmachine: (old-k8s-version-564860) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0420 01:15:13.945918 134009 main.go:141] libmachine: (old-k8s-version-564860) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0420 01:15:13.945934 134009 main.go:141] libmachine: (old-k8s-version-564860) Creating domain...
I0420 01:15:13.947321 134009 main.go:141] libmachine: (old-k8s-version-564860) define libvirt domain using xml:
I0420 01:15:13.947344 134009 main.go:141] libmachine: (old-k8s-version-564860) <domain type='kvm'>
I0420 01:15:13.947355 134009 main.go:141] libmachine: (old-k8s-version-564860) <name>old-k8s-version-564860</name>
I0420 01:15:13.947364 134009 main.go:141] libmachine: (old-k8s-version-564860) <memory unit='MiB'>2200</memory>
I0420 01:15:13.947373 134009 main.go:141] libmachine: (old-k8s-version-564860) <vcpu>2</vcpu>
I0420 01:15:13.947386 134009 main.go:141] libmachine: (old-k8s-version-564860) <features>
I0420 01:15:13.947395 134009 main.go:141] libmachine: (old-k8s-version-564860) <acpi/>
I0420 01:15:13.947416 134009 main.go:141] libmachine: (old-k8s-version-564860) <apic/>
I0420 01:15:13.947424 134009 main.go:141] libmachine: (old-k8s-version-564860) <pae/>
I0420 01:15:13.947444 134009 main.go:141] libmachine: (old-k8s-version-564860)
I0420 01:15:13.947456 134009 main.go:141] libmachine: (old-k8s-version-564860) </features>
I0420 01:15:13.947464 134009 main.go:141] libmachine: (old-k8s-version-564860) <cpu mode='host-passthrough'>
I0420 01:15:13.947478 134009 main.go:141] libmachine: (old-k8s-version-564860)
I0420 01:15:13.947485 134009 main.go:141] libmachine: (old-k8s-version-564860) </cpu>
I0420 01:15:13.947496 134009 main.go:141] libmachine: (old-k8s-version-564860) <os>
I0420 01:15:13.947508 134009 main.go:141] libmachine: (old-k8s-version-564860) <type>hvm</type>
I0420 01:15:13.947516 134009 main.go:141] libmachine: (old-k8s-version-564860) <boot dev='cdrom'/>
I0420 01:15:13.947527 134009 main.go:141] libmachine: (old-k8s-version-564860) <boot dev='hd'/>
I0420 01:15:13.947537 134009 main.go:141] libmachine: (old-k8s-version-564860) <bootmenu enable='no'/>
I0420 01:15:13.947547 134009 main.go:141] libmachine: (old-k8s-version-564860) </os>
I0420 01:15:13.947555 134009 main.go:141] libmachine: (old-k8s-version-564860) <devices>
I0420 01:15:13.947565 134009 main.go:141] libmachine: (old-k8s-version-564860) <disk type='file' device='cdrom'>
I0420 01:15:13.947579 134009 main.go:141] libmachine: (old-k8s-version-564860) <source file='/home/jenkins/minikube-integration/18703-76456/.minikube/machines/old-k8s-version-564860/boot2docker.iso'/>
I0420 01:15:13.947590 134009 main.go:141] libmachine: (old-k8s-version-564860) <target dev='hdc' bus='scsi'/>
I0420 01:15:13.947602 134009 main.go:141] libmachine: (old-k8s-version-564860) <readonly/>
I0420 01:15:13.947610 134009 main.go:141] libmachine: (old-k8s-version-564860) </disk>
I0420 01:15:13.947622 134009 main.go:141] libmachine: (old-k8s-version-564860) <disk type='file' device='disk'>
I0420 01:15:13.947635 134009 main.go:141] libmachine: (old-k8s-version-564860) <driver name='qemu' type='raw' cache='default' io='threads' />
I0420 01:15:13.947655 134009 main.go:141] libmachine: (old-k8s-version-564860) <source file='/home/jenkins/minikube-integration/18703-76456/.minikube/machines/old-k8s-version-564860/old-k8s-version-564860.rawdisk'/>
I0420 01:15:13.947668 134009 main.go:141] libmachine: (old-k8s-version-564860) <target dev='hda' bus='virtio'/>
I0420 01:15:13.947678 134009 main.go:141] libmachine: (old-k8s-version-564860) </disk>
I0420 01:15:13.947693 134009 main.go:141] libmachine: (old-k8s-version-564860) <interface type='network'>
I0420 01:15:13.947706 134009 main.go:141] libmachine: (old-k8s-version-564860) <source network='mk-old-k8s-version-564860'/>
I0420 01:15:13.947717 134009 main.go:141] libmachine: (old-k8s-version-564860) <model type='virtio'/>
I0420 01:15:13.947729 134009 main.go:141] libmachine: (old-k8s-version-564860) </interface>
I0420 01:15:13.947741 134009 main.go:141] libmachine: (old-k8s-version-564860) <interface type='network'>
I0420 01:15:13.947754 134009 main.go:141] libmachine: (old-k8s-version-564860) <source network='default'/>
I0420 01:15:13.947762 134009 main.go:141] libmachine: (old-k8s-version-564860) <model type='virtio'/>
I0420 01:15:13.947773 134009 main.go:141] libmachine: (old-k8s-version-564860) </interface>
I0420 01:15:13.947785 134009 main.go:141] libmachine: (old-k8s-version-564860) <serial type='pty'>
I0420 01:15:13.947799 134009 main.go:141] libmachine: (old-k8s-version-564860) <target port='0'/>
I0420 01:15:13.947809 134009 main.go:141] libmachine: (old-k8s-version-564860) </serial>
I0420 01:15:13.947823 134009 main.go:141] libmachine: (old-k8s-version-564860) <console type='pty'>
I0420 01:15:13.947835 134009 main.go:141] libmachine: (old-k8s-version-564860) <target type='serial' port='0'/>
I0420 01:15:13.947847 134009 main.go:141] libmachine: (old-k8s-version-564860) </console>
I0420 01:15:13.947867 134009 main.go:141] libmachine: (old-k8s-version-564860) <rng model='virtio'>
I0420 01:15:13.947881 134009 main.go:141] libmachine: (old-k8s-version-564860) <backend model='random'>/dev/random</backend>
I0420 01:15:13.947894 134009 main.go:141] libmachine: (old-k8s-version-564860) </rng>
I0420 01:15:13.947906 134009 main.go:141] libmachine: (old-k8s-version-564860)
I0420 01:15:13.947918 134009 main.go:141] libmachine: (old-k8s-version-564860)
I0420 01:15:13.947929 134009 main.go:141] libmachine: (old-k8s-version-564860) </devices>
I0420 01:15:13.947938 134009 main.go:141] libmachine: (old-k8s-version-564860) </domain>
I0420 01:15:13.947950 134009 main.go:141] libmachine: (old-k8s-version-564860)
I0420 01:15:13.952242 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:7a:dc:35 in network default
I0420 01:15:13.953159 134009 main.go:141] libmachine: (old-k8s-version-564860) Ensuring networks are active...
I0420 01:15:13.953194 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:13.954198 134009 main.go:141] libmachine: (old-k8s-version-564860) Ensuring network default is active
I0420 01:15:13.954619 134009 main.go:141] libmachine: (old-k8s-version-564860) Ensuring network mk-old-k8s-version-564860 is active
I0420 01:15:13.955305 134009 main.go:141] libmachine: (old-k8s-version-564860) Getting domain xml...
I0420 01:15:13.956524 134009 main.go:141] libmachine: (old-k8s-version-564860) Creating domain...
I0420 01:15:15.423993 134009 main.go:141] libmachine: (old-k8s-version-564860) Waiting to get IP...
I0420 01:15:15.424935 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:15.425454 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | unable to find current IP address of domain old-k8s-version-564860 in network mk-old-k8s-version-564860
I0420 01:15:15.425481 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:15.425439 135812 retry.go:31] will retry after 276.494348ms: waiting for machine to come up
I0420 01:15:15.704086 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:15.706906 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | unable to find current IP address of domain old-k8s-version-564860 in network mk-old-k8s-version-564860
I0420 01:15:15.706933 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:15.706774 135812 retry.go:31] will retry after 238.273522ms: waiting for machine to come up
I0420 01:15:15.946375 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:15.947054 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | unable to find current IP address of domain old-k8s-version-564860 in network mk-old-k8s-version-564860
I0420 01:15:15.947087 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:15.947003 135812 retry.go:31] will retry after 416.009171ms: waiting for machine to come up
I0420 01:15:16.364947 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:16.365576 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | unable to find current IP address of domain old-k8s-version-564860 in network mk-old-k8s-version-564860
I0420 01:15:16.365610 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:16.365531 135812 retry.go:31] will retry after 432.493828ms: waiting for machine to come up
I0420 01:15:16.799898 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:16.800675 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | unable to find current IP address of domain old-k8s-version-564860 in network mk-old-k8s-version-564860
I0420 01:15:16.800701 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:16.800587 135812 retry.go:31] will retry after 749.656308ms: waiting for machine to come up
I0420 01:15:17.551675 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:17.552326 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | unable to find current IP address of domain old-k8s-version-564860 in network mk-old-k8s-version-564860
I0420 01:15:17.552354 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:17.552266 135812 retry.go:31] will retry after 790.941572ms: waiting for machine to come up
I0420 01:15:18.346000 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:18.346614 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | unable to find current IP address of domain old-k8s-version-564860 in network mk-old-k8s-version-564860
I0420 01:15:18.346647 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:18.346559 135812 retry.go:31] will retry after 729.71766ms: waiting for machine to come up
I0420 01:15:19.077588 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:19.078160 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | unable to find current IP address of domain old-k8s-version-564860 in network mk-old-k8s-version-564860
I0420 01:15:19.078189 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:19.078134 135812 retry.go:31] will retry after 1.171510633s: waiting for machine to come up
I0420 01:15:20.251596 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:20.252145 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | unable to find current IP address of domain old-k8s-version-564860 in network mk-old-k8s-version-564860
I0420 01:15:20.252170 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:20.252103 135812 retry.go:31] will retry after 1.474656329s: waiting for machine to come up
I0420 01:15:21.728938 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:21.729539 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | unable to find current IP address of domain old-k8s-version-564860 in network mk-old-k8s-version-564860
I0420 01:15:21.729562 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:21.729498 135812 retry.go:31] will retry after 2.062935072s: waiting for machine to come up
I0420 01:15:23.793806 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:23.794216 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | unable to find current IP address of domain old-k8s-version-564860 in network mk-old-k8s-version-564860
I0420 01:15:23.794243 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:23.794179 135812 retry.go:31] will retry after 2.086584576s: waiting for machine to come up
I0420 01:15:25.882616 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:25.883071 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | unable to find current IP address of domain old-k8s-version-564860 in network mk-old-k8s-version-564860
I0420 01:15:25.883095 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:25.883019 135812 retry.go:31] will retry after 3.211046666s: waiting for machine to come up
I0420 01:15:29.095300 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:29.095690 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | unable to find current IP address of domain old-k8s-version-564860 in network mk-old-k8s-version-564860
I0420 01:15:29.095721 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:29.095651 135812 retry.go:31] will retry after 3.292557957s: waiting for machine to come up
I0420 01:15:32.389462 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:32.389940 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | unable to find current IP address of domain old-k8s-version-564860 in network mk-old-k8s-version-564860
I0420 01:15:32.389965 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:32.389892 135812 retry.go:31] will retry after 3.942404826s: waiting for machine to come up
I0420 01:15:36.334571 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:36.335096 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | unable to find current IP address of domain old-k8s-version-564860 in network mk-old-k8s-version-564860
I0420 01:15:36.335123 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | I0420 01:15:36.335041 135812 retry.go:31] will retry after 6.897730872s: waiting for machine to come up
I0420 01:15:43.236477 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:43.236965 134009 main.go:141] libmachine: (old-k8s-version-564860) Found IP for machine: 192.168.61.91
I0420 01:15:43.236995 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has current primary IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:43.237002 134009 main.go:141] libmachine: (old-k8s-version-564860) Reserving static IP address...
I0420 01:15:43.237386 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-564860", mac: "52:54:00:9d:63:09", ip: "192.168.61.91"} in network mk-old-k8s-version-564860
I0420 01:15:43.320184 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | Getting to WaitForSSH function...
I0420 01:15:43.320214 134009 main.go:141] libmachine: (old-k8s-version-564860) Reserved static IP address: 192.168.61.91
I0420 01:15:43.320229 134009 main.go:141] libmachine: (old-k8s-version-564860) Waiting for SSH to be available...
I0420 01:15:43.323060 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:43.323534 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:minikube Clientid:01:52:54:00:9d:63:09}
I0420 01:15:43.323563 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:43.323715 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | Using SSH client type: external
I0420 01:15:43.323737 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | Using SSH private key: /home/jenkins/minikube-integration/18703-76456/.minikube/machines/old-k8s-version-564860/id_rsa (-rw-------)
I0420 01:15:43.323778 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.91 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18703-76456/.minikube/machines/old-k8s-version-564860/id_rsa -p 22] /usr/bin/ssh <nil>}
I0420 01:15:43.323808 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | About to run SSH command:
I0420 01:15:43.323822 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | exit 0
I0420 01:15:43.449875 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | SSH cmd err, output: <nil>:
I0420 01:15:43.450207 134009 main.go:141] libmachine: (old-k8s-version-564860) KVM machine creation complete!
I0420 01:15:43.450491 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetConfigRaw
I0420 01:15:43.451156 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .DriverName
I0420 01:15:43.451366 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .DriverName
I0420 01:15:43.451533 134009 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0420 01:15:43.451555 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetState
I0420 01:15:43.453097 134009 main.go:141] libmachine: Detecting operating system of created instance...
I0420 01:15:43.453111 134009 main.go:141] libmachine: Waiting for SSH to be available...
I0420 01:15:43.453117 134009 main.go:141] libmachine: Getting to WaitForSSH function...
I0420 01:15:43.453122 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHHostname
I0420 01:15:43.455676 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:43.456115 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:old-k8s-version-564860 Clientid:01:52:54:00:9d:63:09}
I0420 01:15:43.456161 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:43.456229 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHPort
I0420 01:15:43.456440 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHKeyPath
I0420 01:15:43.456633 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHKeyPath
I0420 01:15:43.456784 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHUsername
I0420 01:15:43.456970 134009 main.go:141] libmachine: Using SSH client type: native
I0420 01:15:43.457176 134009 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.91 22 <nil> <nil>}
I0420 01:15:43.457191 134009 main.go:141] libmachine: About to run SSH command:
exit 0
I0420 01:15:43.561034 134009 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0420 01:15:43.561061 134009 main.go:141] libmachine: Detecting the provisioner...
I0420 01:15:43.561082 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHHostname
I0420 01:15:43.564161 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:43.564572 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:old-k8s-version-564860 Clientid:01:52:54:00:9d:63:09}
I0420 01:15:43.564607 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:43.564858 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHPort
I0420 01:15:43.565089 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHKeyPath
I0420 01:15:43.565285 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHKeyPath
I0420 01:15:43.565497 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHUsername
I0420 01:15:43.565708 134009 main.go:141] libmachine: Using SSH client type: native
I0420 01:15:43.565888 134009 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.91 22 <nil> <nil>}
I0420 01:15:43.565906 134009 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0420 01:15:43.670908 134009 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0420 01:15:43.670993 134009 main.go:141] libmachine: found compatible host: buildroot
I0420 01:15:43.671005 134009 main.go:141] libmachine: Provisioning with buildroot...
I0420 01:15:43.671024 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetMachineName
I0420 01:15:43.671345 134009 buildroot.go:166] provisioning hostname "old-k8s-version-564860"
I0420 01:15:43.671379 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetMachineName
I0420 01:15:43.671565 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHHostname
I0420 01:15:43.674539 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:43.674906 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:old-k8s-version-564860 Clientid:01:52:54:00:9d:63:09}
I0420 01:15:43.674936 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:43.675207 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHPort
I0420 01:15:43.675413 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHKeyPath
I0420 01:15:43.675602 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHKeyPath
I0420 01:15:43.675755 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHUsername
I0420 01:15:43.675907 134009 main.go:141] libmachine: Using SSH client type: native
I0420 01:15:43.676097 134009 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.91 22 <nil> <nil>}
I0420 01:15:43.676110 134009 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-564860 && echo "old-k8s-version-564860" | sudo tee /etc/hostname
I0420 01:15:43.802142 134009 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-564860
I0420 01:15:43.802177 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHHostname
I0420 01:15:43.805114 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:43.805537 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:old-k8s-version-564860 Clientid:01:52:54:00:9d:63:09}
I0420 01:15:43.805600 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:43.805789 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHPort
I0420 01:15:43.806033 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHKeyPath
I0420 01:15:43.806240 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHKeyPath
I0420 01:15:43.806431 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHUsername
I0420 01:15:43.806635 134009 main.go:141] libmachine: Using SSH client type: native
I0420 01:15:43.806857 134009 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.91 22 <nil> <nil>}
I0420 01:15:43.806884 134009 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-564860' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-564860/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-564860' | sudo tee -a /etc/hosts;
fi
fi
I0420 01:15:43.924687 134009 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0420 01:15:43.924730 134009 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18703-76456/.minikube CaCertPath:/home/jenkins/minikube-integration/18703-76456/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18703-76456/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18703-76456/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18703-76456/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18703-76456/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18703-76456/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18703-76456/.minikube}
I0420 01:15:43.924758 134009 buildroot.go:174] setting up certificates
I0420 01:15:43.924771 134009 provision.go:84] configureAuth start
I0420 01:15:43.924808 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetMachineName
I0420 01:15:43.925137 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetIP
I0420 01:15:43.928254 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:43.928679 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:old-k8s-version-564860 Clientid:01:52:54:00:9d:63:09}
I0420 01:15:43.928718 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:43.928917 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHHostname
I0420 01:15:43.931330 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:43.931676 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:old-k8s-version-564860 Clientid:01:52:54:00:9d:63:09}
I0420 01:15:43.931708 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:43.931882 134009 provision.go:143] copyHostCerts
I0420 01:15:43.931952 134009 exec_runner.go:144] found /home/jenkins/minikube-integration/18703-76456/.minikube/ca.pem, removing ...
I0420 01:15:43.931967 134009 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18703-76456/.minikube/ca.pem
I0420 01:15:43.932022 134009 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18703-76456/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18703-76456/.minikube/ca.pem (1078 bytes)
I0420 01:15:43.932169 134009 exec_runner.go:144] found /home/jenkins/minikube-integration/18703-76456/.minikube/cert.pem, removing ...
I0420 01:15:43.932179 134009 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18703-76456/.minikube/cert.pem
I0420 01:15:43.932202 134009 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18703-76456/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18703-76456/.minikube/cert.pem (1123 bytes)
I0420 01:15:43.932269 134009 exec_runner.go:144] found /home/jenkins/minikube-integration/18703-76456/.minikube/key.pem, removing ...
I0420 01:15:43.932283 134009 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18703-76456/.minikube/key.pem
I0420 01:15:43.932300 134009 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18703-76456/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18703-76456/.minikube/key.pem (1675 bytes)
I0420 01:15:43.932356 134009 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18703-76456/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18703-76456/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18703-76456/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-564860 san=[127.0.0.1 192.168.61.91 localhost minikube old-k8s-version-564860]
I0420 01:15:44.026191 134009 provision.go:177] copyRemoteCerts
I0420 01:15:44.026271 134009 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0420 01:15:44.026309 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHHostname
I0420 01:15:44.028979 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.029432 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:old-k8s-version-564860 Clientid:01:52:54:00:9d:63:09}
I0420 01:15:44.029467 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.029682 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHPort
I0420 01:15:44.029913 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHKeyPath
I0420 01:15:44.030088 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHUsername
I0420 01:15:44.030244 134009 sshutil.go:53] new ssh client: &{IP:192.168.61.91 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18703-76456/.minikube/machines/old-k8s-version-564860/id_rsa Username:docker}
I0420 01:15:44.112802 134009 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18703-76456/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0420 01:15:44.138733 134009 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18703-76456/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0420 01:15:44.167316 134009 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18703-76456/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0420 01:15:44.198047 134009 provision.go:87] duration metric: took 273.260565ms to configureAuth
I0420 01:15:44.198075 134009 buildroot.go:189] setting minikube options for container-runtime
I0420 01:15:44.198281 134009 config.go:182] Loaded profile config "old-k8s-version-564860": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0420 01:15:44.198363 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHHostname
I0420 01:15:44.201003 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.201406 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:old-k8s-version-564860 Clientid:01:52:54:00:9d:63:09}
I0420 01:15:44.201448 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.201670 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHPort
I0420 01:15:44.201878 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHKeyPath
I0420 01:15:44.202050 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHKeyPath
I0420 01:15:44.202184 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHUsername
I0420 01:15:44.202327 134009 main.go:141] libmachine: Using SSH client type: native
I0420 01:15:44.202484 134009 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.91 22 <nil> <nil>}
I0420 01:15:44.202498 134009 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0420 01:15:44.493094 134009 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0420 01:15:44.493125 134009 main.go:141] libmachine: Checking connection to Docker...
I0420 01:15:44.493134 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetURL
I0420 01:15:44.494488 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | Using libvirt version 6000000
I0420 01:15:44.496980 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.497394 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:old-k8s-version-564860 Clientid:01:52:54:00:9d:63:09}
I0420 01:15:44.497418 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.497559 134009 main.go:141] libmachine: Docker is up and running!
I0420 01:15:44.497578 134009 main.go:141] libmachine: Reticulating splines...
I0420 01:15:44.497587 134009 client.go:171] duration metric: took 31.116852894s to LocalClient.Create
I0420 01:15:44.497610 134009 start.go:167] duration metric: took 31.116921302s to libmachine.API.Create "old-k8s-version-564860"
I0420 01:15:44.497623 134009 start.go:293] postStartSetup for "old-k8s-version-564860" (driver="kvm2")
I0420 01:15:44.497637 134009 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0420 01:15:44.497660 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .DriverName
I0420 01:15:44.497937 134009 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0420 01:15:44.497963 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHHostname
I0420 01:15:44.500162 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.500483 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:old-k8s-version-564860 Clientid:01:52:54:00:9d:63:09}
I0420 01:15:44.500515 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.500643 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHPort
I0420 01:15:44.500818 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHKeyPath
I0420 01:15:44.501030 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHUsername
I0420 01:15:44.501184 134009 sshutil.go:53] new ssh client: &{IP:192.168.61.91 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18703-76456/.minikube/machines/old-k8s-version-564860/id_rsa Username:docker}
I0420 01:15:44.585665 134009 ssh_runner.go:195] Run: cat /etc/os-release
I0420 01:15:44.591379 134009 info.go:137] Remote host: Buildroot 2023.02.9
I0420 01:15:44.591416 134009 filesync.go:126] Scanning /home/jenkins/minikube-integration/18703-76456/.minikube/addons for local assets ...
I0420 01:15:44.591494 134009 filesync.go:126] Scanning /home/jenkins/minikube-integration/18703-76456/.minikube/files for local assets ...
I0420 01:15:44.591603 134009 filesync.go:149] local asset: /home/jenkins/minikube-integration/18703-76456/.minikube/files/etc/ssl/certs/837422.pem -> 837422.pem in /etc/ssl/certs
I0420 01:15:44.591697 134009 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0420 01:15:44.602913 134009 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18703-76456/.minikube/files/etc/ssl/certs/837422.pem --> /etc/ssl/certs/837422.pem (1708 bytes)
I0420 01:15:44.632316 134009 start.go:296] duration metric: took 134.671685ms for postStartSetup
I0420 01:15:44.632426 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetConfigRaw
I0420 01:15:44.633056 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetIP
I0420 01:15:44.635951 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.636517 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:old-k8s-version-564860 Clientid:01:52:54:00:9d:63:09}
I0420 01:15:44.636548 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.636869 134009 profile.go:143] Saving config to /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/config.json ...
I0420 01:15:44.637101 134009 start.go:128] duration metric: took 31.280995391s to createHost
I0420 01:15:44.637133 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHHostname
I0420 01:15:44.639445 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.639802 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:old-k8s-version-564860 Clientid:01:52:54:00:9d:63:09}
I0420 01:15:44.639831 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.639976 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHPort
I0420 01:15:44.640207 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHKeyPath
I0420 01:15:44.640388 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHKeyPath
I0420 01:15:44.640556 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHUsername
I0420 01:15:44.640737 134009 main.go:141] libmachine: Using SSH client type: native
I0420 01:15:44.640939 134009 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.91 22 <nil> <nil>}
I0420 01:15:44.640954 134009 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0420 01:15:44.748439 134009 main.go:141] libmachine: SSH cmd err, output: <nil>: 1713575744.735716978
I0420 01:15:44.748473 134009 fix.go:216] guest clock: 1713575744.735716978
I0420 01:15:44.748484 134009 fix.go:229] Guest: 2024-04-20 01:15:44.735716978 +0000 UTC Remote: 2024-04-20 01:15:44.637116763 +0000 UTC m=+76.992008872 (delta=98.600215ms)
I0420 01:15:44.748514 134009 fix.go:200] guest clock delta is within tolerance: 98.600215ms
I0420 01:15:44.748520 134009 start.go:83] releasing machines lock for "old-k8s-version-564860", held for 31.392672197s
I0420 01:15:44.748555 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .DriverName
I0420 01:15:44.748898 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetIP
I0420 01:15:44.752116 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.752483 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:old-k8s-version-564860 Clientid:01:52:54:00:9d:63:09}
I0420 01:15:44.752514 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.752673 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .DriverName
I0420 01:15:44.753322 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .DriverName
I0420 01:15:44.753516 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .DriverName
I0420 01:15:44.753627 134009 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0420 01:15:44.753671 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHHostname
I0420 01:15:44.753778 134009 ssh_runner.go:195] Run: cat /version.json
I0420 01:15:44.753817 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHHostname
I0420 01:15:44.756879 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.757149 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.757258 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:old-k8s-version-564860 Clientid:01:52:54:00:9d:63:09}
I0420 01:15:44.757335 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.757483 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:old-k8s-version-564860 Clientid:01:52:54:00:9d:63:09}
I0420 01:15:44.757521 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:44.757862 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHPort
I0420 01:15:44.757914 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHPort
I0420 01:15:44.758052 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHKeyPath
I0420 01:15:44.758076 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHKeyPath
I0420 01:15:44.758255 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHUsername
I0420 01:15:44.758270 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetSSHUsername
I0420 01:15:44.758386 134009 sshutil.go:53] new ssh client: &{IP:192.168.61.91 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18703-76456/.minikube/machines/old-k8s-version-564860/id_rsa Username:docker}
I0420 01:15:44.758555 134009 sshutil.go:53] new ssh client: &{IP:192.168.61.91 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18703-76456/.minikube/machines/old-k8s-version-564860/id_rsa Username:docker}
I0420 01:15:44.848543 134009 ssh_runner.go:195] Run: systemctl --version
I0420 01:15:44.879337 134009 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0420 01:15:45.051149 134009 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0420 01:15:45.058931 134009 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0420 01:15:45.059008 134009 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0420 01:15:45.078710 134009 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0420 01:15:45.078742 134009 start.go:494] detecting cgroup driver to use...
I0420 01:15:45.078841 134009 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0420 01:15:45.103420 134009 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0420 01:15:45.123641 134009 docker.go:217] disabling cri-docker service (if available) ...
I0420 01:15:45.123712 134009 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0420 01:15:45.142277 134009 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0420 01:15:45.159628 134009 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0420 01:15:45.302710 134009 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0420 01:15:45.504964 134009 docker.go:233] disabling docker service ...
I0420 01:15:45.505042 134009 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0420 01:15:45.527351 134009 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0420 01:15:45.547168 134009 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0420 01:15:45.699219 134009 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0420 01:15:45.854482 134009 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0420 01:15:45.871214 134009 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0420 01:15:45.893254 134009 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0420 01:15:45.893339 134009 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0420 01:15:45.906602 134009 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0420 01:15:45.906679 134009 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0420 01:15:45.923779 134009 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0420 01:15:45.938441 134009 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0420 01:15:45.952654 134009 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0420 01:15:45.967642 134009 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0420 01:15:45.981855 134009 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0420 01:15:45.981917 134009 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0420 01:15:46.012144 134009 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0420 01:15:46.024614 134009 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0420 01:15:46.175174 134009 ssh_runner.go:195] Run: sudo systemctl restart crio
I0420 01:15:46.365022 134009 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0420 01:15:46.365098 134009 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0420 01:15:46.371878 134009 start.go:562] Will wait 60s for crictl version
I0420 01:15:46.371959 134009 ssh_runner.go:195] Run: which crictl
I0420 01:15:46.376650 134009 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0420 01:15:46.427695 134009 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0420 01:15:46.427796 134009 ssh_runner.go:195] Run: crio --version
I0420 01:15:46.466206 134009 ssh_runner.go:195] Run: crio --version
I0420 01:15:46.510685 134009 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0420 01:15:46.511923 134009 main.go:141] libmachine: (old-k8s-version-564860) Calling .GetIP
I0420 01:15:46.515290 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:46.515791 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:63:09", ip: ""} in network mk-old-k8s-version-564860: {Iface:virbr2 ExpiryTime:2024-04-20 02:15:31 +0000 UTC Type:0 Mac:52:54:00:9d:63:09 Iaid: IPaddr:192.168.61.91 Prefix:24 Hostname:old-k8s-version-564860 Clientid:01:52:54:00:9d:63:09}
I0420 01:15:46.515819 134009 main.go:141] libmachine: (old-k8s-version-564860) DBG | domain old-k8s-version-564860 has defined IP address 192.168.61.91 and MAC address 52:54:00:9d:63:09 in network mk-old-k8s-version-564860
I0420 01:15:46.516039 134009 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0420 01:15:46.520999 134009 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0420 01:15:46.537248 134009 kubeadm.go:877] updating cluster {Name:old-k8s-version-564860 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.33.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-564860 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.91 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: D
isableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0420 01:15:46.537417 134009 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0420 01:15:46.537471 134009 ssh_runner.go:195] Run: sudo crictl images --output json
I0420 01:15:46.586979 134009 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0420 01:15:46.587063 134009 ssh_runner.go:195] Run: which lz4
I0420 01:15:46.591909 134009 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0420 01:15:46.596672 134009 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0420 01:15:46.596711 134009 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18703-76456/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0420 01:15:48.914196 134009 crio.go:462] duration metric: took 2.322333618s to copy over tarball
I0420 01:15:48.914311 134009 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0420 01:15:52.356652 134009 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.442300936s)
I0420 01:15:52.356683 134009 crio.go:469] duration metric: took 3.442446157s to extract the tarball
I0420 01:15:52.356692 134009 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0420 01:15:52.406463 134009 ssh_runner.go:195] Run: sudo crictl images --output json
I0420 01:15:52.461620 134009 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0420 01:15:52.461655 134009 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0420 01:15:52.461735 134009 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0420 01:15:52.461748 134009 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0420 01:15:52.461811 134009 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0420 01:15:52.461816 134009 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0420 01:15:52.461833 134009 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0420 01:15:52.461809 134009 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0420 01:15:52.461785 134009 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0420 01:15:52.461965 134009 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0420 01:15:52.463506 134009 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0420 01:15:52.463506 134009 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0420 01:15:52.463523 134009 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0420 01:15:52.463520 134009 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0420 01:15:52.463507 134009 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0420 01:15:52.463520 134009 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0420 01:15:52.463559 134009 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0420 01:15:52.463878 134009 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0420 01:15:52.605943 134009 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0420 01:15:52.616470 134009 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0420 01:15:52.621544 134009 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0420 01:15:52.626625 134009 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0420 01:15:52.627503 134009 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0420 01:15:52.638438 134009 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0420 01:15:52.699275 134009 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0420 01:15:52.747751 134009 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0420 01:15:52.782955 134009 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0420 01:15:52.788059 134009 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0420 01:15:52.788124 134009 ssh_runner.go:195] Run: which crictl
I0420 01:15:52.826564 134009 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0420 01:15:52.826616 134009 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0420 01:15:52.826672 134009 ssh_runner.go:195] Run: which crictl
I0420 01:15:52.832374 134009 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0420 01:15:52.832425 134009 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0420 01:15:52.832459 134009 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0420 01:15:52.832483 134009 ssh_runner.go:195] Run: which crictl
I0420 01:15:52.832499 134009 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0420 01:15:52.832538 134009 ssh_runner.go:195] Run: which crictl
I0420 01:15:52.832562 134009 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0420 01:15:52.832597 134009 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0420 01:15:52.832636 134009 ssh_runner.go:195] Run: which crictl
I0420 01:15:52.832681 134009 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0420 01:15:52.832713 134009 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0420 01:15:52.832750 134009 ssh_runner.go:195] Run: which crictl
I0420 01:15:52.994100 134009 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0420 01:15:52.994136 134009 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0420 01:15:52.994173 134009 ssh_runner.go:195] Run: which crictl
I0420 01:15:52.994229 134009 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0420 01:15:52.994258 134009 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0420 01:15:52.994301 134009 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0420 01:15:52.994347 134009 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0420 01:15:52.994380 134009 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0420 01:15:52.994424 134009 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0420 01:15:53.163216 134009 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0420 01:15:53.163289 134009 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18703-76456/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0420 01:15:53.163288 134009 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18703-76456/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0420 01:15:53.163342 134009 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18703-76456/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0420 01:15:53.163415 134009 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18703-76456/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0420 01:15:53.163450 134009 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18703-76456/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0420 01:15:53.163488 134009 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18703-76456/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0420 01:15:53.222022 134009 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18703-76456/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0420 01:15:53.222083 134009 cache_images.go:92] duration metric: took 760.41214ms to LoadCachedImages
W0420 01:15:53.222206 134009 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18703-76456/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18703-76456/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I0420 01:15:53.222228 134009 kubeadm.go:928] updating node { 192.168.61.91 8443 v1.20.0 crio true true} ...
I0420 01:15:53.222379 134009 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-564860 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.91
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-564860 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0420 01:15:53.222454 134009 ssh_runner.go:195] Run: crio config
I0420 01:15:53.291409 134009 cni.go:84] Creating CNI manager for ""
I0420 01:15:53.291438 134009 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0420 01:15:53.291451 134009 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0420 01:15:53.291474 134009 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.91 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-564860 NodeName:old-k8s-version-564860 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.91"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.91 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0420 01:15:53.291648 134009 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.91
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-564860"
kubeletExtraArgs:
node-ip: 192.168.61.91
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.91"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0420 01:15:53.291727 134009 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0420 01:15:53.305215 134009 binaries.go:44] Found k8s binaries, skipping transfer
I0420 01:15:53.305289 134009 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0420 01:15:53.318721 134009 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0420 01:15:53.345463 134009 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0420 01:15:53.369970 134009 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0420 01:15:53.403103 134009 ssh_runner.go:195] Run: grep 192.168.61.91 control-plane.minikube.internal$ /etc/hosts
I0420 01:15:53.409701 134009 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.91 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0420 01:15:53.428232 134009 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0420 01:15:53.607068 134009 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0420 01:15:53.638914 134009 certs.go:68] Setting up /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860 for IP: 192.168.61.91
I0420 01:15:53.638945 134009 certs.go:194] generating shared ca certs ...
I0420 01:15:53.638967 134009 certs.go:226] acquiring lock for ca certs: {Name:mk8b05008ea79296d881c722adfabc65a57f02ff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0420 01:15:53.639153 134009 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18703-76456/.minikube/ca.key
I0420 01:15:53.639226 134009 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18703-76456/.minikube/proxy-client-ca.key
I0420 01:15:53.639241 134009 certs.go:256] generating profile certs ...
I0420 01:15:53.639316 134009 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/client.key
I0420 01:15:53.639335 134009 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/client.crt with IP's: []
I0420 01:15:53.838671 134009 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/client.crt ...
I0420 01:15:53.838705 134009 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/client.crt: {Name:mka230af60e2ea837b47fba2511891be76d78b44 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0420 01:15:53.838923 134009 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/client.key ...
I0420 01:15:53.838985 134009 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/client.key: {Name:mk7c107c7e5e47fde871bd6dbf4bf77372dffc65 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0420 01:15:53.839501 134009 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/apiserver.key.d235183f
I0420 01:15:53.839540 134009 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/apiserver.crt.d235183f with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.91]
I0420 01:15:53.995396 134009 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/apiserver.crt.d235183f ...
I0420 01:15:53.995439 134009 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/apiserver.crt.d235183f: {Name:mkb221f25823c555005fd3dbb9895ddfbe5ca0e1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0420 01:15:53.995659 134009 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/apiserver.key.d235183f ...
I0420 01:15:53.995682 134009 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/apiserver.key.d235183f: {Name:mk9e045eb4ec636c145adb179632dc58818a253a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0420 01:15:53.995793 134009 certs.go:381] copying /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/apiserver.crt.d235183f -> /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/apiserver.crt
I0420 01:15:53.995916 134009 certs.go:385] copying /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/apiserver.key.d235183f -> /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/apiserver.key
I0420 01:15:53.996002 134009 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/proxy-client.key
I0420 01:15:53.996025 134009 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/proxy-client.crt with IP's: []
I0420 01:15:54.076787 134009 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/proxy-client.crt ...
I0420 01:15:54.076826 134009 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/proxy-client.crt: {Name:mk6c99d0f7e0721540255780d05a868007a0f2f9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0420 01:15:54.077023 134009 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/proxy-client.key ...
I0420 01:15:54.077043 134009 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/proxy-client.key: {Name:mkfed778643a193b2e5b4d9d72573a4e491b3b66 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0420 01:15:54.077247 134009 certs.go:484] found cert: /home/jenkins/minikube-integration/18703-76456/.minikube/certs/83742.pem (1338 bytes)
W0420 01:15:54.077302 134009 certs.go:480] ignoring /home/jenkins/minikube-integration/18703-76456/.minikube/certs/83742_empty.pem, impossibly tiny 0 bytes
I0420 01:15:54.077332 134009 certs.go:484] found cert: /home/jenkins/minikube-integration/18703-76456/.minikube/certs/ca-key.pem (1675 bytes)
I0420 01:15:54.077375 134009 certs.go:484] found cert: /home/jenkins/minikube-integration/18703-76456/.minikube/certs/ca.pem (1078 bytes)
I0420 01:15:54.077409 134009 certs.go:484] found cert: /home/jenkins/minikube-integration/18703-76456/.minikube/certs/cert.pem (1123 bytes)
I0420 01:15:54.077445 134009 certs.go:484] found cert: /home/jenkins/minikube-integration/18703-76456/.minikube/certs/key.pem (1675 bytes)
I0420 01:15:54.077499 134009 certs.go:484] found cert: /home/jenkins/minikube-integration/18703-76456/.minikube/files/etc/ssl/certs/837422.pem (1708 bytes)
I0420 01:15:54.078370 134009 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18703-76456/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0420 01:15:54.110400 134009 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18703-76456/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0420 01:15:54.147469 134009 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18703-76456/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0420 01:15:54.181375 134009 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18703-76456/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0420 01:15:54.217289 134009 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0420 01:15:54.256738 134009 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0420 01:15:54.297735 134009 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0420 01:15:54.338143 134009 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18703-76456/.minikube/profiles/old-k8s-version-564860/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0420 01:15:54.379692 134009 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18703-76456/.minikube/files/etc/ssl/certs/837422.pem --> /usr/share/ca-certificates/837422.pem (1708 bytes)
I0420 01:15:54.421883 134009 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18703-76456/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0420 01:15:54.460676 134009 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18703-76456/.minikube/certs/83742.pem --> /usr/share/ca-certificates/83742.pem (1338 bytes)
I0420 01:15:54.502704 134009 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0420 01:15:54.531096 134009 ssh_runner.go:195] Run: openssl version
I0420 01:15:54.540737 134009 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0420 01:15:54.560106 134009 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0420 01:15:54.568014 134009 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 19 23:57 /usr/share/ca-certificates/minikubeCA.pem
I0420 01:15:54.568089 134009 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0420 01:15:54.577739 134009 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0420 01:15:54.597506 134009 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/83742.pem && ln -fs /usr/share/ca-certificates/83742.pem /etc/ssl/certs/83742.pem"
I0420 01:15:54.618051 134009 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/83742.pem
I0420 01:15:54.626459 134009 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 20 00:09 /usr/share/ca-certificates/83742.pem
I0420 01:15:54.626590 134009 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/83742.pem
I0420 01:15:54.636334 134009 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/83742.pem /etc/ssl/certs/51391683.0"
I0420 01:15:54.655230 134009 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/837422.pem && ln -fs /usr/share/ca-certificates/837422.pem /etc/ssl/certs/837422.pem"
I0420 01:15:54.682920 134009 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/837422.pem
I0420 01:15:54.694277 134009 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 20 00:09 /usr/share/ca-certificates/837422.pem
I0420 01:15:54.694413 134009 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/837422.pem
I0420 01:15:54.704301 134009 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/837422.pem /etc/ssl/certs/3ec20f2e.0"
I0420 01:15:54.726154 134009 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0420 01:15:54.736607 134009 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0420 01:15:54.736772 134009 kubeadm.go:391] StartCluster: {Name:old-k8s-version-564860 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.33.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-564860 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.91 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disa
bleOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0420 01:15:54.736890 134009 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0420 01:15:54.736987 134009 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0420 01:15:54.801150 134009 cri.go:89] found id: ""
I0420 01:15:54.801238 134009 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0420 01:15:54.824284 134009 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0420 01:15:54.837791 134009 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0420 01:15:54.850937 134009 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0420 01:15:54.850963 134009 kubeadm.go:156] found existing configuration files:
I0420 01:15:54.851026 134009 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0420 01:15:54.862150 134009 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0420 01:15:54.862231 134009 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0420 01:15:54.874460 134009 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0420 01:15:54.886409 134009 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0420 01:15:54.886478 134009 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0420 01:15:54.898473 134009 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0420 01:15:54.916474 134009 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0420 01:15:54.916550 134009 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0420 01:15:54.928655 134009 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0420 01:15:54.942866 134009 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0420 01:15:54.942921 134009 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0420 01:15:54.960453 134009 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0420 01:15:55.191072 134009 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0420 01:15:55.191931 134009 kubeadm.go:309] [preflight] Running pre-flight checks
I0420 01:15:55.425109 134009 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0420 01:15:55.425281 134009 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0420 01:15:55.425452 134009 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0420 01:15:55.762478 134009 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0420 01:15:55.764487 134009 out.go:204] - Generating certificates and keys ...
I0420 01:15:55.764735 134009 kubeadm.go:309] [certs] Using existing ca certificate authority
I0420 01:15:55.764842 134009 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0420 01:15:55.942496 134009 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0420 01:15:56.346124 134009 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0420 01:15:56.620774 134009 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0420 01:15:56.828750 134009 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0420 01:15:56.963792 134009 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0420 01:15:56.964159 134009 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-564860] and IPs [192.168.61.91 127.0.0.1 ::1]
I0420 01:15:57.088868 134009 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0420 01:15:57.089166 134009 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-564860] and IPs [192.168.61.91 127.0.0.1 ::1]
I0420 01:15:57.332624 134009 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0420 01:15:57.548035 134009 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0420 01:15:57.760985 134009 kubeadm.go:309] [certs] Generating "sa" key and public key
I0420 01:15:57.761449 134009 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0420 01:15:57.951228 134009 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0420 01:15:58.237742 134009 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0420 01:15:58.442404 134009 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0420 01:15:58.879063 134009 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0420 01:15:58.907235 134009 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0420 01:15:58.909708 134009 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0420 01:15:58.909809 134009 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0420 01:15:59.143128 134009 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0420 01:15:59.144528 134009 out.go:204] - Booting up control plane ...
I0420 01:15:59.144720 134009 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0420 01:15:59.158989 134009 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0420 01:15:59.162938 134009 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0420 01:15:59.163042 134009 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0420 01:15:59.166695 134009 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0420 01:16:39.165827 134009 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0420 01:16:39.166726 134009 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0420 01:16:39.167135 134009 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0420 01:16:44.167917 134009 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0420 01:16:44.168131 134009 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0420 01:16:54.168791 134009 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0420 01:16:54.168966 134009 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0420 01:17:14.170201 134009 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0420 01:17:14.170463 134009 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0420 01:17:54.170679 134009 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0420 01:17:54.170924 134009 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0420 01:17:54.170939 134009 kubeadm.go:309]
I0420 01:17:54.170990 134009 kubeadm.go:309] Unfortunately, an error has occurred:
I0420 01:17:54.171037 134009 kubeadm.go:309] timed out waiting for the condition
I0420 01:17:54.171044 134009 kubeadm.go:309]
I0420 01:17:54.171084 134009 kubeadm.go:309] This error is likely caused by:
I0420 01:17:54.171133 134009 kubeadm.go:309] - The kubelet is not running
I0420 01:17:54.171262 134009 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0420 01:17:54.171270 134009 kubeadm.go:309]
I0420 01:17:54.171419 134009 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0420 01:17:54.171461 134009 kubeadm.go:309] - 'systemctl status kubelet'
I0420 01:17:54.171502 134009 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0420 01:17:54.171509 134009 kubeadm.go:309]
I0420 01:17:54.171649 134009 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0420 01:17:54.171752 134009 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0420 01:17:54.171759 134009 kubeadm.go:309]
I0420 01:17:54.171881 134009 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0420 01:17:54.171988 134009 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0420 01:17:54.172079 134009 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0420 01:17:54.172174 134009 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0420 01:17:54.172180 134009 kubeadm.go:309]
I0420 01:17:54.173502 134009 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0420 01:17:54.173617 134009 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0420 01:17:54.173709 134009 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0420 01:17:54.173870 134009 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-564860] and IPs [192.168.61.91 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-564860] and IPs [192.168.61.91 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-564860] and IPs [192.168.61.91 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-564860] and IPs [192.168.61.91 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0420 01:17:54.173935 134009 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0420 01:17:57.687670 134009 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (3.513697766s)
I0420 01:17:57.687766 134009 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0420 01:17:57.703403 134009 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0420 01:17:57.716994 134009 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0420 01:17:57.717016 134009 kubeadm.go:156] found existing configuration files:
I0420 01:17:57.717074 134009 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0420 01:17:57.728058 134009 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0420 01:17:57.728127 134009 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0420 01:17:57.740085 134009 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0420 01:17:57.751954 134009 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0420 01:17:57.752008 134009 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0420 01:17:57.764751 134009 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0420 01:17:57.776495 134009 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0420 01:17:57.776558 134009 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0420 01:17:57.789068 134009 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0420 01:17:57.801292 134009 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0420 01:17:57.801374 134009 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0420 01:17:57.813709 134009 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0420 01:17:57.886054 134009 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0420 01:17:57.886142 134009 kubeadm.go:309] [preflight] Running pre-flight checks
I0420 01:17:58.042160 134009 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0420 01:17:58.042372 134009 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0420 01:17:58.042534 134009 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0420 01:17:58.265363 134009 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0420 01:17:58.267312 134009 out.go:204] - Generating certificates and keys ...
I0420 01:17:58.267428 134009 kubeadm.go:309] [certs] Using existing ca certificate authority
I0420 01:17:58.267528 134009 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0420 01:17:58.267635 134009 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0420 01:17:58.267733 134009 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0420 01:17:58.267845 134009 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0420 01:17:58.267919 134009 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0420 01:17:58.268313 134009 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0420 01:17:58.268736 134009 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0420 01:17:58.269083 134009 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0420 01:17:58.269597 134009 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0420 01:17:58.269766 134009 kubeadm.go:309] [certs] Using the existing "sa" key
I0420 01:17:58.269871 134009 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0420 01:17:58.451046 134009 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0420 01:17:58.658719 134009 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0420 01:17:58.983509 134009 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0420 01:17:59.140622 134009 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0420 01:17:59.157139 134009 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0420 01:17:59.159325 134009 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0420 01:17:59.159399 134009 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0420 01:17:59.333757 134009 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0420 01:17:59.335304 134009 out.go:204] - Booting up control plane ...
I0420 01:17:59.335445 134009 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0420 01:17:59.341474 134009 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0420 01:17:59.342485 134009 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0420 01:17:59.343133 134009 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0420 01:17:59.345361 134009 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0420 01:18:39.347619 134009 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0420 01:18:39.347911 134009 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0420 01:18:39.348092 134009 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0420 01:18:44.348471 134009 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0420 01:18:44.348737 134009 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0420 01:18:54.349506 134009 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0420 01:18:54.349678 134009 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0420 01:19:14.350978 134009 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0420 01:19:14.351247 134009 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0420 01:19:54.350834 134009 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0420 01:19:54.351152 134009 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0420 01:19:54.351179 134009 kubeadm.go:309]
I0420 01:19:54.351225 134009 kubeadm.go:309] Unfortunately, an error has occurred:
I0420 01:19:54.351273 134009 kubeadm.go:309] timed out waiting for the condition
I0420 01:19:54.351285 134009 kubeadm.go:309]
I0420 01:19:54.351332 134009 kubeadm.go:309] This error is likely caused by:
I0420 01:19:54.351386 134009 kubeadm.go:309] - The kubelet is not running
I0420 01:19:54.351518 134009 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0420 01:19:54.351530 134009 kubeadm.go:309]
I0420 01:19:54.351646 134009 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0420 01:19:54.351703 134009 kubeadm.go:309] - 'systemctl status kubelet'
I0420 01:19:54.351740 134009 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0420 01:19:54.351748 134009 kubeadm.go:309]
I0420 01:19:54.351853 134009 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0420 01:19:54.351964 134009 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0420 01:19:54.351977 134009 kubeadm.go:309]
I0420 01:19:54.352065 134009 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0420 01:19:54.352152 134009 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0420 01:19:54.352231 134009 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0420 01:19:54.352310 134009 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0420 01:19:54.352323 134009 kubeadm.go:309]
I0420 01:19:54.352742 134009 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0420 01:19:54.352814 134009 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0420 01:19:54.352866 134009 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0420 01:19:54.352928 134009 kubeadm.go:393] duration metric: took 3m59.616199952s to StartCluster
I0420 01:19:54.352976 134009 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0420 01:19:54.353033 134009 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0420 01:19:54.399967 134009 cri.go:89] found id: ""
I0420 01:19:54.400001 134009 logs.go:276] 0 containers: []
W0420 01:19:54.400012 134009 logs.go:278] No container was found matching "kube-apiserver"
I0420 01:19:54.400019 134009 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0420 01:19:54.400085 134009 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0420 01:19:54.441141 134009 cri.go:89] found id: ""
I0420 01:19:54.441165 134009 logs.go:276] 0 containers: []
W0420 01:19:54.441173 134009 logs.go:278] No container was found matching "etcd"
I0420 01:19:54.441178 134009 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0420 01:19:54.441233 134009 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0420 01:19:54.483205 134009 cri.go:89] found id: ""
I0420 01:19:54.483242 134009 logs.go:276] 0 containers: []
W0420 01:19:54.483255 134009 logs.go:278] No container was found matching "coredns"
I0420 01:19:54.483269 134009 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0420 01:19:54.483343 134009 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0420 01:19:54.520315 134009 cri.go:89] found id: ""
I0420 01:19:54.520346 134009 logs.go:276] 0 containers: []
W0420 01:19:54.520356 134009 logs.go:278] No container was found matching "kube-scheduler"
I0420 01:19:54.520366 134009 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0420 01:19:54.520413 134009 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0420 01:19:54.560071 134009 cri.go:89] found id: ""
I0420 01:19:54.560113 134009 logs.go:276] 0 containers: []
W0420 01:19:54.560122 134009 logs.go:278] No container was found matching "kube-proxy"
I0420 01:19:54.560128 134009 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0420 01:19:54.560184 134009 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0420 01:19:54.598166 134009 cri.go:89] found id: ""
I0420 01:19:54.598194 134009 logs.go:276] 0 containers: []
W0420 01:19:54.598202 134009 logs.go:278] No container was found matching "kube-controller-manager"
I0420 01:19:54.598209 134009 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0420 01:19:54.598272 134009 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0420 01:19:54.647197 134009 cri.go:89] found id: ""
I0420 01:19:54.647223 134009 logs.go:276] 0 containers: []
W0420 01:19:54.647231 134009 logs.go:278] No container was found matching "kindnet"
I0420 01:19:54.647240 134009 logs.go:123] Gathering logs for kubelet ...
I0420 01:19:54.647254 134009 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0420 01:19:54.702147 134009 logs.go:123] Gathering logs for dmesg ...
I0420 01:19:54.702176 134009 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0420 01:19:54.717713 134009 logs.go:123] Gathering logs for describe nodes ...
I0420 01:19:54.717739 134009 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0420 01:19:54.881082 134009 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0420 01:19:54.881106 134009 logs.go:123] Gathering logs for CRI-O ...
I0420 01:19:54.881123 134009 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0420 01:19:54.976346 134009 logs.go:123] Gathering logs for container status ...
I0420 01:19:54.976386 134009 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0420 01:19:55.022223 134009 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0420 01:19:55.022274 134009 out.go:239] *
*
W0420 01:19:55.022329 134009 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0420 01:19:55.022355 134009 out.go:239] *
*
W0420 01:19:55.023197 134009 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0420 01:19:55.026843 134009 out.go:177]
W0420 01:19:55.028625 134009 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0420 01:19:55.028685 134009 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0420 01:19:55.028714 134009 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0420 01:19:55.030419 134009 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-564860 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-564860 -n old-k8s-version-564860
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-564860 -n old-k8s-version-564860: exit status 6 (257.050929ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0420 01:19:55.332003 141381 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-564860" does not appear in /home/jenkins/minikube-integration/18703-76456/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-564860" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (327.71s)