=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-834964 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-834964 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m28.618733624s)
-- stdout --
* [old-k8s-version-834964] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19339
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19339-88081/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-88081/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-834964" primary control-plane node in "old-k8s-version-834964" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0729 18:49:14.848733 146540 out.go:291] Setting OutFile to fd 1 ...
I0729 18:49:14.849064 146540 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 18:49:14.849076 146540 out.go:304] Setting ErrFile to fd 2...
I0729 18:49:14.849082 146540 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 18:49:14.849391 146540 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19339-88081/.minikube/bin
I0729 18:49:14.850117 146540 out.go:298] Setting JSON to false
I0729 18:49:14.851617 146540 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":12675,"bootTime":1722266280,"procs":303,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0729 18:49:14.851697 146540 start.go:139] virtualization: kvm guest
I0729 18:49:14.853982 146540 out.go:177] * [old-k8s-version-834964] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0729 18:49:14.855701 146540 out.go:177] - MINIKUBE_LOCATION=19339
I0729 18:49:14.855702 146540 notify.go:220] Checking for updates...
I0729 18:49:14.858144 146540 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0729 18:49:14.859348 146540 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19339-88081/kubeconfig
I0729 18:49:14.860751 146540 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19339-88081/.minikube
I0729 18:49:14.861921 146540 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0729 18:49:14.863182 146540 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0729 18:49:14.864766 146540 config.go:182] Loaded profile config "bridge-085245": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0729 18:49:14.864909 146540 config.go:182] Loaded profile config "calico-085245": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0729 18:49:14.865007 146540 config.go:182] Loaded profile config "cert-expiration-974855": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0729 18:49:14.865114 146540 driver.go:392] Setting default libvirt URI to qemu:///system
I0729 18:49:14.903323 146540 out.go:177] * Using the kvm2 driver based on user configuration
I0729 18:49:14.904598 146540 start.go:297] selected driver: kvm2
I0729 18:49:14.904611 146540 start.go:901] validating driver "kvm2" against <nil>
I0729 18:49:14.904626 146540 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0729 18:49:14.905366 146540 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0729 18:49:14.905456 146540 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19339-88081/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0729 18:49:14.921206 146540 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0729 18:49:14.921262 146540 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0729 18:49:14.921497 146540 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0729 18:49:14.921526 146540 cni.go:84] Creating CNI manager for ""
I0729 18:49:14.921536 146540 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0729 18:49:14.921548 146540 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0729 18:49:14.921610 146540 start.go:340] cluster config:
{Name:old-k8s-version-834964 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-834964 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0729 18:49:14.921742 146540 iso.go:125] acquiring lock: {Name:mkff602c753bfa3e0d79d57ee8dc490f2e8d0298 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0729 18:49:14.923596 146540 out.go:177] * Starting "old-k8s-version-834964" primary control-plane node in "old-k8s-version-834964" cluster
I0729 18:49:14.924883 146540 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0729 18:49:14.924920 146540 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19339-88081/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0729 18:49:14.924929 146540 cache.go:56] Caching tarball of preloaded images
I0729 18:49:14.925015 146540 preload.go:172] Found /home/jenkins/minikube-integration/19339-88081/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0729 18:49:14.925027 146540 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0729 18:49:14.925137 146540 profile.go:143] Saving config to /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/config.json ...
I0729 18:49:14.925160 146540 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/config.json: {Name:mkaa41da62a8994662ab6db090f957f1a1e041fd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 18:49:14.925300 146540 start.go:360] acquireMachinesLock for old-k8s-version-834964: {Name:mkb4fc91615189a18c2505c715f6575ee0da2912 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0729 18:49:14.925337 146540 start.go:364] duration metric: took 15.724µs to acquireMachinesLock for "old-k8s-version-834964"
I0729 18:49:14.925357 146540 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-834964 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-834964 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0729 18:49:14.925445 146540 start.go:125] createHost starting for "" (driver="kvm2")
I0729 18:49:14.927101 146540 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0729 18:49:14.927257 146540 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0729 18:49:14.927304 146540 main.go:141] libmachine: Launching plugin server for driver kvm2
I0729 18:49:14.942908 146540 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45211
I0729 18:49:14.943366 146540 main.go:141] libmachine: () Calling .GetVersion
I0729 18:49:14.944051 146540 main.go:141] libmachine: Using API Version 1
I0729 18:49:14.944077 146540 main.go:141] libmachine: () Calling .SetConfigRaw
I0729 18:49:14.944525 146540 main.go:141] libmachine: () Calling .GetMachineName
I0729 18:49:14.944773 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetMachineName
I0729 18:49:14.945011 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .DriverName
I0729 18:49:14.945181 146540 start.go:159] libmachine.API.Create for "old-k8s-version-834964" (driver="kvm2")
I0729 18:49:14.945238 146540 client.go:168] LocalClient.Create starting
I0729 18:49:14.945281 146540 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19339-88081/.minikube/certs/ca.pem
I0729 18:49:14.945324 146540 main.go:141] libmachine: Decoding PEM data...
I0729 18:49:14.945348 146540 main.go:141] libmachine: Parsing certificate...
I0729 18:49:14.945424 146540 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19339-88081/.minikube/certs/cert.pem
I0729 18:49:14.945452 146540 main.go:141] libmachine: Decoding PEM data...
I0729 18:49:14.945471 146540 main.go:141] libmachine: Parsing certificate...
I0729 18:49:14.945495 146540 main.go:141] libmachine: Running pre-create checks...
I0729 18:49:14.945511 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .PreCreateCheck
I0729 18:49:14.945928 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetConfigRaw
I0729 18:49:14.946324 146540 main.go:141] libmachine: Creating machine...
I0729 18:49:14.946338 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .Create
I0729 18:49:14.946469 146540 main.go:141] libmachine: (old-k8s-version-834964) Creating KVM machine...
I0729 18:49:14.947934 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found existing default KVM network
I0729 18:49:14.949733 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:14.949535 146562 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:2a:46:27} reservation:<nil>}
I0729 18:49:14.950764 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:14.950668 146562 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:7b:af:8a} reservation:<nil>}
I0729 18:49:14.952237 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:14.952144 146562 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002a30d0}
I0729 18:49:14.952260 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | created network xml:
I0729 18:49:14.952277 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | <network>
I0729 18:49:14.952292 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | <name>mk-old-k8s-version-834964</name>
I0729 18:49:14.952309 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | <dns enable='no'/>
I0729 18:49:14.952321 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG |
I0729 18:49:14.952333 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0729 18:49:14.952346 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | <dhcp>
I0729 18:49:14.952356 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0729 18:49:14.952364 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | </dhcp>
I0729 18:49:14.952372 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | </ip>
I0729 18:49:14.952380 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG |
I0729 18:49:14.952396 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | </network>
I0729 18:49:14.952409 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG |
I0729 18:49:14.957938 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | trying to create private KVM network mk-old-k8s-version-834964 192.168.61.0/24...
I0729 18:49:15.038522 146540 main.go:141] libmachine: (old-k8s-version-834964) Setting up store path in /home/jenkins/minikube-integration/19339-88081/.minikube/machines/old-k8s-version-834964 ...
I0729 18:49:15.038558 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | private KVM network mk-old-k8s-version-834964 192.168.61.0/24 created
I0729 18:49:15.038572 146540 main.go:141] libmachine: (old-k8s-version-834964) Building disk image from file:///home/jenkins/minikube-integration/19339-88081/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso
I0729 18:49:15.038593 146540 main.go:141] libmachine: (old-k8s-version-834964) Downloading /home/jenkins/minikube-integration/19339-88081/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19339-88081/.minikube/cache/iso/amd64/minikube-v1.33.1-1722248113-19339-amd64.iso...
I0729 18:49:15.038608 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:15.037415 146562 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19339-88081/.minikube
I0729 18:49:15.314132 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:15.313989 146562 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19339-88081/.minikube/machines/old-k8s-version-834964/id_rsa...
I0729 18:49:15.572299 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:15.572165 146562 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19339-88081/.minikube/machines/old-k8s-version-834964/old-k8s-version-834964.rawdisk...
I0729 18:49:15.572327 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | Writing magic tar header
I0729 18:49:15.572340 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | Writing SSH key tar header
I0729 18:49:15.572352 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:15.572296 146562 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19339-88081/.minikube/machines/old-k8s-version-834964 ...
I0729 18:49:15.572446 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19339-88081/.minikube/machines/old-k8s-version-834964
I0729 18:49:15.572476 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19339-88081/.minikube/machines
I0729 18:49:15.572518 146540 main.go:141] libmachine: (old-k8s-version-834964) Setting executable bit set on /home/jenkins/minikube-integration/19339-88081/.minikube/machines/old-k8s-version-834964 (perms=drwx------)
I0729 18:49:15.572532 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19339-88081/.minikube
I0729 18:49:15.572543 146540 main.go:141] libmachine: (old-k8s-version-834964) Setting executable bit set on /home/jenkins/minikube-integration/19339-88081/.minikube/machines (perms=drwxr-xr-x)
I0729 18:49:15.572560 146540 main.go:141] libmachine: (old-k8s-version-834964) Setting executable bit set on /home/jenkins/minikube-integration/19339-88081/.minikube (perms=drwxr-xr-x)
I0729 18:49:15.572578 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19339-88081
I0729 18:49:15.572591 146540 main.go:141] libmachine: (old-k8s-version-834964) Setting executable bit set on /home/jenkins/minikube-integration/19339-88081 (perms=drwxrwxr-x)
I0729 18:49:15.572603 146540 main.go:141] libmachine: (old-k8s-version-834964) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0729 18:49:15.572612 146540 main.go:141] libmachine: (old-k8s-version-834964) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0729 18:49:15.572623 146540 main.go:141] libmachine: (old-k8s-version-834964) Creating domain...
I0729 18:49:15.572639 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0729 18:49:15.572650 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | Checking permissions on dir: /home/jenkins
I0729 18:49:15.572661 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | Checking permissions on dir: /home
I0729 18:49:15.572675 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | Skipping /home - not owner
I0729 18:49:15.573798 146540 main.go:141] libmachine: (old-k8s-version-834964) define libvirt domain using xml:
I0729 18:49:15.573827 146540 main.go:141] libmachine: (old-k8s-version-834964) <domain type='kvm'>
I0729 18:49:15.573838 146540 main.go:141] libmachine: (old-k8s-version-834964) <name>old-k8s-version-834964</name>
I0729 18:49:15.573846 146540 main.go:141] libmachine: (old-k8s-version-834964) <memory unit='MiB'>2200</memory>
I0729 18:49:15.573855 146540 main.go:141] libmachine: (old-k8s-version-834964) <vcpu>2</vcpu>
I0729 18:49:15.573865 146540 main.go:141] libmachine: (old-k8s-version-834964) <features>
I0729 18:49:15.573874 146540 main.go:141] libmachine: (old-k8s-version-834964) <acpi/>
I0729 18:49:15.573886 146540 main.go:141] libmachine: (old-k8s-version-834964) <apic/>
I0729 18:49:15.573898 146540 main.go:141] libmachine: (old-k8s-version-834964) <pae/>
I0729 18:49:15.573914 146540 main.go:141] libmachine: (old-k8s-version-834964)
I0729 18:49:15.573927 146540 main.go:141] libmachine: (old-k8s-version-834964) </features>
I0729 18:49:15.573938 146540 main.go:141] libmachine: (old-k8s-version-834964) <cpu mode='host-passthrough'>
I0729 18:49:15.573949 146540 main.go:141] libmachine: (old-k8s-version-834964)
I0729 18:49:15.573957 146540 main.go:141] libmachine: (old-k8s-version-834964) </cpu>
I0729 18:49:15.573968 146540 main.go:141] libmachine: (old-k8s-version-834964) <os>
I0729 18:49:15.573988 146540 main.go:141] libmachine: (old-k8s-version-834964) <type>hvm</type>
I0729 18:49:15.574000 146540 main.go:141] libmachine: (old-k8s-version-834964) <boot dev='cdrom'/>
I0729 18:49:15.574013 146540 main.go:141] libmachine: (old-k8s-version-834964) <boot dev='hd'/>
I0729 18:49:15.574024 146540 main.go:141] libmachine: (old-k8s-version-834964) <bootmenu enable='no'/>
I0729 18:49:15.574036 146540 main.go:141] libmachine: (old-k8s-version-834964) </os>
I0729 18:49:15.574045 146540 main.go:141] libmachine: (old-k8s-version-834964) <devices>
I0729 18:49:15.574057 146540 main.go:141] libmachine: (old-k8s-version-834964) <disk type='file' device='cdrom'>
I0729 18:49:15.574073 146540 main.go:141] libmachine: (old-k8s-version-834964) <source file='/home/jenkins/minikube-integration/19339-88081/.minikube/machines/old-k8s-version-834964/boot2docker.iso'/>
I0729 18:49:15.574104 146540 main.go:141] libmachine: (old-k8s-version-834964) <target dev='hdc' bus='scsi'/>
I0729 18:49:15.574136 146540 main.go:141] libmachine: (old-k8s-version-834964) <readonly/>
I0729 18:49:15.574149 146540 main.go:141] libmachine: (old-k8s-version-834964) </disk>
I0729 18:49:15.574163 146540 main.go:141] libmachine: (old-k8s-version-834964) <disk type='file' device='disk'>
I0729 18:49:15.574187 146540 main.go:141] libmachine: (old-k8s-version-834964) <driver name='qemu' type='raw' cache='default' io='threads' />
I0729 18:49:15.574207 146540 main.go:141] libmachine: (old-k8s-version-834964) <source file='/home/jenkins/minikube-integration/19339-88081/.minikube/machines/old-k8s-version-834964/old-k8s-version-834964.rawdisk'/>
I0729 18:49:15.574221 146540 main.go:141] libmachine: (old-k8s-version-834964) <target dev='hda' bus='virtio'/>
I0729 18:49:15.574232 146540 main.go:141] libmachine: (old-k8s-version-834964) </disk>
I0729 18:49:15.574243 146540 main.go:141] libmachine: (old-k8s-version-834964) <interface type='network'>
I0729 18:49:15.574255 146540 main.go:141] libmachine: (old-k8s-version-834964) <source network='mk-old-k8s-version-834964'/>
I0729 18:49:15.574266 146540 main.go:141] libmachine: (old-k8s-version-834964) <model type='virtio'/>
I0729 18:49:15.574277 146540 main.go:141] libmachine: (old-k8s-version-834964) </interface>
I0729 18:49:15.574288 146540 main.go:141] libmachine: (old-k8s-version-834964) <interface type='network'>
I0729 18:49:15.574300 146540 main.go:141] libmachine: (old-k8s-version-834964) <source network='default'/>
I0729 18:49:15.574310 146540 main.go:141] libmachine: (old-k8s-version-834964) <model type='virtio'/>
I0729 18:49:15.574321 146540 main.go:141] libmachine: (old-k8s-version-834964) </interface>
I0729 18:49:15.574328 146540 main.go:141] libmachine: (old-k8s-version-834964) <serial type='pty'>
I0729 18:49:15.574351 146540 main.go:141] libmachine: (old-k8s-version-834964) <target port='0'/>
I0729 18:49:15.574374 146540 main.go:141] libmachine: (old-k8s-version-834964) </serial>
I0729 18:49:15.574387 146540 main.go:141] libmachine: (old-k8s-version-834964) <console type='pty'>
I0729 18:49:15.574399 146540 main.go:141] libmachine: (old-k8s-version-834964) <target type='serial' port='0'/>
I0729 18:49:15.574411 146540 main.go:141] libmachine: (old-k8s-version-834964) </console>
I0729 18:49:15.574422 146540 main.go:141] libmachine: (old-k8s-version-834964) <rng model='virtio'>
I0729 18:49:15.574435 146540 main.go:141] libmachine: (old-k8s-version-834964) <backend model='random'>/dev/random</backend>
I0729 18:49:15.574453 146540 main.go:141] libmachine: (old-k8s-version-834964) </rng>
I0729 18:49:15.574463 146540 main.go:141] libmachine: (old-k8s-version-834964)
I0729 18:49:15.574474 146540 main.go:141] libmachine: (old-k8s-version-834964)
I0729 18:49:15.574484 146540 main.go:141] libmachine: (old-k8s-version-834964) </devices>
I0729 18:49:15.574493 146540 main.go:141] libmachine: (old-k8s-version-834964) </domain>
I0729 18:49:15.574507 146540 main.go:141] libmachine: (old-k8s-version-834964)
I0729 18:49:15.578320 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:2a:c5:6f in network default
I0729 18:49:15.578932 146540 main.go:141] libmachine: (old-k8s-version-834964) Ensuring networks are active...
I0729 18:49:15.578952 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:15.579514 146540 main.go:141] libmachine: (old-k8s-version-834964) Ensuring network default is active
I0729 18:49:15.579829 146540 main.go:141] libmachine: (old-k8s-version-834964) Ensuring network mk-old-k8s-version-834964 is active
I0729 18:49:15.580311 146540 main.go:141] libmachine: (old-k8s-version-834964) Getting domain xml...
I0729 18:49:15.580998 146540 main.go:141] libmachine: (old-k8s-version-834964) Creating domain...
I0729 18:49:15.912746 146540 main.go:141] libmachine: (old-k8s-version-834964) Waiting to get IP...
I0729 18:49:15.913676 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:15.914110 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | unable to find current IP address of domain old-k8s-version-834964 in network mk-old-k8s-version-834964
I0729 18:49:15.914169 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:15.914099 146562 retry.go:31] will retry after 251.036856ms: waiting for machine to come up
I0729 18:49:16.166662 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:16.167238 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | unable to find current IP address of domain old-k8s-version-834964 in network mk-old-k8s-version-834964
I0729 18:49:16.167268 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:16.167185 146562 retry.go:31] will retry after 319.554537ms: waiting for machine to come up
I0729 18:49:16.489214 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:16.489867 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | unable to find current IP address of domain old-k8s-version-834964 in network mk-old-k8s-version-834964
I0729 18:49:16.489931 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:16.489813 146562 retry.go:31] will retry after 380.351583ms: waiting for machine to come up
I0729 18:49:16.871223 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:16.871637 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | unable to find current IP address of domain old-k8s-version-834964 in network mk-old-k8s-version-834964
I0729 18:49:16.871666 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:16.871611 146562 retry.go:31] will retry after 520.878659ms: waiting for machine to come up
I0729 18:49:17.394531 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:17.395179 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | unable to find current IP address of domain old-k8s-version-834964 in network mk-old-k8s-version-834964
I0729 18:49:17.395210 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:17.395117 146562 retry.go:31] will retry after 498.78577ms: waiting for machine to come up
I0729 18:49:17.896212 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:17.896768 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | unable to find current IP address of domain old-k8s-version-834964 in network mk-old-k8s-version-834964
I0729 18:49:17.896796 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:17.896727 146562 retry.go:31] will retry after 947.89031ms: waiting for machine to come up
I0729 18:49:18.846306 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:18.846783 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | unable to find current IP address of domain old-k8s-version-834964 in network mk-old-k8s-version-834964
I0729 18:49:18.846812 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:18.846729 146562 retry.go:31] will retry after 1.094988115s: waiting for machine to come up
I0729 18:49:19.943099 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:19.943638 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | unable to find current IP address of domain old-k8s-version-834964 in network mk-old-k8s-version-834964
I0729 18:49:19.943661 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:19.943578 146562 retry.go:31] will retry after 1.150294001s: waiting for machine to come up
I0729 18:49:21.095733 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:21.096301 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | unable to find current IP address of domain old-k8s-version-834964 in network mk-old-k8s-version-834964
I0729 18:49:21.096331 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:21.096257 146562 retry.go:31] will retry after 1.517108829s: waiting for machine to come up
I0729 18:49:22.614640 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:22.615161 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | unable to find current IP address of domain old-k8s-version-834964 in network mk-old-k8s-version-834964
I0729 18:49:22.615198 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:22.615112 146562 retry.go:31] will retry after 1.674428756s: waiting for machine to come up
I0729 18:49:24.291929 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:24.292503 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | unable to find current IP address of domain old-k8s-version-834964 in network mk-old-k8s-version-834964
I0729 18:49:24.292532 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:24.292442 146562 retry.go:31] will retry after 2.36408842s: waiting for machine to come up
I0729 18:49:26.658148 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:26.658699 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | unable to find current IP address of domain old-k8s-version-834964 in network mk-old-k8s-version-834964
I0729 18:49:26.658742 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:26.658679 146562 retry.go:31] will retry after 2.634353507s: waiting for machine to come up
I0729 18:49:29.295754 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:29.296261 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | unable to find current IP address of domain old-k8s-version-834964 in network mk-old-k8s-version-834964
I0729 18:49:29.296286 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:29.296217 146562 retry.go:31] will retry after 3.280920537s: waiting for machine to come up
I0729 18:49:32.579089 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:32.579644 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | unable to find current IP address of domain old-k8s-version-834964 in network mk-old-k8s-version-834964
I0729 18:49:32.579677 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | I0729 18:49:32.579580 146562 retry.go:31] will retry after 5.185953962s: waiting for machine to come up
I0729 18:49:37.767023 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:37.767653 146540 main.go:141] libmachine: (old-k8s-version-834964) Found IP for machine: 192.168.61.89
I0729 18:49:37.767685 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has current primary IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:37.767712 146540 main.go:141] libmachine: (old-k8s-version-834964) Reserving static IP address...
I0729 18:49:37.768100 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-834964", mac: "52:54:00:60:d4:59", ip: "192.168.61.89"} in network mk-old-k8s-version-834964
I0729 18:49:37.850682 146540 main.go:141] libmachine: (old-k8s-version-834964) Reserved static IP address: 192.168.61.89
I0729 18:49:37.850713 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | Getting to WaitForSSH function...
I0729 18:49:37.850722 146540 main.go:141] libmachine: (old-k8s-version-834964) Waiting for SSH to be available...
I0729 18:49:37.853882 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:37.854282 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:minikube Clientid:01:52:54:00:60:d4:59}
I0729 18:49:37.854312 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:37.854508 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | Using SSH client type: external
I0729 18:49:37.854536 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | Using SSH private key: /home/jenkins/minikube-integration/19339-88081/.minikube/machines/old-k8s-version-834964/id_rsa (-rw-------)
I0729 18:49:37.854564 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.89 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19339-88081/.minikube/machines/old-k8s-version-834964/id_rsa -p 22] /usr/bin/ssh <nil>}
I0729 18:49:37.854577 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | About to run SSH command:
I0729 18:49:37.854591 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | exit 0
I0729 18:49:37.985140 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | SSH cmd err, output: <nil>:
I0729 18:49:37.985488 146540 main.go:141] libmachine: (old-k8s-version-834964) KVM machine creation complete!
I0729 18:49:37.985822 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetConfigRaw
I0729 18:49:37.986430 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .DriverName
I0729 18:49:37.986690 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .DriverName
I0729 18:49:37.986945 146540 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0729 18:49:37.986967 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetState
I0729 18:49:37.988624 146540 main.go:141] libmachine: Detecting operating system of created instance...
I0729 18:49:37.988638 146540 main.go:141] libmachine: Waiting for SSH to be available...
I0729 18:49:37.988643 146540 main.go:141] libmachine: Getting to WaitForSSH function...
I0729 18:49:37.988652 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHHostname
I0729 18:49:37.991567 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:37.992095 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:old-k8s-version-834964 Clientid:01:52:54:00:60:d4:59}
I0729 18:49:37.992119 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:37.992331 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHPort
I0729 18:49:37.992548 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHKeyPath
I0729 18:49:37.992721 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHKeyPath
I0729 18:49:37.992922 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHUsername
I0729 18:49:37.993137 146540 main.go:141] libmachine: Using SSH client type: native
I0729 18:49:37.993374 146540 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.61.89 22 <nil> <nil>}
I0729 18:49:37.993393 146540 main.go:141] libmachine: About to run SSH command:
exit 0
I0729 18:49:38.104629 146540 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0729 18:49:38.104659 146540 main.go:141] libmachine: Detecting the provisioner...
I0729 18:49:38.104672 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHHostname
I0729 18:49:38.107483 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:38.107797 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:old-k8s-version-834964 Clientid:01:52:54:00:60:d4:59}
I0729 18:49:38.107827 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:38.107985 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHPort
I0729 18:49:38.108198 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHKeyPath
I0729 18:49:38.108363 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHKeyPath
I0729 18:49:38.108579 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHUsername
I0729 18:49:38.108759 146540 main.go:141] libmachine: Using SSH client type: native
I0729 18:49:38.109019 146540 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.61.89 22 <nil> <nil>}
I0729 18:49:38.109033 146540 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0729 18:49:38.217901 146540 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0729 18:49:38.217970 146540 main.go:141] libmachine: found compatible host: buildroot
I0729 18:49:38.217984 146540 main.go:141] libmachine: Provisioning with buildroot...
I0729 18:49:38.217996 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetMachineName
I0729 18:49:38.218231 146540 buildroot.go:166] provisioning hostname "old-k8s-version-834964"
I0729 18:49:38.218257 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetMachineName
I0729 18:49:38.218438 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHHostname
I0729 18:49:38.221130 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:38.221474 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:old-k8s-version-834964 Clientid:01:52:54:00:60:d4:59}
I0729 18:49:38.221507 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:38.221679 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHPort
I0729 18:49:38.221861 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHKeyPath
I0729 18:49:38.222036 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHKeyPath
I0729 18:49:38.222191 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHUsername
I0729 18:49:38.222354 146540 main.go:141] libmachine: Using SSH client type: native
I0729 18:49:38.222562 146540 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.61.89 22 <nil> <nil>}
I0729 18:49:38.222581 146540 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-834964 && echo "old-k8s-version-834964" | sudo tee /etc/hostname
I0729 18:49:38.342441 146540 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-834964
I0729 18:49:38.342476 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHHostname
I0729 18:49:38.345545 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:38.345968 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:old-k8s-version-834964 Clientid:01:52:54:00:60:d4:59}
I0729 18:49:38.346003 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:38.346156 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHPort
I0729 18:49:38.346377 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHKeyPath
I0729 18:49:38.346576 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHKeyPath
I0729 18:49:38.346745 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHUsername
I0729 18:49:38.346951 146540 main.go:141] libmachine: Using SSH client type: native
I0729 18:49:38.347138 146540 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.61.89 22 <nil> <nil>}
I0729 18:49:38.347160 146540 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-834964' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-834964/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-834964' | sudo tee -a /etc/hosts;
fi
fi
I0729 18:49:38.463988 146540 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0729 18:49:38.464022 146540 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19339-88081/.minikube CaCertPath:/home/jenkins/minikube-integration/19339-88081/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19339-88081/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19339-88081/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19339-88081/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19339-88081/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19339-88081/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19339-88081/.minikube}
I0729 18:49:38.464045 146540 buildroot.go:174] setting up certificates
I0729 18:49:38.464057 146540 provision.go:84] configureAuth start
I0729 18:49:38.464070 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetMachineName
I0729 18:49:38.464562 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetIP
I0729 18:49:38.467450 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:38.467763 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:old-k8s-version-834964 Clientid:01:52:54:00:60:d4:59}
I0729 18:49:38.467787 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:38.467991 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHHostname
I0729 18:49:38.470158 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:38.470478 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:old-k8s-version-834964 Clientid:01:52:54:00:60:d4:59}
I0729 18:49:38.470517 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:38.470612 146540 provision.go:143] copyHostCerts
I0729 18:49:38.470682 146540 exec_runner.go:144] found /home/jenkins/minikube-integration/19339-88081/.minikube/key.pem, removing ...
I0729 18:49:38.470696 146540 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19339-88081/.minikube/key.pem
I0729 18:49:38.470778 146540 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19339-88081/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19339-88081/.minikube/key.pem (1679 bytes)
I0729 18:49:38.470902 146540 exec_runner.go:144] found /home/jenkins/minikube-integration/19339-88081/.minikube/ca.pem, removing ...
I0729 18:49:38.470914 146540 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19339-88081/.minikube/ca.pem
I0729 18:49:38.470964 146540 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19339-88081/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19339-88081/.minikube/ca.pem (1078 bytes)
I0729 18:49:38.471039 146540 exec_runner.go:144] found /home/jenkins/minikube-integration/19339-88081/.minikube/cert.pem, removing ...
I0729 18:49:38.471048 146540 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19339-88081/.minikube/cert.pem
I0729 18:49:38.471080 146540 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19339-88081/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19339-88081/.minikube/cert.pem (1123 bytes)
I0729 18:49:38.471144 146540 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19339-88081/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19339-88081/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19339-88081/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-834964 san=[127.0.0.1 192.168.61.89 localhost minikube old-k8s-version-834964]
I0729 18:49:38.635316 146540 provision.go:177] copyRemoteCerts
I0729 18:49:38.635392 146540 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0729 18:49:38.635426 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHHostname
I0729 18:49:38.638182 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:38.638474 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:old-k8s-version-834964 Clientid:01:52:54:00:60:d4:59}
I0729 18:49:38.638525 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:38.638644 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHPort
I0729 18:49:38.638822 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHKeyPath
I0729 18:49:38.639035 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHUsername
I0729 18:49:38.639203 146540 sshutil.go:53] new ssh client: &{IP:192.168.61.89 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19339-88081/.minikube/machines/old-k8s-version-834964/id_rsa Username:docker}
I0729 18:49:38.726655 146540 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-88081/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0729 18:49:38.756788 146540 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-88081/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0729 18:49:38.786185 146540 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-88081/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0729 18:49:38.813769 146540 provision.go:87] duration metric: took 349.697036ms to configureAuth
I0729 18:49:38.813804 146540 buildroot.go:189] setting minikube options for container-runtime
I0729 18:49:38.814032 146540 config.go:182] Loaded profile config "old-k8s-version-834964": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0729 18:49:38.814114 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHHostname
I0729 18:49:38.817260 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:38.817696 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:old-k8s-version-834964 Clientid:01:52:54:00:60:d4:59}
I0729 18:49:38.817728 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:38.818041 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHPort
I0729 18:49:38.818235 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHKeyPath
I0729 18:49:38.818433 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHKeyPath
I0729 18:49:38.818605 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHUsername
I0729 18:49:38.818766 146540 main.go:141] libmachine: Using SSH client type: native
I0729 18:49:38.818943 146540 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.61.89 22 <nil> <nil>}
I0729 18:49:38.818971 146540 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0729 18:49:39.117090 146540 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0729 18:49:39.117115 146540 main.go:141] libmachine: Checking connection to Docker...
I0729 18:49:39.117124 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetURL
I0729 18:49:39.118506 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | Using libvirt version 6000000
I0729 18:49:39.121171 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:39.121609 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:old-k8s-version-834964 Clientid:01:52:54:00:60:d4:59}
I0729 18:49:39.121639 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:39.121772 146540 main.go:141] libmachine: Docker is up and running!
I0729 18:49:39.121789 146540 main.go:141] libmachine: Reticulating splines...
I0729 18:49:39.121797 146540 client.go:171] duration metric: took 24.176547796s to LocalClient.Create
I0729 18:49:39.121833 146540 start.go:167] duration metric: took 24.176652819s to libmachine.API.Create "old-k8s-version-834964"
I0729 18:49:39.121844 146540 start.go:293] postStartSetup for "old-k8s-version-834964" (driver="kvm2")
I0729 18:49:39.121856 146540 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0729 18:49:39.121912 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .DriverName
I0729 18:49:39.122179 146540 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0729 18:49:39.122232 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHHostname
I0729 18:49:39.124392 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:39.124769 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:old-k8s-version-834964 Clientid:01:52:54:00:60:d4:59}
I0729 18:49:39.124798 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:39.124993 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHPort
I0729 18:49:39.125153 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHKeyPath
I0729 18:49:39.125304 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHUsername
I0729 18:49:39.125490 146540 sshutil.go:53] new ssh client: &{IP:192.168.61.89 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19339-88081/.minikube/machines/old-k8s-version-834964/id_rsa Username:docker}
I0729 18:49:39.215903 146540 ssh_runner.go:195] Run: cat /etc/os-release
I0729 18:49:39.220448 146540 info.go:137] Remote host: Buildroot 2023.02.9
I0729 18:49:39.220479 146540 filesync.go:126] Scanning /home/jenkins/minikube-integration/19339-88081/.minikube/addons for local assets ...
I0729 18:49:39.220565 146540 filesync.go:126] Scanning /home/jenkins/minikube-integration/19339-88081/.minikube/files for local assets ...
I0729 18:49:39.220677 146540 filesync.go:149] local asset: /home/jenkins/minikube-integration/19339-88081/.minikube/files/etc/ssl/certs/952822.pem -> 952822.pem in /etc/ssl/certs
I0729 18:49:39.220814 146540 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0729 18:49:39.234460 146540 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-88081/.minikube/files/etc/ssl/certs/952822.pem --> /etc/ssl/certs/952822.pem (1708 bytes)
I0729 18:49:39.262028 146540 start.go:296] duration metric: took 140.17115ms for postStartSetup
I0729 18:49:39.262090 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetConfigRaw
I0729 18:49:39.262799 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetIP
I0729 18:49:39.266138 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:39.266563 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:old-k8s-version-834964 Clientid:01:52:54:00:60:d4:59}
I0729 18:49:39.266594 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:39.266853 146540 profile.go:143] Saving config to /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/config.json ...
I0729 18:49:39.267048 146540 start.go:128] duration metric: took 24.341591627s to createHost
I0729 18:49:39.267083 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHHostname
I0729 18:49:39.269780 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:39.270146 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:old-k8s-version-834964 Clientid:01:52:54:00:60:d4:59}
I0729 18:49:39.270174 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:39.270357 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHPort
I0729 18:49:39.270548 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHKeyPath
I0729 18:49:39.270727 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHKeyPath
I0729 18:49:39.270916 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHUsername
I0729 18:49:39.271137 146540 main.go:141] libmachine: Using SSH client type: native
I0729 18:49:39.271362 146540 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.61.89 22 <nil> <nil>}
I0729 18:49:39.271377 146540 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0729 18:49:39.381612 146540 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722278979.355638257
I0729 18:49:39.381639 146540 fix.go:216] guest clock: 1722278979.355638257
I0729 18:49:39.381649 146540 fix.go:229] Guest: 2024-07-29 18:49:39.355638257 +0000 UTC Remote: 2024-07-29 18:49:39.267062072 +0000 UTC m=+24.462629733 (delta=88.576185ms)
I0729 18:49:39.381694 146540 fix.go:200] guest clock delta is within tolerance: 88.576185ms
I0729 18:49:39.381702 146540 start.go:83] releasing machines lock for "old-k8s-version-834964", held for 24.456356518s
I0729 18:49:39.381730 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .DriverName
I0729 18:49:39.382029 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetIP
I0729 18:49:39.385170 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:39.385592 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:old-k8s-version-834964 Clientid:01:52:54:00:60:d4:59}
I0729 18:49:39.385622 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:39.385750 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .DriverName
I0729 18:49:39.386273 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .DriverName
I0729 18:49:39.386466 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .DriverName
I0729 18:49:39.386580 146540 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0729 18:49:39.386632 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHHostname
I0729 18:49:39.386714 146540 ssh_runner.go:195] Run: cat /version.json
I0729 18:49:39.386739 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHHostname
I0729 18:49:39.389548 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:39.389783 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:39.389888 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:old-k8s-version-834964 Clientid:01:52:54:00:60:d4:59}
I0729 18:49:39.389926 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:39.390115 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHPort
I0729 18:49:39.390291 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:old-k8s-version-834964 Clientid:01:52:54:00:60:d4:59}
I0729 18:49:39.390317 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:39.390341 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHKeyPath
I0729 18:49:39.390464 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHPort
I0729 18:49:39.390538 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHUsername
I0729 18:49:39.390635 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHKeyPath
I0729 18:49:39.390705 146540 sshutil.go:53] new ssh client: &{IP:192.168.61.89 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19339-88081/.minikube/machines/old-k8s-version-834964/id_rsa Username:docker}
I0729 18:49:39.390797 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetSSHUsername
I0729 18:49:39.390948 146540 sshutil.go:53] new ssh client: &{IP:192.168.61.89 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19339-88081/.minikube/machines/old-k8s-version-834964/id_rsa Username:docker}
I0729 18:49:39.467665 146540 ssh_runner.go:195] Run: systemctl --version
I0729 18:49:39.490707 146540 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0729 18:49:39.663369 146540 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0729 18:49:39.670351 146540 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0729 18:49:39.670425 146540 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0729 18:49:39.687756 146540 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0729 18:49:39.687793 146540 start.go:495] detecting cgroup driver to use...
I0729 18:49:39.687875 146540 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0729 18:49:39.705117 146540 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0729 18:49:39.719265 146540 docker.go:217] disabling cri-docker service (if available) ...
I0729 18:49:39.719335 146540 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0729 18:49:39.733922 146540 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0729 18:49:39.748009 146540 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0729 18:49:39.891603 146540 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0729 18:49:40.076349 146540 docker.go:233] disabling docker service ...
I0729 18:49:40.076420 146540 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0729 18:49:40.096027 146540 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0729 18:49:40.114598 146540 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0729 18:49:40.267221 146540 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0729 18:49:40.421513 146540 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0729 18:49:40.437122 146540 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0729 18:49:40.457785 146540 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0729 18:49:40.457871 146540 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0729 18:49:40.468801 146540 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0729 18:49:40.468894 146540 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0729 18:49:40.480021 146540 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0729 18:49:40.493266 146540 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0729 18:49:40.504183 146540 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0729 18:49:40.518050 146540 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0729 18:49:40.528684 146540 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0729 18:49:40.528788 146540 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0729 18:49:40.543158 146540 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0729 18:49:40.556670 146540 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0729 18:49:40.703484 146540 ssh_runner.go:195] Run: sudo systemctl restart crio
I0729 18:49:40.862959 146540 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0729 18:49:40.863056 146540 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0729 18:49:40.869333 146540 start.go:563] Will wait 60s for crictl version
I0729 18:49:40.869401 146540 ssh_runner.go:195] Run: which crictl
I0729 18:49:40.874707 146540 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0729 18:49:40.932416 146540 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0729 18:49:40.932524 146540 ssh_runner.go:195] Run: crio --version
I0729 18:49:40.965687 146540 ssh_runner.go:195] Run: crio --version
I0729 18:49:40.998262 146540 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0729 18:49:40.999546 146540 main.go:141] libmachine: (old-k8s-version-834964) Calling .GetIP
I0729 18:49:41.002714 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:41.003123 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:d4:59", ip: ""} in network mk-old-k8s-version-834964: {Iface:virbr1 ExpiryTime:2024-07-29 19:49:29 +0000 UTC Type:0 Mac:52:54:00:60:d4:59 Iaid: IPaddr:192.168.61.89 Prefix:24 Hostname:old-k8s-version-834964 Clientid:01:52:54:00:60:d4:59}
I0729 18:49:41.003155 146540 main.go:141] libmachine: (old-k8s-version-834964) DBG | domain old-k8s-version-834964 has defined IP address 192.168.61.89 and MAC address 52:54:00:60:d4:59 in network mk-old-k8s-version-834964
I0729 18:49:41.003358 146540 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0729 18:49:41.008104 146540 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0729 18:49:41.021842 146540 kubeadm.go:883] updating cluster {Name:old-k8s-version-834964 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-834964 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.89 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0729 18:49:41.022016 146540 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0729 18:49:41.022084 146540 ssh_runner.go:195] Run: sudo crictl images --output json
I0729 18:49:41.063295 146540 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0729 18:49:41.063378 146540 ssh_runner.go:195] Run: which lz4
I0729 18:49:41.069194 146540 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0729 18:49:41.074787 146540 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0729 18:49:41.074824 146540 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-88081/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0729 18:49:42.768260 146540 crio.go:462] duration metric: took 1.699119612s to copy over tarball
I0729 18:49:42.768362 146540 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0729 18:49:45.531321 146540 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.762918873s)
I0729 18:49:45.531358 146540 crio.go:469] duration metric: took 2.763060863s to extract the tarball
I0729 18:49:45.531369 146540 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0729 18:49:45.576885 146540 ssh_runner.go:195] Run: sudo crictl images --output json
I0729 18:49:45.626637 146540 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0729 18:49:45.626664 146540 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0729 18:49:45.626746 146540 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0729 18:49:45.626799 146540 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0729 18:49:45.626791 146540 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0729 18:49:45.626888 146540 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0729 18:49:45.626904 146540 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0729 18:49:45.626829 146540 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0729 18:49:45.626981 146540 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0729 18:49:45.626741 146540 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0729 18:49:45.628365 146540 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0729 18:49:45.628366 146540 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0729 18:49:45.628367 146540 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0729 18:49:45.628589 146540 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0729 18:49:45.628626 146540 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0729 18:49:45.628367 146540 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0729 18:49:45.628367 146540 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0729 18:49:45.628540 146540 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0729 18:49:45.780358 146540 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0729 18:49:45.786447 146540 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0729 18:49:45.787696 146540 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0729 18:49:45.804402 146540 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0729 18:49:45.822732 146540 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0729 18:49:45.822925 146540 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0729 18:49:45.827398 146540 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0729 18:49:45.868513 146540 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0729 18:49:45.868574 146540 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0729 18:49:45.868625 146540 ssh_runner.go:195] Run: which crictl
I0729 18:49:45.888448 146540 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0729 18:49:45.888503 146540 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0729 18:49:45.888565 146540 ssh_runner.go:195] Run: which crictl
I0729 18:49:45.911596 146540 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0729 18:49:45.911636 146540 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0729 18:49:45.911684 146540 ssh_runner.go:195] Run: which crictl
I0729 18:49:45.939315 146540 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0729 18:49:45.963639 146540 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0729 18:49:45.963685 146540 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0729 18:49:45.963726 146540 ssh_runner.go:195] Run: which crictl
I0729 18:49:45.988928 146540 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0729 18:49:45.988970 146540 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0729 18:49:45.988999 146540 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0729 18:49:45.989016 146540 ssh_runner.go:195] Run: which crictl
I0729 18:49:45.989030 146540 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0729 18:49:45.989076 146540 ssh_runner.go:195] Run: which crictl
I0729 18:49:45.989092 146540 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0729 18:49:45.989123 146540 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0729 18:49:45.989160 146540 ssh_runner.go:195] Run: which crictl
I0729 18:49:45.989122 146540 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0729 18:49:45.989172 146540 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0729 18:49:45.989163 146540 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0729 18:49:46.136842 146540 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0729 18:49:46.136951 146540 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19339-88081/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0729 18:49:46.136945 146540 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19339-88081/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0729 18:49:46.137001 146540 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0729 18:49:46.137018 146540 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0729 18:49:46.137043 146540 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19339-88081/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0729 18:49:46.137068 146540 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0729 18:49:46.188411 146540 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19339-88081/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0729 18:49:46.236248 146540 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19339-88081/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0729 18:49:46.236308 146540 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19339-88081/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0729 18:49:46.236417 146540 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19339-88081/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0729 18:49:46.236463 146540 cache_images.go:92] duration metric: took 609.787454ms to LoadCachedImages
W0729 18:49:46.236553 146540 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19339-88081/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19339-88081/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
I0729 18:49:46.236569 146540 kubeadm.go:934] updating node { 192.168.61.89 8443 v1.20.0 crio true true} ...
I0729 18:49:46.236693 146540 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-834964 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.89
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-834964 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0729 18:49:46.236778 146540 ssh_runner.go:195] Run: crio config
I0729 18:49:46.283028 146540 cni.go:84] Creating CNI manager for ""
I0729 18:49:46.283051 146540 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0729 18:49:46.283063 146540 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0729 18:49:46.283086 146540 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.89 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-834964 NodeName:old-k8s-version-834964 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.89"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.89 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0729 18:49:46.283256 146540 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.89
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-834964"
kubeletExtraArgs:
node-ip: 192.168.61.89
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.89"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0729 18:49:46.283328 146540 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0729 18:49:46.293609 146540 binaries.go:44] Found k8s binaries, skipping transfer
I0729 18:49:46.293702 146540 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0729 18:49:46.303864 146540 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0729 18:49:46.320996 146540 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0729 18:49:46.340046 146540 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0729 18:49:46.357492 146540 ssh_runner.go:195] Run: grep 192.168.61.89 control-plane.minikube.internal$ /etc/hosts
I0729 18:49:46.361513 146540 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.89 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0729 18:49:46.374102 146540 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0729 18:49:46.506358 146540 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0729 18:49:46.524331 146540 certs.go:68] Setting up /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964 for IP: 192.168.61.89
I0729 18:49:46.524355 146540 certs.go:194] generating shared ca certs ...
I0729 18:49:46.524376 146540 certs.go:226] acquiring lock for ca certs: {Name:mk20106d58b3f22ea0fc0f4b499fa3fa572a2690 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 18:49:46.524554 146540 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19339-88081/.minikube/ca.key
I0729 18:49:46.524618 146540 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19339-88081/.minikube/proxy-client-ca.key
I0729 18:49:46.524633 146540 certs.go:256] generating profile certs ...
I0729 18:49:46.524707 146540 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/client.key
I0729 18:49:46.524726 146540 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/client.crt with IP's: []
I0729 18:49:46.723183 146540 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/client.crt ...
I0729 18:49:46.723221 146540 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/client.crt: {Name:mk4aaa084c1885fbc532e8de7ff3eee7ba262f30 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 18:49:46.723448 146540 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/client.key ...
I0729 18:49:46.723470 146540 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/client.key: {Name:mk5066563a5318424d4212c115ab473463f669cf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 18:49:46.723601 146540 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/apiserver.key.34fbf854
I0729 18:49:46.723626 146540 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/apiserver.crt.34fbf854 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.89]
I0729 18:49:46.842123 146540 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/apiserver.crt.34fbf854 ...
I0729 18:49:46.842153 146540 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/apiserver.crt.34fbf854: {Name:mk52d7991a2bdedf17a0a6e948da6c0480372cc6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 18:49:46.842344 146540 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/apiserver.key.34fbf854 ...
I0729 18:49:46.842362 146540 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/apiserver.key.34fbf854: {Name:mkd53e7d55f46823576cf78817375d78df0ba97a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 18:49:46.842479 146540 certs.go:381] copying /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/apiserver.crt.34fbf854 -> /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/apiserver.crt
I0729 18:49:46.842619 146540 certs.go:385] copying /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/apiserver.key.34fbf854 -> /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/apiserver.key
I0729 18:49:46.842707 146540 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/proxy-client.key
I0729 18:49:46.842726 146540 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/proxy-client.crt with IP's: []
I0729 18:49:46.964604 146540 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/proxy-client.crt ...
I0729 18:49:46.964638 146540 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/proxy-client.crt: {Name:mkdc2d98df9b2c76b92310e6730d32abdae49e10 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 18:49:46.995121 146540 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/proxy-client.key ...
I0729 18:49:46.995158 146540 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/proxy-client.key: {Name:mk397a9ef2540a94be0d1b342569131bbb7b1633 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 18:49:46.995470 146540 certs.go:484] found cert: /home/jenkins/minikube-integration/19339-88081/.minikube/certs/95282.pem (1338 bytes)
W0729 18:49:46.995531 146540 certs.go:480] ignoring /home/jenkins/minikube-integration/19339-88081/.minikube/certs/95282_empty.pem, impossibly tiny 0 bytes
I0729 18:49:46.995576 146540 certs.go:484] found cert: /home/jenkins/minikube-integration/19339-88081/.minikube/certs/ca-key.pem (1679 bytes)
I0729 18:49:46.995624 146540 certs.go:484] found cert: /home/jenkins/minikube-integration/19339-88081/.minikube/certs/ca.pem (1078 bytes)
I0729 18:49:46.995669 146540 certs.go:484] found cert: /home/jenkins/minikube-integration/19339-88081/.minikube/certs/cert.pem (1123 bytes)
I0729 18:49:46.995706 146540 certs.go:484] found cert: /home/jenkins/minikube-integration/19339-88081/.minikube/certs/key.pem (1679 bytes)
I0729 18:49:46.995773 146540 certs.go:484] found cert: /home/jenkins/minikube-integration/19339-88081/.minikube/files/etc/ssl/certs/952822.pem (1708 bytes)
I0729 18:49:46.996573 146540 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-88081/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0729 18:49:47.025441 146540 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-88081/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0729 18:49:47.050238 146540 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-88081/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0729 18:49:47.075716 146540 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-88081/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0729 18:49:47.103014 146540 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0729 18:49:47.127372 146540 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0729 18:49:47.151455 146540 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0729 18:49:47.195932 146540 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/old-k8s-version-834964/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0729 18:49:47.223339 146540 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-88081/.minikube/files/etc/ssl/certs/952822.pem --> /usr/share/ca-certificates/952822.pem (1708 bytes)
I0729 18:49:47.250564 146540 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-88081/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0729 18:49:47.276877 146540 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19339-88081/.minikube/certs/95282.pem --> /usr/share/ca-certificates/95282.pem (1338 bytes)
I0729 18:49:47.302377 146540 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0729 18:49:47.320618 146540 ssh_runner.go:195] Run: openssl version
I0729 18:49:47.326601 146540 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/952822.pem && ln -fs /usr/share/ca-certificates/952822.pem /etc/ssl/certs/952822.pem"
I0729 18:49:47.337920 146540 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/952822.pem
I0729 18:49:47.342650 146540 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 29 17:45 /usr/share/ca-certificates/952822.pem
I0729 18:49:47.342698 146540 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/952822.pem
I0729 18:49:47.348406 146540 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/952822.pem /etc/ssl/certs/3ec20f2e.0"
I0729 18:49:47.361733 146540 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0729 18:49:47.379655 146540 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0729 18:49:47.385762 146540 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 29 17:34 /usr/share/ca-certificates/minikubeCA.pem
I0729 18:49:47.385844 146540 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0729 18:49:47.395125 146540 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0729 18:49:47.411609 146540 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/95282.pem && ln -fs /usr/share/ca-certificates/95282.pem /etc/ssl/certs/95282.pem"
I0729 18:49:47.429416 146540 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/95282.pem
I0729 18:49:47.434905 146540 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 29 17:45 /usr/share/ca-certificates/95282.pem
I0729 18:49:47.434982 146540 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/95282.pem
I0729 18:49:47.446648 146540 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/95282.pem /etc/ssl/certs/51391683.0"
I0729 18:49:47.462619 146540 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0729 18:49:47.467810 146540 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0729 18:49:47.467873 146540 kubeadm.go:392] StartCluster: {Name:old-k8s-version-834964 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19339/minikube-v1.33.1-1722248113-19339-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-834964 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.89 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0729 18:49:47.467969 146540 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0729 18:49:47.468026 146540 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0729 18:49:47.515580 146540 cri.go:89] found id: ""
I0729 18:49:47.515670 146540 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0729 18:49:47.528022 146540 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0729 18:49:47.539905 146540 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0729 18:49:47.552152 146540 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0729 18:49:47.552179 146540 kubeadm.go:157] found existing configuration files:
I0729 18:49:47.552238 146540 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0729 18:49:47.562494 146540 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0729 18:49:47.562569 146540 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0729 18:49:47.572656 146540 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0729 18:49:47.582868 146540 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0729 18:49:47.582934 146540 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0729 18:49:47.593018 146540 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0729 18:49:47.602442 146540 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0729 18:49:47.602512 146540 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0729 18:49:47.612124 146540 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0729 18:49:47.622342 146540 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0729 18:49:47.622392 146540 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0729 18:49:47.633838 146540 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0729 18:49:47.753820 146540 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0729 18:49:47.753940 146540 kubeadm.go:310] [preflight] Running pre-flight checks
I0729 18:49:47.907051 146540 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0729 18:49:47.907222 146540 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0729 18:49:47.907358 146540 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0729 18:49:48.114447 146540 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0729 18:49:48.253720 146540 out.go:204] - Generating certificates and keys ...
I0729 18:49:48.253844 146540 kubeadm.go:310] [certs] Using existing ca certificate authority
I0729 18:49:48.253940 146540 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0729 18:49:48.401216 146540 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0729 18:49:48.589113 146540 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0729 18:49:48.665863 146540 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0729 18:49:48.819968 146540 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0729 18:49:49.088642 146540 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0729 18:49:49.088865 146540 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-834964] and IPs [192.168.61.89 127.0.0.1 ::1]
I0729 18:49:49.275573 146540 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0729 18:49:49.275840 146540 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-834964] and IPs [192.168.61.89 127.0.0.1 ::1]
I0729 18:49:49.342329 146540 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0729 18:49:49.415327 146540 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0729 18:49:49.722222 146540 kubeadm.go:310] [certs] Generating "sa" key and public key
I0729 18:49:49.722465 146540 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0729 18:49:49.798239 146540 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0729 18:49:50.094158 146540 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0729 18:49:50.640201 146540 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0729 18:49:50.763144 146540 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0729 18:49:50.778208 146540 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0729 18:49:50.779287 146540 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0729 18:49:50.779588 146540 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0729 18:49:50.909208 146540 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0729 18:49:50.910895 146540 out.go:204] - Booting up control plane ...
I0729 18:49:50.911043 146540 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0729 18:49:50.917846 146540 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0729 18:49:50.918964 146540 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0729 18:49:50.920370 146540 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0729 18:49:50.924536 146540 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0729 18:50:30.918616 146540 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0729 18:50:30.920037 146540 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:50:30.920248 146540 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:50:35.920548 146540 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:50:35.920727 146540 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:50:45.919993 146540 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:50:45.920247 146540 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:51:05.919910 146540 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:51:05.920384 146540 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:51:45.920802 146540 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:51:45.921043 146540 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:51:45.921075 146540 kubeadm.go:310]
I0729 18:51:45.921150 146540 kubeadm.go:310] Unfortunately, an error has occurred:
I0729 18:51:45.921219 146540 kubeadm.go:310] timed out waiting for the condition
I0729 18:51:45.921229 146540 kubeadm.go:310]
I0729 18:51:45.921291 146540 kubeadm.go:310] This error is likely caused by:
I0729 18:51:45.921355 146540 kubeadm.go:310] - The kubelet is not running
I0729 18:51:45.921505 146540 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0729 18:51:45.921525 146540 kubeadm.go:310]
I0729 18:51:45.921613 146540 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0729 18:51:45.921647 146540 kubeadm.go:310] - 'systemctl status kubelet'
I0729 18:51:45.921708 146540 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0729 18:51:45.921722 146540 kubeadm.go:310]
I0729 18:51:45.921916 146540 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0729 18:51:45.922048 146540 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0729 18:51:45.922059 146540 kubeadm.go:310]
I0729 18:51:45.922196 146540 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0729 18:51:45.922321 146540 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0729 18:51:45.922441 146540 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0729 18:51:45.922555 146540 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0729 18:51:45.922574 146540 kubeadm.go:310]
I0729 18:51:45.923208 146540 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0729 18:51:45.923334 146540 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0729 18:51:45.923456 146540 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0729 18:51:45.923563 146540 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-834964] and IPs [192.168.61.89 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-834964] and IPs [192.168.61.89 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-834964] and IPs [192.168.61.89 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-834964] and IPs [192.168.61.89 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0729 18:51:45.923616 146540 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0729 18:51:46.441791 146540 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0729 18:51:46.455614 146540 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0729 18:51:46.465207 146540 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0729 18:51:46.465226 146540 kubeadm.go:157] found existing configuration files:
I0729 18:51:46.465277 146540 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0729 18:51:46.474646 146540 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0729 18:51:46.474701 146540 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0729 18:51:46.484003 146540 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0729 18:51:46.492752 146540 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0729 18:51:46.492800 146540 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0729 18:51:46.502043 146540 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0729 18:51:46.510723 146540 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0729 18:51:46.510765 146540 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0729 18:51:46.519712 146540 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0729 18:51:46.528411 146540 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0729 18:51:46.528460 146540 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0729 18:51:46.537397 146540 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0729 18:51:46.604447 146540 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0729 18:51:46.604516 146540 kubeadm.go:310] [preflight] Running pre-flight checks
I0729 18:51:46.735054 146540 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0729 18:51:46.735179 146540 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0729 18:51:46.735304 146540 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0729 18:51:46.926175 146540 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0729 18:51:46.928137 146540 out.go:204] - Generating certificates and keys ...
I0729 18:51:46.928245 146540 kubeadm.go:310] [certs] Using existing ca certificate authority
I0729 18:51:46.928334 146540 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0729 18:51:46.928440 146540 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0729 18:51:46.928550 146540 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0729 18:51:46.928646 146540 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0729 18:51:46.928718 146540 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0729 18:51:46.928818 146540 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0729 18:51:46.928913 146540 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0729 18:51:46.929031 146540 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0729 18:51:46.929143 146540 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0729 18:51:46.929199 146540 kubeadm.go:310] [certs] Using the existing "sa" key
I0729 18:51:46.929289 146540 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0729 18:51:47.116714 146540 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0729 18:51:47.197997 146540 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0729 18:51:47.466143 146540 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0729 18:51:47.621876 146540 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0729 18:51:47.636962 146540 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0729 18:51:47.639306 146540 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0729 18:51:47.639383 146540 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0729 18:51:47.769424 146540 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0729 18:51:47.771149 146540 out.go:204] - Booting up control plane ...
I0729 18:51:47.771252 146540 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0729 18:51:47.784252 146540 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0729 18:51:47.785484 146540 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0729 18:51:47.786468 146540 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0729 18:51:47.790222 146540 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0729 18:52:27.793015 146540 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0729 18:52:27.793563 146540 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:52:27.793840 146540 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:52:32.794710 146540 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:52:32.794942 146540 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:52:42.795606 146540 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:52:42.795863 146540 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:53:02.794825 146540 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:53:02.795033 146540 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:53:42.794283 146540 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:53:42.794565 146540 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:53:42.794584 146540 kubeadm.go:310]
I0729 18:53:42.794638 146540 kubeadm.go:310] Unfortunately, an error has occurred:
I0729 18:53:42.794689 146540 kubeadm.go:310] timed out waiting for the condition
I0729 18:53:42.794699 146540 kubeadm.go:310]
I0729 18:53:42.794743 146540 kubeadm.go:310] This error is likely caused by:
I0729 18:53:42.794813 146540 kubeadm.go:310] - The kubelet is not running
I0729 18:53:42.794926 146540 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0729 18:53:42.794935 146540 kubeadm.go:310]
I0729 18:53:42.795018 146540 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0729 18:53:42.795074 146540 kubeadm.go:310] - 'systemctl status kubelet'
I0729 18:53:42.795121 146540 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0729 18:53:42.795129 146540 kubeadm.go:310]
I0729 18:53:42.795267 146540 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0729 18:53:42.795375 146540 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0729 18:53:42.795384 146540 kubeadm.go:310]
I0729 18:53:42.795516 146540 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0729 18:53:42.795635 146540 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0729 18:53:42.795746 146540 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0729 18:53:42.795865 146540 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0729 18:53:42.795881 146540 kubeadm.go:310]
I0729 18:53:42.796649 146540 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0729 18:53:42.796747 146540 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0729 18:53:42.796940 146540 kubeadm.go:394] duration metric: took 3m55.329071027s to StartCluster
I0729 18:53:42.796957 146540 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0729 18:53:42.797015 146540 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0729 18:53:42.797080 146540 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0729 18:53:42.841289 146540 cri.go:89] found id: ""
I0729 18:53:42.841312 146540 logs.go:276] 0 containers: []
W0729 18:53:42.841322 146540 logs.go:278] No container was found matching "kube-apiserver"
I0729 18:53:42.841330 146540 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0729 18:53:42.841382 146540 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0729 18:53:42.910641 146540 cri.go:89] found id: ""
I0729 18:53:42.910666 146540 logs.go:276] 0 containers: []
W0729 18:53:42.910676 146540 logs.go:278] No container was found matching "etcd"
I0729 18:53:42.910683 146540 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0729 18:53:42.910739 146540 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0729 18:53:42.946956 146540 cri.go:89] found id: ""
I0729 18:53:42.946980 146540 logs.go:276] 0 containers: []
W0729 18:53:42.946991 146540 logs.go:278] No container was found matching "coredns"
I0729 18:53:42.946998 146540 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0729 18:53:42.947056 146540 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0729 18:53:42.982033 146540 cri.go:89] found id: ""
I0729 18:53:42.982060 146540 logs.go:276] 0 containers: []
W0729 18:53:42.982070 146540 logs.go:278] No container was found matching "kube-scheduler"
I0729 18:53:42.982078 146540 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0729 18:53:42.982133 146540 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0729 18:53:43.030176 146540 cri.go:89] found id: ""
I0729 18:53:43.030209 146540 logs.go:276] 0 containers: []
W0729 18:53:43.030220 146540 logs.go:278] No container was found matching "kube-proxy"
I0729 18:53:43.030227 146540 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0729 18:53:43.030288 146540 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0729 18:53:43.069413 146540 cri.go:89] found id: ""
I0729 18:53:43.069443 146540 logs.go:276] 0 containers: []
W0729 18:53:43.069451 146540 logs.go:278] No container was found matching "kube-controller-manager"
I0729 18:53:43.069456 146540 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0729 18:53:43.069522 146540 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0729 18:53:43.103098 146540 cri.go:89] found id: ""
I0729 18:53:43.103134 146540 logs.go:276] 0 containers: []
W0729 18:53:43.103146 146540 logs.go:278] No container was found matching "kindnet"
I0729 18:53:43.103160 146540 logs.go:123] Gathering logs for kubelet ...
I0729 18:53:43.103175 146540 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0729 18:53:43.151056 146540 logs.go:123] Gathering logs for dmesg ...
I0729 18:53:43.151090 146540 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0729 18:53:43.164688 146540 logs.go:123] Gathering logs for describe nodes ...
I0729 18:53:43.164721 146540 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0729 18:53:43.270797 146540 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0729 18:53:43.270823 146540 logs.go:123] Gathering logs for CRI-O ...
I0729 18:53:43.270839 146540 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0729 18:53:43.368606 146540 logs.go:123] Gathering logs for container status ...
I0729 18:53:43.368647 146540 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0729 18:53:43.407083 146540 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0729 18:53:43.407133 146540 out.go:239] *
*
W0729 18:53:43.407210 146540 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0729 18:53:43.407244 146540 out.go:239] *
*
W0729 18:53:43.408194 146540 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0729 18:53:43.410941 146540 out.go:177]
W0729 18:53:43.412025 146540 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0729 18:53:43.412083 146540 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0729 18:53:43.412109 146540 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0729 18:53:43.413905 146540 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-834964 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-834964 -n old-k8s-version-834964
E0729 18:53:43.709385 95282 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19339-88081/.minikube/profiles/flannel-085245/client.crt: no such file or directory
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-834964 -n old-k8s-version-834964: exit status 6 (245.179432ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0729 18:53:43.700017 151129 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-834964" does not appear in /home/jenkins/minikube-integration/19339-88081/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-834964" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (268.92s)