=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-572355 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-572355 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m39.991019323s)
-- stdout --
* [old-k8s-version-572355] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19297
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19297-13059/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19297-13059/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-572355" primary control-plane node in "old-k8s-version-572355" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0718 19:21:01.011234 64349 out.go:291] Setting OutFile to fd 1 ...
I0718 19:21:01.011385 64349 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0718 19:21:01.011397 64349 out.go:304] Setting ErrFile to fd 2...
I0718 19:21:01.011405 64349 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0718 19:21:01.011599 64349 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19297-13059/.minikube/bin
I0718 19:21:01.012223 64349 out.go:298] Setting JSON to false
I0718 19:21:01.013168 64349 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":7404,"bootTime":1721323057,"procs":209,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0718 19:21:01.013232 64349 start.go:139] virtualization: kvm guest
I0718 19:21:01.015742 64349 out.go:177] * [old-k8s-version-572355] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0718 19:21:01.017079 64349 out.go:177] - MINIKUBE_LOCATION=19297
I0718 19:21:01.017091 64349 notify.go:220] Checking for updates...
I0718 19:21:01.019695 64349 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0718 19:21:01.020916 64349 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19297-13059/kubeconfig
I0718 19:21:01.022124 64349 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19297-13059/.minikube
I0718 19:21:01.023341 64349 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0718 19:21:01.024684 64349 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0718 19:21:01.026278 64349 config.go:182] Loaded profile config "cert-expiration-969301": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0718 19:21:01.026383 64349 config.go:182] Loaded profile config "force-systemd-flag-961949": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0718 19:21:01.026480 64349 config.go:182] Loaded profile config "kubernetes-upgrade-019052": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0-beta.0
I0718 19:21:01.026583 64349 driver.go:392] Setting default libvirt URI to qemu:///system
I0718 19:21:01.064670 64349 out.go:177] * Using the kvm2 driver based on user configuration
I0718 19:21:01.065860 64349 start.go:297] selected driver: kvm2
I0718 19:21:01.065881 64349 start.go:901] validating driver "kvm2" against <nil>
I0718 19:21:01.065896 64349 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0718 19:21:01.066764 64349 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0718 19:21:01.066845 64349 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19297-13059/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0718 19:21:01.082670 64349 install.go:137] /home/jenkins/minikube-integration/19297-13059/.minikube/bin/docker-machine-driver-kvm2 version is 1.33.1
I0718 19:21:01.082721 64349 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0718 19:21:01.082966 64349 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0718 19:21:01.082997 64349 cni.go:84] Creating CNI manager for ""
I0718 19:21:01.083009 64349 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0718 19:21:01.083021 64349 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0718 19:21:01.083081 64349 start.go:340] cluster config:
{Name:old-k8s-version-572355 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-572355 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0718 19:21:01.083236 64349 iso.go:125] acquiring lock: {Name:mk6e82bea385c58c1317dc0104e49c48f7843ea3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0718 19:21:01.085149 64349 out.go:177] * Starting "old-k8s-version-572355" primary control-plane node in "old-k8s-version-572355" cluster
I0718 19:21:01.086305 64349 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0718 19:21:01.086345 64349 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19297-13059/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0718 19:21:01.086357 64349 cache.go:56] Caching tarball of preloaded images
I0718 19:21:01.086445 64349 preload.go:172] Found /home/jenkins/minikube-integration/19297-13059/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0718 19:21:01.086461 64349 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0718 19:21:01.086541 64349 profile.go:143] Saving config to /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/config.json ...
I0718 19:21:01.086562 64349 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/config.json: {Name:mk2bb0723c93695ead1abdaa21fbe8a792a6bff8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0718 19:21:01.086722 64349 start.go:360] acquireMachinesLock for old-k8s-version-572355: {Name:mk7ddc9aab743e0e95ad7469aa2ebfc5dd98b438 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0718 19:21:11.284676 64349 start.go:364] duration metric: took 10.197933004s to acquireMachinesLock for "old-k8s-version-572355"
I0718 19:21:11.284746 64349 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-572355 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19264/minikube-v1.33.1-1721146474-19264-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-572355 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0718 19:21:11.284843 64349 start.go:125] createHost starting for "" (driver="kvm2")
I0718 19:21:11.432853 64349 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0718 19:21:11.433152 64349 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/19297-13059/.minikube/bin/docker-machine-driver-kvm2
I0718 19:21:11.433216 64349 main.go:141] libmachine: Launching plugin server for driver kvm2
I0718 19:21:11.449584 64349 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38951
I0718 19:21:11.450214 64349 main.go:141] libmachine: () Calling .GetVersion
I0718 19:21:11.450905 64349 main.go:141] libmachine: Using API Version 1
I0718 19:21:11.450935 64349 main.go:141] libmachine: () Calling .SetConfigRaw
I0718 19:21:11.451357 64349 main.go:141] libmachine: () Calling .GetMachineName
I0718 19:21:11.451560 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetMachineName
I0718 19:21:11.451795 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .DriverName
I0718 19:21:11.451973 64349 start.go:159] libmachine.API.Create for "old-k8s-version-572355" (driver="kvm2")
I0718 19:21:11.452002 64349 client.go:168] LocalClient.Create starting
I0718 19:21:11.452039 64349 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19297-13059/.minikube/certs/ca.pem
I0718 19:21:11.452078 64349 main.go:141] libmachine: Decoding PEM data...
I0718 19:21:11.452099 64349 main.go:141] libmachine: Parsing certificate...
I0718 19:21:11.452162 64349 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19297-13059/.minikube/certs/cert.pem
I0718 19:21:11.452186 64349 main.go:141] libmachine: Decoding PEM data...
I0718 19:21:11.452214 64349 main.go:141] libmachine: Parsing certificate...
I0718 19:21:11.452254 64349 main.go:141] libmachine: Running pre-create checks...
I0718 19:21:11.452265 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .PreCreateCheck
I0718 19:21:11.452584 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetConfigRaw
I0718 19:21:11.453052 64349 main.go:141] libmachine: Creating machine...
I0718 19:21:11.453067 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .Create
I0718 19:21:11.453198 64349 main.go:141] libmachine: (old-k8s-version-572355) Creating KVM machine...
I0718 19:21:11.454422 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found existing default KVM network
I0718 19:21:11.456077 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:11.455900 64437 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:ed:08:8c} reservation:<nil>}
I0718 19:21:11.457037 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:11.456948 64437 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:bf:62:24} reservation:<nil>}
I0718 19:21:11.458420 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:11.458336 64437 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000308740}
I0718 19:21:11.458440 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | created network xml:
I0718 19:21:11.458451 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | <network>
I0718 19:21:11.458464 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | <name>mk-old-k8s-version-572355</name>
I0718 19:21:11.458477 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | <dns enable='no'/>
I0718 19:21:11.458489 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG |
I0718 19:21:11.458500 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0718 19:21:11.458512 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | <dhcp>
I0718 19:21:11.458526 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0718 19:21:11.458540 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | </dhcp>
I0718 19:21:11.458549 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | </ip>
I0718 19:21:11.458556 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG |
I0718 19:21:11.458568 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | </network>
I0718 19:21:11.458577 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG |
I0718 19:21:11.545697 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | trying to create private KVM network mk-old-k8s-version-572355 192.168.61.0/24...
I0718 19:21:11.622848 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | private KVM network mk-old-k8s-version-572355 192.168.61.0/24 created
I0718 19:21:11.623020 64349 main.go:141] libmachine: (old-k8s-version-572355) Setting up store path in /home/jenkins/minikube-integration/19297-13059/.minikube/machines/old-k8s-version-572355 ...
I0718 19:21:11.623062 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:11.622977 64437 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19297-13059/.minikube
I0718 19:21:11.623077 64349 main.go:141] libmachine: (old-k8s-version-572355) Building disk image from file:///home/jenkins/minikube-integration/19297-13059/.minikube/cache/iso/amd64/minikube-v1.33.1-1721146474-19264-amd64.iso
I0718 19:21:11.623110 64349 main.go:141] libmachine: (old-k8s-version-572355) Downloading /home/jenkins/minikube-integration/19297-13059/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19297-13059/.minikube/cache/iso/amd64/minikube-v1.33.1-1721146474-19264-amd64.iso...
I0718 19:21:11.859082 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:11.858916 64437 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19297-13059/.minikube/machines/old-k8s-version-572355/id_rsa...
I0718 19:21:11.931275 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:11.931130 64437 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19297-13059/.minikube/machines/old-k8s-version-572355/old-k8s-version-572355.rawdisk...
I0718 19:21:11.931309 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | Writing magic tar header
I0718 19:21:11.931333 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | Writing SSH key tar header
I0718 19:21:11.931347 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:11.931248 64437 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19297-13059/.minikube/machines/old-k8s-version-572355 ...
I0718 19:21:11.931420 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19297-13059/.minikube/machines/old-k8s-version-572355
I0718 19:21:11.931456 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19297-13059/.minikube/machines
I0718 19:21:11.931475 64349 main.go:141] libmachine: (old-k8s-version-572355) Setting executable bit set on /home/jenkins/minikube-integration/19297-13059/.minikube/machines/old-k8s-version-572355 (perms=drwx------)
I0718 19:21:11.931489 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19297-13059/.minikube
I0718 19:21:11.931516 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19297-13059
I0718 19:21:11.931528 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0718 19:21:11.931543 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | Checking permissions on dir: /home/jenkins
I0718 19:21:11.931555 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | Checking permissions on dir: /home
I0718 19:21:11.931568 64349 main.go:141] libmachine: (old-k8s-version-572355) Setting executable bit set on /home/jenkins/minikube-integration/19297-13059/.minikube/machines (perms=drwxr-xr-x)
I0718 19:21:11.931584 64349 main.go:141] libmachine: (old-k8s-version-572355) Setting executable bit set on /home/jenkins/minikube-integration/19297-13059/.minikube (perms=drwxr-xr-x)
I0718 19:21:11.931597 64349 main.go:141] libmachine: (old-k8s-version-572355) Setting executable bit set on /home/jenkins/minikube-integration/19297-13059 (perms=drwxrwxr-x)
I0718 19:21:11.931614 64349 main.go:141] libmachine: (old-k8s-version-572355) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0718 19:21:11.931626 64349 main.go:141] libmachine: (old-k8s-version-572355) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0718 19:21:11.931651 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | Skipping /home - not owner
I0718 19:21:11.931661 64349 main.go:141] libmachine: (old-k8s-version-572355) Creating domain...
I0718 19:21:11.932905 64349 main.go:141] libmachine: (old-k8s-version-572355) define libvirt domain using xml:
I0718 19:21:11.932930 64349 main.go:141] libmachine: (old-k8s-version-572355) <domain type='kvm'>
I0718 19:21:11.932943 64349 main.go:141] libmachine: (old-k8s-version-572355) <name>old-k8s-version-572355</name>
I0718 19:21:11.932968 64349 main.go:141] libmachine: (old-k8s-version-572355) <memory unit='MiB'>2200</memory>
I0718 19:21:11.932980 64349 main.go:141] libmachine: (old-k8s-version-572355) <vcpu>2</vcpu>
I0718 19:21:11.932989 64349 main.go:141] libmachine: (old-k8s-version-572355) <features>
I0718 19:21:11.932996 64349 main.go:141] libmachine: (old-k8s-version-572355) <acpi/>
I0718 19:21:11.933010 64349 main.go:141] libmachine: (old-k8s-version-572355) <apic/>
I0718 19:21:11.933021 64349 main.go:141] libmachine: (old-k8s-version-572355) <pae/>
I0718 19:21:11.933031 64349 main.go:141] libmachine: (old-k8s-version-572355)
I0718 19:21:11.933043 64349 main.go:141] libmachine: (old-k8s-version-572355) </features>
I0718 19:21:11.933051 64349 main.go:141] libmachine: (old-k8s-version-572355) <cpu mode='host-passthrough'>
I0718 19:21:11.933159 64349 main.go:141] libmachine: (old-k8s-version-572355)
I0718 19:21:11.933195 64349 main.go:141] libmachine: (old-k8s-version-572355) </cpu>
I0718 19:21:11.933206 64349 main.go:141] libmachine: (old-k8s-version-572355) <os>
I0718 19:21:11.933218 64349 main.go:141] libmachine: (old-k8s-version-572355) <type>hvm</type>
I0718 19:21:11.933232 64349 main.go:141] libmachine: (old-k8s-version-572355) <boot dev='cdrom'/>
I0718 19:21:11.933244 64349 main.go:141] libmachine: (old-k8s-version-572355) <boot dev='hd'/>
I0718 19:21:11.933257 64349 main.go:141] libmachine: (old-k8s-version-572355) <bootmenu enable='no'/>
I0718 19:21:11.933271 64349 main.go:141] libmachine: (old-k8s-version-572355) </os>
I0718 19:21:11.933280 64349 main.go:141] libmachine: (old-k8s-version-572355) <devices>
I0718 19:21:11.933291 64349 main.go:141] libmachine: (old-k8s-version-572355) <disk type='file' device='cdrom'>
I0718 19:21:11.933309 64349 main.go:141] libmachine: (old-k8s-version-572355) <source file='/home/jenkins/minikube-integration/19297-13059/.minikube/machines/old-k8s-version-572355/boot2docker.iso'/>
I0718 19:21:11.933325 64349 main.go:141] libmachine: (old-k8s-version-572355) <target dev='hdc' bus='scsi'/>
I0718 19:21:11.933337 64349 main.go:141] libmachine: (old-k8s-version-572355) <readonly/>
I0718 19:21:11.933350 64349 main.go:141] libmachine: (old-k8s-version-572355) </disk>
I0718 19:21:11.933392 64349 main.go:141] libmachine: (old-k8s-version-572355) <disk type='file' device='disk'>
I0718 19:21:11.933435 64349 main.go:141] libmachine: (old-k8s-version-572355) <driver name='qemu' type='raw' cache='default' io='threads' />
I0718 19:21:11.933460 64349 main.go:141] libmachine: (old-k8s-version-572355) <source file='/home/jenkins/minikube-integration/19297-13059/.minikube/machines/old-k8s-version-572355/old-k8s-version-572355.rawdisk'/>
I0718 19:21:11.933472 64349 main.go:141] libmachine: (old-k8s-version-572355) <target dev='hda' bus='virtio'/>
I0718 19:21:11.933484 64349 main.go:141] libmachine: (old-k8s-version-572355) </disk>
I0718 19:21:11.933495 64349 main.go:141] libmachine: (old-k8s-version-572355) <interface type='network'>
I0718 19:21:11.933506 64349 main.go:141] libmachine: (old-k8s-version-572355) <source network='mk-old-k8s-version-572355'/>
I0718 19:21:11.933521 64349 main.go:141] libmachine: (old-k8s-version-572355) <model type='virtio'/>
I0718 19:21:11.933548 64349 main.go:141] libmachine: (old-k8s-version-572355) </interface>
I0718 19:21:11.933556 64349 main.go:141] libmachine: (old-k8s-version-572355) <interface type='network'>
I0718 19:21:11.933566 64349 main.go:141] libmachine: (old-k8s-version-572355) <source network='default'/>
I0718 19:21:11.933574 64349 main.go:141] libmachine: (old-k8s-version-572355) <model type='virtio'/>
I0718 19:21:11.933582 64349 main.go:141] libmachine: (old-k8s-version-572355) </interface>
I0718 19:21:11.933592 64349 main.go:141] libmachine: (old-k8s-version-572355) <serial type='pty'>
I0718 19:21:11.933600 64349 main.go:141] libmachine: (old-k8s-version-572355) <target port='0'/>
I0718 19:21:11.933612 64349 main.go:141] libmachine: (old-k8s-version-572355) </serial>
I0718 19:21:11.933633 64349 main.go:141] libmachine: (old-k8s-version-572355) <console type='pty'>
I0718 19:21:11.933648 64349 main.go:141] libmachine: (old-k8s-version-572355) <target type='serial' port='0'/>
I0718 19:21:11.933659 64349 main.go:141] libmachine: (old-k8s-version-572355) </console>
I0718 19:21:11.933670 64349 main.go:141] libmachine: (old-k8s-version-572355) <rng model='virtio'>
I0718 19:21:11.933684 64349 main.go:141] libmachine: (old-k8s-version-572355) <backend model='random'>/dev/random</backend>
I0718 19:21:11.933694 64349 main.go:141] libmachine: (old-k8s-version-572355) </rng>
I0718 19:21:11.933703 64349 main.go:141] libmachine: (old-k8s-version-572355)
I0718 19:21:11.933713 64349 main.go:141] libmachine: (old-k8s-version-572355)
I0718 19:21:11.933739 64349 main.go:141] libmachine: (old-k8s-version-572355) </devices>
I0718 19:21:11.933756 64349 main.go:141] libmachine: (old-k8s-version-572355) </domain>
I0718 19:21:11.933789 64349 main.go:141] libmachine: (old-k8s-version-572355)
I0718 19:21:12.048316 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:0c:85:b1 in network default
I0718 19:21:12.050648 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:12.050692 64349 main.go:141] libmachine: (old-k8s-version-572355) Ensuring networks are active...
I0718 19:21:12.051608 64349 main.go:141] libmachine: (old-k8s-version-572355) Ensuring network default is active
I0718 19:21:12.051948 64349 main.go:141] libmachine: (old-k8s-version-572355) Ensuring network mk-old-k8s-version-572355 is active
I0718 19:21:12.052563 64349 main.go:141] libmachine: (old-k8s-version-572355) Getting domain xml...
I0718 19:21:12.053460 64349 main.go:141] libmachine: (old-k8s-version-572355) Creating domain...
I0718 19:21:13.823397 64349 main.go:141] libmachine: (old-k8s-version-572355) Waiting to get IP...
I0718 19:21:13.824351 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:13.824871 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | unable to find current IP address of domain old-k8s-version-572355 in network mk-old-k8s-version-572355
I0718 19:21:13.824953 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:13.824855 64437 retry.go:31] will retry after 225.025583ms: waiting for machine to come up
I0718 19:21:14.051202 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:14.051700 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | unable to find current IP address of domain old-k8s-version-572355 in network mk-old-k8s-version-572355
I0718 19:21:14.051763 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:14.051678 64437 retry.go:31] will retry after 273.744441ms: waiting for machine to come up
I0718 19:21:14.327268 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:14.327819 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | unable to find current IP address of domain old-k8s-version-572355 in network mk-old-k8s-version-572355
I0718 19:21:14.327845 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:14.327758 64437 retry.go:31] will retry after 448.822405ms: waiting for machine to come up
I0718 19:21:14.778272 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:14.778826 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | unable to find current IP address of domain old-k8s-version-572355 in network mk-old-k8s-version-572355
I0718 19:21:14.778855 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:14.778764 64437 retry.go:31] will retry after 435.670861ms: waiting for machine to come up
I0718 19:21:15.216098 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:15.216572 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | unable to find current IP address of domain old-k8s-version-572355 in network mk-old-k8s-version-572355
I0718 19:21:15.216601 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:15.216527 64437 retry.go:31] will retry after 611.906702ms: waiting for machine to come up
I0718 19:21:15.830533 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:15.831138 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | unable to find current IP address of domain old-k8s-version-572355 in network mk-old-k8s-version-572355
I0718 19:21:15.831168 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:15.831072 64437 retry.go:31] will retry after 591.785608ms: waiting for machine to come up
I0718 19:21:16.425128 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:16.425592 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | unable to find current IP address of domain old-k8s-version-572355 in network mk-old-k8s-version-572355
I0718 19:21:16.425627 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:16.425543 64437 retry.go:31] will retry after 935.98442ms: waiting for machine to come up
I0718 19:21:17.362723 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:17.363256 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | unable to find current IP address of domain old-k8s-version-572355 in network mk-old-k8s-version-572355
I0718 19:21:17.363284 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:17.363203 64437 retry.go:31] will retry after 1.435132661s: waiting for machine to come up
I0718 19:21:18.800360 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:18.800874 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | unable to find current IP address of domain old-k8s-version-572355 in network mk-old-k8s-version-572355
I0718 19:21:18.800903 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:18.800828 64437 retry.go:31] will retry after 1.510810401s: waiting for machine to come up
I0718 19:21:20.313131 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:20.313580 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | unable to find current IP address of domain old-k8s-version-572355 in network mk-old-k8s-version-572355
I0718 19:21:20.313605 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:20.313545 64437 retry.go:31] will retry after 2.098991282s: waiting for machine to come up
I0718 19:21:22.413807 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:22.414335 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | unable to find current IP address of domain old-k8s-version-572355 in network mk-old-k8s-version-572355
I0718 19:21:22.414370 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:22.414307 64437 retry.go:31] will retry after 2.134328959s: waiting for machine to come up
I0718 19:21:24.550768 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:24.551364 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | unable to find current IP address of domain old-k8s-version-572355 in network mk-old-k8s-version-572355
I0718 19:21:24.551391 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:24.551319 64437 retry.go:31] will retry after 2.84457841s: waiting for machine to come up
I0718 19:21:27.397326 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:27.397975 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | unable to find current IP address of domain old-k8s-version-572355 in network mk-old-k8s-version-572355
I0718 19:21:27.398036 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:27.397852 64437 retry.go:31] will retry after 3.734504142s: waiting for machine to come up
I0718 19:21:31.136818 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:31.137369 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | unable to find current IP address of domain old-k8s-version-572355 in network mk-old-k8s-version-572355
I0718 19:21:31.137395 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | I0718 19:21:31.137330 64437 retry.go:31] will retry after 4.959785763s: waiting for machine to come up
I0718 19:21:36.102470 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.103011 64349 main.go:141] libmachine: (old-k8s-version-572355) Found IP for machine: 192.168.61.73
I0718 19:21:36.103035 64349 main.go:141] libmachine: (old-k8s-version-572355) Reserving static IP address...
I0718 19:21:36.103066 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has current primary IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.103426 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-572355", mac: "52:54:00:de:80:1f", ip: "192.168.61.73"} in network mk-old-k8s-version-572355
I0718 19:21:36.174610 64349 main.go:141] libmachine: (old-k8s-version-572355) Reserved static IP address: 192.168.61.73
I0718 19:21:36.174641 64349 main.go:141] libmachine: (old-k8s-version-572355) Waiting for SSH to be available...
I0718 19:21:36.174668 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | Getting to WaitForSSH function...
I0718 19:21:36.177334 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.177757 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:minikube Clientid:01:52:54:00:de:80:1f}
I0718 19:21:36.177788 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.177944 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | Using SSH client type: external
I0718 19:21:36.177985 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | Using SSH private key: /home/jenkins/minikube-integration/19297-13059/.minikube/machines/old-k8s-version-572355/id_rsa (-rw-------)
I0718 19:21:36.178010 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.73 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19297-13059/.minikube/machines/old-k8s-version-572355/id_rsa -p 22] /usr/bin/ssh <nil>}
I0718 19:21:36.178023 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | About to run SSH command:
I0718 19:21:36.178041 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | exit 0
I0718 19:21:36.302990 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | SSH cmd err, output: <nil>:
I0718 19:21:36.303278 64349 main.go:141] libmachine: (old-k8s-version-572355) KVM machine creation complete!
I0718 19:21:36.303540 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetConfigRaw
I0718 19:21:36.304092 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .DriverName
I0718 19:21:36.304285 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .DriverName
I0718 19:21:36.304444 64349 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0718 19:21:36.304460 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetState
I0718 19:21:36.305768 64349 main.go:141] libmachine: Detecting operating system of created instance...
I0718 19:21:36.305782 64349 main.go:141] libmachine: Waiting for SSH to be available...
I0718 19:21:36.305798 64349 main.go:141] libmachine: Getting to WaitForSSH function...
I0718 19:21:36.305803 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHHostname
I0718 19:21:36.307932 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.308274 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:old-k8s-version-572355 Clientid:01:52:54:00:de:80:1f}
I0718 19:21:36.308301 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.308393 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHPort
I0718 19:21:36.308571 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHKeyPath
I0718 19:21:36.308723 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHKeyPath
I0718 19:21:36.308865 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHUsername
I0718 19:21:36.309057 64349 main.go:141] libmachine: Using SSH client type: native
I0718 19:21:36.309249 64349 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.61.73 22 <nil> <nil>}
I0718 19:21:36.309259 64349 main.go:141] libmachine: About to run SSH command:
exit 0
I0718 19:21:36.418185 64349 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0718 19:21:36.418208 64349 main.go:141] libmachine: Detecting the provisioner...
I0718 19:21:36.418217 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHHostname
I0718 19:21:36.421127 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.421430 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:old-k8s-version-572355 Clientid:01:52:54:00:de:80:1f}
I0718 19:21:36.421458 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.421590 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHPort
I0718 19:21:36.421805 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHKeyPath
I0718 19:21:36.421970 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHKeyPath
I0718 19:21:36.422098 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHUsername
I0718 19:21:36.422249 64349 main.go:141] libmachine: Using SSH client type: native
I0718 19:21:36.422410 64349 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.61.73 22 <nil> <nil>}
I0718 19:21:36.422420 64349 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0718 19:21:36.531935 64349 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0718 19:21:36.531983 64349 main.go:141] libmachine: found compatible host: buildroot
I0718 19:21:36.531990 64349 main.go:141] libmachine: Provisioning with buildroot...
I0718 19:21:36.531999 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetMachineName
I0718 19:21:36.532224 64349 buildroot.go:166] provisioning hostname "old-k8s-version-572355"
I0718 19:21:36.532251 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetMachineName
I0718 19:21:36.532395 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHHostname
I0718 19:21:36.535117 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.535493 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:old-k8s-version-572355 Clientid:01:52:54:00:de:80:1f}
I0718 19:21:36.535522 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.535660 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHPort
I0718 19:21:36.535850 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHKeyPath
I0718 19:21:36.536037 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHKeyPath
I0718 19:21:36.536177 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHUsername
I0718 19:21:36.536361 64349 main.go:141] libmachine: Using SSH client type: native
I0718 19:21:36.536577 64349 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.61.73 22 <nil> <nil>}
I0718 19:21:36.536596 64349 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-572355 && echo "old-k8s-version-572355" | sudo tee /etc/hostname
I0718 19:21:36.661085 64349 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-572355
I0718 19:21:36.661116 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHHostname
I0718 19:21:36.663750 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.664119 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:old-k8s-version-572355 Clientid:01:52:54:00:de:80:1f}
I0718 19:21:36.664145 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.664314 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHPort
I0718 19:21:36.664501 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHKeyPath
I0718 19:21:36.664651 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHKeyPath
I0718 19:21:36.664801 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHUsername
I0718 19:21:36.664976 64349 main.go:141] libmachine: Using SSH client type: native
I0718 19:21:36.665179 64349 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.61.73 22 <nil> <nil>}
I0718 19:21:36.665205 64349 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-572355' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-572355/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-572355' | sudo tee -a /etc/hosts;
fi
fi
I0718 19:21:36.779473 64349 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0718 19:21:36.779499 64349 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19297-13059/.minikube CaCertPath:/home/jenkins/minikube-integration/19297-13059/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19297-13059/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19297-13059/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19297-13059/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19297-13059/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19297-13059/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19297-13059/.minikube}
I0718 19:21:36.779529 64349 buildroot.go:174] setting up certificates
I0718 19:21:36.779538 64349 provision.go:84] configureAuth start
I0718 19:21:36.779546 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetMachineName
I0718 19:21:36.779790 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetIP
I0718 19:21:36.782578 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.782929 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:old-k8s-version-572355 Clientid:01:52:54:00:de:80:1f}
I0718 19:21:36.782968 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.783112 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHHostname
I0718 19:21:36.785164 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.785446 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:old-k8s-version-572355 Clientid:01:52:54:00:de:80:1f}
I0718 19:21:36.785472 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.785547 64349 provision.go:143] copyHostCerts
I0718 19:21:36.785603 64349 exec_runner.go:144] found /home/jenkins/minikube-integration/19297-13059/.minikube/ca.pem, removing ...
I0718 19:21:36.785614 64349 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19297-13059/.minikube/ca.pem
I0718 19:21:36.785666 64349 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19297-13059/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19297-13059/.minikube/ca.pem (1082 bytes)
I0718 19:21:36.785762 64349 exec_runner.go:144] found /home/jenkins/minikube-integration/19297-13059/.minikube/cert.pem, removing ...
I0718 19:21:36.785769 64349 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19297-13059/.minikube/cert.pem
I0718 19:21:36.785788 64349 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19297-13059/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19297-13059/.minikube/cert.pem (1123 bytes)
I0718 19:21:36.785849 64349 exec_runner.go:144] found /home/jenkins/minikube-integration/19297-13059/.minikube/key.pem, removing ...
I0718 19:21:36.785869 64349 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19297-13059/.minikube/key.pem
I0718 19:21:36.785899 64349 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19297-13059/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19297-13059/.minikube/key.pem (1675 bytes)
I0718 19:21:36.785957 64349 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19297-13059/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19297-13059/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19297-13059/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-572355 san=[127.0.0.1 192.168.61.73 localhost minikube old-k8s-version-572355]
I0718 19:21:36.879316 64349 provision.go:177] copyRemoteCerts
I0718 19:21:36.879369 64349 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0718 19:21:36.879390 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHHostname
I0718 19:21:36.882038 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.882325 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:old-k8s-version-572355 Clientid:01:52:54:00:de:80:1f}
I0718 19:21:36.882351 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:36.882564 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHPort
I0718 19:21:36.882755 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHKeyPath
I0718 19:21:36.882953 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHUsername
I0718 19:21:36.883088 64349 sshutil.go:53] new ssh client: &{IP:192.168.61.73 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19297-13059/.minikube/machines/old-k8s-version-572355/id_rsa Username:docker}
I0718 19:21:36.965088 64349 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19297-13059/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0718 19:21:36.987732 64349 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19297-13059/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0718 19:21:37.010667 64349 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19297-13059/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0718 19:21:37.033739 64349 provision.go:87] duration metric: took 254.190482ms to configureAuth
I0718 19:21:37.033778 64349 buildroot.go:189] setting minikube options for container-runtime
I0718 19:21:37.033959 64349 config.go:182] Loaded profile config "old-k8s-version-572355": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0718 19:21:37.034039 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHHostname
I0718 19:21:37.036437 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:37.036667 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:old-k8s-version-572355 Clientid:01:52:54:00:de:80:1f}
I0718 19:21:37.036696 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:37.036852 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHPort
I0718 19:21:37.037015 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHKeyPath
I0718 19:21:37.037139 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHKeyPath
I0718 19:21:37.037258 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHUsername
I0718 19:21:37.037366 64349 main.go:141] libmachine: Using SSH client type: native
I0718 19:21:37.037523 64349 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.61.73 22 <nil> <nil>}
I0718 19:21:37.037537 64349 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0718 19:21:37.305552 64349 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0718 19:21:37.305591 64349 main.go:141] libmachine: Checking connection to Docker...
I0718 19:21:37.305603 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetURL
I0718 19:21:37.306806 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | Using libvirt version 6000000
I0718 19:21:37.308855 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:37.309194 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:old-k8s-version-572355 Clientid:01:52:54:00:de:80:1f}
I0718 19:21:37.309230 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:37.309421 64349 main.go:141] libmachine: Docker is up and running!
I0718 19:21:37.309434 64349 main.go:141] libmachine: Reticulating splines...
I0718 19:21:37.309441 64349 client.go:171] duration metric: took 25.857429108s to LocalClient.Create
I0718 19:21:37.309461 64349 start.go:167] duration metric: took 25.857491372s to libmachine.API.Create "old-k8s-version-572355"
I0718 19:21:37.309470 64349 start.go:293] postStartSetup for "old-k8s-version-572355" (driver="kvm2")
I0718 19:21:37.309480 64349 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0718 19:21:37.309496 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .DriverName
I0718 19:21:37.309734 64349 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0718 19:21:37.309757 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHHostname
I0718 19:21:37.312138 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:37.312486 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:old-k8s-version-572355 Clientid:01:52:54:00:de:80:1f}
I0718 19:21:37.312516 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:37.312642 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHPort
I0718 19:21:37.312814 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHKeyPath
I0718 19:21:37.312955 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHUsername
I0718 19:21:37.313074 64349 sshutil.go:53] new ssh client: &{IP:192.168.61.73 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19297-13059/.minikube/machines/old-k8s-version-572355/id_rsa Username:docker}
I0718 19:21:37.397427 64349 ssh_runner.go:195] Run: cat /etc/os-release
I0718 19:21:37.401566 64349 info.go:137] Remote host: Buildroot 2023.02.9
I0718 19:21:37.401589 64349 filesync.go:126] Scanning /home/jenkins/minikube-integration/19297-13059/.minikube/addons for local assets ...
I0718 19:21:37.401649 64349 filesync.go:126] Scanning /home/jenkins/minikube-integration/19297-13059/.minikube/files for local assets ...
I0718 19:21:37.401715 64349 filesync.go:149] local asset: /home/jenkins/minikube-integration/19297-13059/.minikube/files/etc/ssl/certs/202522.pem -> 202522.pem in /etc/ssl/certs
I0718 19:21:37.401791 64349 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0718 19:21:37.410795 64349 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19297-13059/.minikube/files/etc/ssl/certs/202522.pem --> /etc/ssl/certs/202522.pem (1708 bytes)
I0718 19:21:37.436891 64349 start.go:296] duration metric: took 127.410285ms for postStartSetup
I0718 19:21:37.436935 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetConfigRaw
I0718 19:21:37.437516 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetIP
I0718 19:21:37.440004 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:37.440321 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:old-k8s-version-572355 Clientid:01:52:54:00:de:80:1f}
I0718 19:21:37.440351 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:37.440573 64349 profile.go:143] Saving config to /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/config.json ...
I0718 19:21:37.440774 64349 start.go:128] duration metric: took 26.155919351s to createHost
I0718 19:21:37.440809 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHHostname
I0718 19:21:37.443020 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:37.443324 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:old-k8s-version-572355 Clientid:01:52:54:00:de:80:1f}
I0718 19:21:37.443351 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:37.443490 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHPort
I0718 19:21:37.443667 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHKeyPath
I0718 19:21:37.443809 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHKeyPath
I0718 19:21:37.443921 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHUsername
I0718 19:21:37.444059 64349 main.go:141] libmachine: Using SSH client type: native
I0718 19:21:37.444271 64349 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.61.73 22 <nil> <nil>}
I0718 19:21:37.444293 64349 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0718 19:21:37.551823 64349 main.go:141] libmachine: SSH cmd err, output: <nil>: 1721330497.518466454
I0718 19:21:37.551849 64349 fix.go:216] guest clock: 1721330497.518466454
I0718 19:21:37.551859 64349 fix.go:229] Guest: 2024-07-18 19:21:37.518466454 +0000 UTC Remote: 2024-07-18 19:21:37.440786049 +0000 UTC m=+36.463823342 (delta=77.680405ms)
I0718 19:21:37.551884 64349 fix.go:200] guest clock delta is within tolerance: 77.680405ms
I0718 19:21:37.551890 64349 start.go:83] releasing machines lock for "old-k8s-version-572355", held for 26.267176425s
I0718 19:21:37.551912 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .DriverName
I0718 19:21:37.552205 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetIP
I0718 19:21:37.554760 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:37.555095 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:old-k8s-version-572355 Clientid:01:52:54:00:de:80:1f}
I0718 19:21:37.555143 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:37.555339 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .DriverName
I0718 19:21:37.555874 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .DriverName
I0718 19:21:37.556089 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .DriverName
I0718 19:21:37.556176 64349 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0718 19:21:37.556206 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHHostname
I0718 19:21:37.556283 64349 ssh_runner.go:195] Run: cat /version.json
I0718 19:21:37.556294 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHHostname
I0718 19:21:37.561054 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:37.561201 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:37.561427 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:old-k8s-version-572355 Clientid:01:52:54:00:de:80:1f}
I0718 19:21:37.561459 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:37.561609 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:old-k8s-version-572355 Clientid:01:52:54:00:de:80:1f}
I0718 19:21:37.561626 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHPort
I0718 19:21:37.561649 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:37.561788 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHPort
I0718 19:21:37.561811 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHKeyPath
I0718 19:21:37.561950 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHUsername
I0718 19:21:37.561977 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHKeyPath
I0718 19:21:37.562062 64349 sshutil.go:53] new ssh client: &{IP:192.168.61.73 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19297-13059/.minikube/machines/old-k8s-version-572355/id_rsa Username:docker}
I0718 19:21:37.562144 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetSSHUsername
I0718 19:21:37.562278 64349 sshutil.go:53] new ssh client: &{IP:192.168.61.73 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19297-13059/.minikube/machines/old-k8s-version-572355/id_rsa Username:docker}
I0718 19:21:37.671149 64349 ssh_runner.go:195] Run: systemctl --version
I0718 19:21:37.677346 64349 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0718 19:21:37.852091 64349 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0718 19:21:37.858498 64349 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0718 19:21:37.858559 64349 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0718 19:21:37.876747 64349 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0718 19:21:37.876775 64349 start.go:495] detecting cgroup driver to use...
I0718 19:21:37.876871 64349 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0718 19:21:37.896329 64349 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0718 19:21:37.910887 64349 docker.go:217] disabling cri-docker service (if available) ...
I0718 19:21:37.910943 64349 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0718 19:21:37.923677 64349 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0718 19:21:37.936317 64349 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0718 19:21:38.048490 64349 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0718 19:21:38.210887 64349 docker.go:233] disabling docker service ...
I0718 19:21:38.210952 64349 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0718 19:21:38.224636 64349 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0718 19:21:38.236737 64349 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0718 19:21:38.355141 64349 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0718 19:21:38.476561 64349 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0718 19:21:38.490459 64349 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0718 19:21:38.512876 64349 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0718 19:21:38.512932 64349 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0718 19:21:38.522445 64349 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0718 19:21:38.522501 64349 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0718 19:21:38.532156 64349 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0718 19:21:38.542270 64349 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0718 19:21:38.553026 64349 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0718 19:21:38.563289 64349 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0718 19:21:38.572591 64349 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0718 19:21:38.572641 64349 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0718 19:21:38.585937 64349 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0718 19:21:38.598835 64349 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0718 19:21:38.714975 64349 ssh_runner.go:195] Run: sudo systemctl restart crio
I0718 19:21:38.870342 64349 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0718 19:21:38.870415 64349 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0718 19:21:38.875183 64349 start.go:563] Will wait 60s for crictl version
I0718 19:21:38.875243 64349 ssh_runner.go:195] Run: which crictl
I0718 19:21:38.878918 64349 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0718 19:21:38.922755 64349 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0718 19:21:38.922860 64349 ssh_runner.go:195] Run: crio --version
I0718 19:21:38.952316 64349 ssh_runner.go:195] Run: crio --version
I0718 19:21:38.984926 64349 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0718 19:21:38.986296 64349 main.go:141] libmachine: (old-k8s-version-572355) Calling .GetIP
I0718 19:21:38.989314 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:38.989710 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:80:1f", ip: ""} in network mk-old-k8s-version-572355: {Iface:virbr3 ExpiryTime:2024-07-18 20:21:26 +0000 UTC Type:0 Mac:52:54:00:de:80:1f Iaid: IPaddr:192.168.61.73 Prefix:24 Hostname:old-k8s-version-572355 Clientid:01:52:54:00:de:80:1f}
I0718 19:21:38.989743 64349 main.go:141] libmachine: (old-k8s-version-572355) DBG | domain old-k8s-version-572355 has defined IP address 192.168.61.73 and MAC address 52:54:00:de:80:1f in network mk-old-k8s-version-572355
I0718 19:21:38.990001 64349 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0718 19:21:38.994252 64349 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0718 19:21:39.007962 64349 kubeadm.go:883] updating cluster {Name:old-k8s-version-572355 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19264/minikube-v1.33.1-1721146474-19264-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-572355 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.73 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0718 19:21:39.008064 64349 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0718 19:21:39.008103 64349 ssh_runner.go:195] Run: sudo crictl images --output json
I0718 19:21:39.042403 64349 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0718 19:21:39.042468 64349 ssh_runner.go:195] Run: which lz4
I0718 19:21:39.046841 64349 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0718 19:21:39.050920 64349 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0718 19:21:39.050952 64349 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19297-13059/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0718 19:21:40.722361 64349 crio.go:462] duration metric: took 1.675543572s to copy over tarball
I0718 19:21:40.722452 64349 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0718 19:21:43.298224 64349 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.575743053s)
I0718 19:21:43.298249 64349 crio.go:469] duration metric: took 2.575853441s to extract the tarball
I0718 19:21:43.298259 64349 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0718 19:21:43.348133 64349 ssh_runner.go:195] Run: sudo crictl images --output json
I0718 19:21:43.395303 64349 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0718 19:21:43.395332 64349 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0718 19:21:43.395419 64349 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0718 19:21:43.395440 64349 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0718 19:21:43.395449 64349 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0718 19:21:43.395474 64349 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0718 19:21:43.395419 64349 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0718 19:21:43.395517 64349 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0718 19:21:43.395538 64349 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0718 19:21:43.395555 64349 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0718 19:21:43.396819 64349 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0718 19:21:43.396840 64349 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0718 19:21:43.396893 64349 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0718 19:21:43.396916 64349 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0718 19:21:43.396916 64349 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0718 19:21:43.396928 64349 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0718 19:21:43.396998 64349 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0718 19:21:43.397009 64349 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0718 19:21:43.583454 64349 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0718 19:21:43.624105 64349 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0718 19:21:43.624149 64349 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0718 19:21:43.624196 64349 ssh_runner.go:195] Run: which crictl
I0718 19:21:43.629718 64349 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0718 19:21:43.641860 64349 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0718 19:21:43.666588 64349 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19297-13059/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0718 19:21:43.700197 64349 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0718 19:21:43.700242 64349 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0718 19:21:43.700290 64349 ssh_runner.go:195] Run: which crictl
I0718 19:21:43.704137 64349 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0718 19:21:43.735973 64349 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19297-13059/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0718 19:21:43.740881 64349 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0718 19:21:43.742297 64349 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0718 19:21:43.744059 64349 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0718 19:21:43.755030 64349 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0718 19:21:43.796239 64349 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0718 19:21:43.796289 64349 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0718 19:21:43.796338 64349 ssh_runner.go:195] Run: which crictl
I0718 19:21:43.822859 64349 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0718 19:21:43.822912 64349 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0718 19:21:43.822962 64349 ssh_runner.go:195] Run: which crictl
I0718 19:21:43.830526 64349 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0718 19:21:43.830571 64349 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0718 19:21:43.830617 64349 ssh_runner.go:195] Run: which crictl
I0718 19:21:43.836042 64349 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0718 19:21:43.841979 64349 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0718 19:21:43.842015 64349 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0718 19:21:43.842050 64349 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0718 19:21:43.842056 64349 ssh_runner.go:195] Run: which crictl
I0718 19:21:43.842059 64349 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0718 19:21:43.842110 64349 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0718 19:21:43.925320 64349 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0718 19:21:43.925369 64349 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0718 19:21:43.925383 64349 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19297-13059/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0718 19:21:43.925422 64349 ssh_runner.go:195] Run: which crictl
I0718 19:21:43.925454 64349 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0718 19:21:43.932881 64349 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19297-13059/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0718 19:21:43.938586 64349 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19297-13059/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0718 19:21:43.966878 64349 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19297-13059/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0718 19:21:43.966928 64349 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0718 19:21:43.997991 64349 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19297-13059/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0718 19:21:44.254974 64349 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0718 19:21:44.396763 64349 cache_images.go:92] duration metric: took 1.001410249s to LoadCachedImages
W0718 19:21:44.396873 64349 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19297-13059/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19297-13059/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0718 19:21:44.396893 64349 kubeadm.go:934] updating node { 192.168.61.73 8443 v1.20.0 crio true true} ...
I0718 19:21:44.397013 64349 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-572355 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.73
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-572355 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0718 19:21:44.397078 64349 ssh_runner.go:195] Run: crio config
I0718 19:21:44.447436 64349 cni.go:84] Creating CNI manager for ""
I0718 19:21:44.447463 64349 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0718 19:21:44.447477 64349 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0718 19:21:44.447501 64349 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.73 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-572355 NodeName:old-k8s-version-572355 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.73"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.73 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0718 19:21:44.447704 64349 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.73
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-572355"
kubeletExtraArgs:
node-ip: 192.168.61.73
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.73"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0718 19:21:44.447776 64349 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0718 19:21:44.458045 64349 binaries.go:44] Found k8s binaries, skipping transfer
I0718 19:21:44.458114 64349 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0718 19:21:44.467744 64349 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0718 19:21:44.484682 64349 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0718 19:21:44.500808 64349 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0718 19:21:44.517597 64349 ssh_runner.go:195] Run: grep 192.168.61.73 control-plane.minikube.internal$ /etc/hosts
I0718 19:21:44.521536 64349 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.73 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0718 19:21:44.533904 64349 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0718 19:21:44.665246 64349 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0718 19:21:44.683981 64349 certs.go:68] Setting up /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355 for IP: 192.168.61.73
I0718 19:21:44.684003 64349 certs.go:194] generating shared ca certs ...
I0718 19:21:44.684018 64349 certs.go:226] acquiring lock for ca certs: {Name:mk820be11dab75ee64e8d245409c39c5a3038772 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0718 19:21:44.684184 64349 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19297-13059/.minikube/ca.key
I0718 19:21:44.684237 64349 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19297-13059/.minikube/proxy-client-ca.key
I0718 19:21:44.684247 64349 certs.go:256] generating profile certs ...
I0718 19:21:44.684307 64349 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/client.key
I0718 19:21:44.684326 64349 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/client.crt with IP's: []
I0718 19:21:44.834242 64349 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/client.crt ...
I0718 19:21:44.834277 64349 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/client.crt: {Name:mkaec5f1b7b0a03fc2ca9003ff3d97ae984d29f8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0718 19:21:44.834488 64349 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/client.key ...
I0718 19:21:44.834506 64349 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/client.key: {Name:mk3dae378668fb879e0ec26bc7532a70e89c924c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0718 19:21:44.834598 64349 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/apiserver.key.447e8fca
I0718 19:21:44.834620 64349 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/apiserver.crt.447e8fca with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.73]
I0718 19:21:44.944333 64349 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/apiserver.crt.447e8fca ...
I0718 19:21:44.944363 64349 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/apiserver.crt.447e8fca: {Name:mk582fed6e67203e2bace8ec0f71457f2f182e6f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0718 19:21:44.944525 64349 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/apiserver.key.447e8fca ...
I0718 19:21:44.944547 64349 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/apiserver.key.447e8fca: {Name:mk55374e6346d3fa1337aa7a636358e6e7d609e3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0718 19:21:44.944639 64349 certs.go:381] copying /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/apiserver.crt.447e8fca -> /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/apiserver.crt
I0718 19:21:44.944726 64349 certs.go:385] copying /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/apiserver.key.447e8fca -> /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/apiserver.key
I0718 19:21:44.944784 64349 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/proxy-client.key
I0718 19:21:44.944802 64349 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/proxy-client.crt with IP's: []
I0718 19:21:45.032346 64349 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/proxy-client.crt ...
I0718 19:21:45.032374 64349 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/proxy-client.crt: {Name:mk4b671ce78d4761a00bb66e6678d2d89ea4c1a3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0718 19:21:45.032554 64349 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/proxy-client.key ...
I0718 19:21:45.032583 64349 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/proxy-client.key: {Name:mk95a01b5ba1879836c9b32b6ba1abda13379753 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0718 19:21:45.032787 64349 certs.go:484] found cert: /home/jenkins/minikube-integration/19297-13059/.minikube/certs/20252.pem (1338 bytes)
W0718 19:21:45.032827 64349 certs.go:480] ignoring /home/jenkins/minikube-integration/19297-13059/.minikube/certs/20252_empty.pem, impossibly tiny 0 bytes
I0718 19:21:45.032838 64349 certs.go:484] found cert: /home/jenkins/minikube-integration/19297-13059/.minikube/certs/ca-key.pem (1679 bytes)
I0718 19:21:45.032862 64349 certs.go:484] found cert: /home/jenkins/minikube-integration/19297-13059/.minikube/certs/ca.pem (1082 bytes)
I0718 19:21:45.032885 64349 certs.go:484] found cert: /home/jenkins/minikube-integration/19297-13059/.minikube/certs/cert.pem (1123 bytes)
I0718 19:21:45.032914 64349 certs.go:484] found cert: /home/jenkins/minikube-integration/19297-13059/.minikube/certs/key.pem (1675 bytes)
I0718 19:21:45.032949 64349 certs.go:484] found cert: /home/jenkins/minikube-integration/19297-13059/.minikube/files/etc/ssl/certs/202522.pem (1708 bytes)
I0718 19:21:45.033514 64349 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19297-13059/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0718 19:21:45.060394 64349 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19297-13059/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0718 19:21:45.086639 64349 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19297-13059/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0718 19:21:45.115068 64349 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19297-13059/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0718 19:21:45.141038 64349 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0718 19:21:45.166322 64349 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0718 19:21:45.193348 64349 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0718 19:21:45.217231 64349 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19297-13059/.minikube/profiles/old-k8s-version-572355/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0718 19:21:45.242452 64349 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19297-13059/.minikube/certs/20252.pem --> /usr/share/ca-certificates/20252.pem (1338 bytes)
I0718 19:21:45.267231 64349 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19297-13059/.minikube/files/etc/ssl/certs/202522.pem --> /usr/share/ca-certificates/202522.pem (1708 bytes)
I0718 19:21:45.292995 64349 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19297-13059/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0718 19:21:45.317709 64349 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0718 19:21:45.336136 64349 ssh_runner.go:195] Run: openssl version
I0718 19:21:45.342297 64349 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0718 19:21:45.353539 64349 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0718 19:21:45.358276 64349 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 18 18:06 /usr/share/ca-certificates/minikubeCA.pem
I0718 19:21:45.358361 64349 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0718 19:21:45.364546 64349 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0718 19:21:45.375741 64349 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/20252.pem && ln -fs /usr/share/ca-certificates/20252.pem /etc/ssl/certs/20252.pem"
I0718 19:21:45.386898 64349 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/20252.pem
I0718 19:21:45.391663 64349 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 18 18:18 /usr/share/ca-certificates/20252.pem
I0718 19:21:45.391718 64349 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/20252.pem
I0718 19:21:45.397695 64349 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/20252.pem /etc/ssl/certs/51391683.0"
I0718 19:21:45.408779 64349 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/202522.pem && ln -fs /usr/share/ca-certificates/202522.pem /etc/ssl/certs/202522.pem"
I0718 19:21:45.419675 64349 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/202522.pem
I0718 19:21:45.424526 64349 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 18 18:18 /usr/share/ca-certificates/202522.pem
I0718 19:21:45.424570 64349 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/202522.pem
I0718 19:21:45.430351 64349 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/202522.pem /etc/ssl/certs/3ec20f2e.0"
I0718 19:21:45.441884 64349 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0718 19:21:45.446277 64349 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0718 19:21:45.446335 64349 kubeadm.go:392] StartCluster: {Name:old-k8s-version-572355 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19264/minikube-v1.33.1-1721146474-19264-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-572355 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.73 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0718 19:21:45.446415 64349 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0718 19:21:45.446509 64349 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0718 19:21:45.493330 64349 cri.go:89] found id: ""
I0718 19:21:45.493440 64349 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0718 19:21:45.511518 64349 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0718 19:21:45.531114 64349 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0718 19:21:45.547020 64349 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0718 19:21:45.547039 64349 kubeadm.go:157] found existing configuration files:
I0718 19:21:45.547100 64349 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0718 19:21:45.559755 64349 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0718 19:21:45.559815 64349 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0718 19:21:45.574156 64349 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0718 19:21:45.589801 64349 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0718 19:21:45.589874 64349 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0718 19:21:45.609193 64349 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0718 19:21:45.624237 64349 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0718 19:21:45.624313 64349 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0718 19:21:45.635067 64349 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0718 19:21:45.644371 64349 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0718 19:21:45.644446 64349 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0718 19:21:45.654844 64349 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0718 19:21:45.924865 64349 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0718 19:23:43.065329 64349 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0718 19:23:43.065421 64349 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0718 19:23:43.066928 64349 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0718 19:23:43.066993 64349 kubeadm.go:310] [preflight] Running pre-flight checks
I0718 19:23:43.067088 64349 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0718 19:23:43.067229 64349 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0718 19:23:43.067331 64349 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0718 19:23:43.067400 64349 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0718 19:23:43.069140 64349 out.go:204] - Generating certificates and keys ...
I0718 19:23:43.069231 64349 kubeadm.go:310] [certs] Using existing ca certificate authority
I0718 19:23:43.069296 64349 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0718 19:23:43.069362 64349 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0718 19:23:43.069426 64349 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0718 19:23:43.069503 64349 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0718 19:23:43.069570 64349 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0718 19:23:43.069645 64349 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0718 19:23:43.069803 64349 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-572355] and IPs [192.168.61.73 127.0.0.1 ::1]
I0718 19:23:43.069853 64349 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0718 19:23:43.069969 64349 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-572355] and IPs [192.168.61.73 127.0.0.1 ::1]
I0718 19:23:43.070038 64349 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0718 19:23:43.070101 64349 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0718 19:23:43.070143 64349 kubeadm.go:310] [certs] Generating "sa" key and public key
I0718 19:23:43.070206 64349 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0718 19:23:43.070280 64349 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0718 19:23:43.070363 64349 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0718 19:23:43.070436 64349 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0718 19:23:43.070489 64349 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0718 19:23:43.070583 64349 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0718 19:23:43.070697 64349 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0718 19:23:43.070756 64349 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0718 19:23:43.070822 64349 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0718 19:23:43.072188 64349 out.go:204] - Booting up control plane ...
I0718 19:23:43.072264 64349 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0718 19:23:43.072328 64349 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0718 19:23:43.072398 64349 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0718 19:23:43.072484 64349 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0718 19:23:43.072625 64349 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0718 19:23:43.072670 64349 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0718 19:23:43.072729 64349 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0718 19:23:43.072898 64349 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0718 19:23:43.072964 64349 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0718 19:23:43.073151 64349 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0718 19:23:43.073248 64349 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0718 19:23:43.073396 64349 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0718 19:23:43.073467 64349 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0718 19:23:43.073622 64349 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0718 19:23:43.073693 64349 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0718 19:23:43.073845 64349 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0718 19:23:43.073853 64349 kubeadm.go:310]
I0718 19:23:43.073894 64349 kubeadm.go:310] Unfortunately, an error has occurred:
I0718 19:23:43.073928 64349 kubeadm.go:310] timed out waiting for the condition
I0718 19:23:43.073937 64349 kubeadm.go:310]
I0718 19:23:43.073969 64349 kubeadm.go:310] This error is likely caused by:
I0718 19:23:43.073998 64349 kubeadm.go:310] - The kubelet is not running
I0718 19:23:43.074091 64349 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0718 19:23:43.074097 64349 kubeadm.go:310]
I0718 19:23:43.074204 64349 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0718 19:23:43.074253 64349 kubeadm.go:310] - 'systemctl status kubelet'
I0718 19:23:43.074282 64349 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0718 19:23:43.074288 64349 kubeadm.go:310]
I0718 19:23:43.074398 64349 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0718 19:23:43.074470 64349 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0718 19:23:43.074476 64349 kubeadm.go:310]
I0718 19:23:43.074565 64349 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0718 19:23:43.074644 64349 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0718 19:23:43.074708 64349 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0718 19:23:43.074771 64349 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0718 19:23:43.074786 64349 kubeadm.go:310]
W0718 19:23:43.074908 64349 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-572355] and IPs [192.168.61.73 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-572355] and IPs [192.168.61.73 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-572355] and IPs [192.168.61.73 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-572355] and IPs [192.168.61.73 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0718 19:23:43.074954 64349 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0718 19:23:44.022178 64349 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0718 19:23:44.036844 64349 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0718 19:23:44.046685 64349 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0718 19:23:44.046709 64349 kubeadm.go:157] found existing configuration files:
I0718 19:23:44.046761 64349 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0718 19:23:44.059550 64349 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0718 19:23:44.059608 64349 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0718 19:23:44.072985 64349 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0718 19:23:44.082731 64349 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0718 19:23:44.082789 64349 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0718 19:23:44.092352 64349 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0718 19:23:44.101677 64349 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0718 19:23:44.101768 64349 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0718 19:23:44.110896 64349 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0718 19:23:44.119811 64349 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0718 19:23:44.119861 64349 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0718 19:23:44.128784 64349 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0718 19:23:44.197088 64349 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0718 19:23:44.197173 64349 kubeadm.go:310] [preflight] Running pre-flight checks
I0718 19:23:44.328338 64349 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0718 19:23:44.328465 64349 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0718 19:23:44.328592 64349 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0718 19:23:44.510938 64349 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0718 19:23:44.512902 64349 out.go:204] - Generating certificates and keys ...
I0718 19:23:44.512995 64349 kubeadm.go:310] [certs] Using existing ca certificate authority
I0718 19:23:44.513095 64349 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0718 19:23:44.513233 64349 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0718 19:23:44.513348 64349 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0718 19:23:44.513458 64349 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0718 19:23:44.513534 64349 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0718 19:23:44.513869 64349 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0718 19:23:44.514127 64349 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0718 19:23:44.514585 64349 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0718 19:23:44.514999 64349 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0718 19:23:44.515041 64349 kubeadm.go:310] [certs] Using the existing "sa" key
I0718 19:23:44.515109 64349 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0718 19:23:44.603009 64349 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0718 19:23:44.725908 64349 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0718 19:23:44.924697 64349 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0718 19:23:45.157369 64349 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0718 19:23:45.177260 64349 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0718 19:23:45.177364 64349 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0718 19:23:45.177409 64349 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0718 19:23:45.322446 64349 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0718 19:23:45.324373 64349 out.go:204] - Booting up control plane ...
I0718 19:23:45.324481 64349 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0718 19:23:45.327030 64349 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0718 19:23:45.328363 64349 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0718 19:23:45.330107 64349 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0718 19:23:45.333467 64349 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0718 19:24:25.332503 64349 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0718 19:24:25.332594 64349 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0718 19:24:25.332787 64349 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0718 19:24:30.332822 64349 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0718 19:24:30.333099 64349 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0718 19:24:40.333171 64349 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0718 19:24:40.333397 64349 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0718 19:25:00.333739 64349 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0718 19:25:00.333954 64349 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0718 19:25:40.335299 64349 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0718 19:25:40.335573 64349 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0718 19:25:40.335597 64349 kubeadm.go:310]
I0718 19:25:40.335651 64349 kubeadm.go:310] Unfortunately, an error has occurred:
I0718 19:25:40.335731 64349 kubeadm.go:310] timed out waiting for the condition
I0718 19:25:40.335751 64349 kubeadm.go:310]
I0718 19:25:40.335798 64349 kubeadm.go:310] This error is likely caused by:
I0718 19:25:40.335842 64349 kubeadm.go:310] - The kubelet is not running
I0718 19:25:40.335996 64349 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0718 19:25:40.336009 64349 kubeadm.go:310]
I0718 19:25:40.336123 64349 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0718 19:25:40.336170 64349 kubeadm.go:310] - 'systemctl status kubelet'
I0718 19:25:40.336216 64349 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0718 19:25:40.336228 64349 kubeadm.go:310]
I0718 19:25:40.336353 64349 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0718 19:25:40.336471 64349 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0718 19:25:40.336485 64349 kubeadm.go:310]
I0718 19:25:40.336629 64349 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0718 19:25:40.336745 64349 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0718 19:25:40.336847 64349 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0718 19:25:40.336954 64349 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0718 19:25:40.336970 64349 kubeadm.go:310]
I0718 19:25:40.337611 64349 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0718 19:25:40.337709 64349 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0718 19:25:40.337794 64349 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0718 19:25:40.337866 64349 kubeadm.go:394] duration metric: took 3m54.891533837s to StartCluster
I0718 19:25:40.337931 64349 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0718 19:25:40.337994 64349 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0718 19:25:40.393707 64349 cri.go:89] found id: ""
I0718 19:25:40.393737 64349 logs.go:276] 0 containers: []
W0718 19:25:40.393747 64349 logs.go:278] No container was found matching "kube-apiserver"
I0718 19:25:40.393753 64349 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0718 19:25:40.393813 64349 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0718 19:25:40.427770 64349 cri.go:89] found id: ""
I0718 19:25:40.427813 64349 logs.go:276] 0 containers: []
W0718 19:25:40.427822 64349 logs.go:278] No container was found matching "etcd"
I0718 19:25:40.427828 64349 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0718 19:25:40.427880 64349 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0718 19:25:40.464347 64349 cri.go:89] found id: ""
I0718 19:25:40.464383 64349 logs.go:276] 0 containers: []
W0718 19:25:40.464393 64349 logs.go:278] No container was found matching "coredns"
I0718 19:25:40.464400 64349 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0718 19:25:40.464457 64349 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0718 19:25:40.498309 64349 cri.go:89] found id: ""
I0718 19:25:40.498341 64349 logs.go:276] 0 containers: []
W0718 19:25:40.498361 64349 logs.go:278] No container was found matching "kube-scheduler"
I0718 19:25:40.498370 64349 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0718 19:25:40.498422 64349 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0718 19:25:40.534011 64349 cri.go:89] found id: ""
I0718 19:25:40.534042 64349 logs.go:276] 0 containers: []
W0718 19:25:40.534051 64349 logs.go:278] No container was found matching "kube-proxy"
I0718 19:25:40.534059 64349 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0718 19:25:40.534120 64349 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0718 19:25:40.566211 64349 cri.go:89] found id: ""
I0718 19:25:40.566243 64349 logs.go:276] 0 containers: []
W0718 19:25:40.566254 64349 logs.go:278] No container was found matching "kube-controller-manager"
I0718 19:25:40.566261 64349 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0718 19:25:40.566318 64349 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0718 19:25:40.597677 64349 cri.go:89] found id: ""
I0718 19:25:40.597707 64349 logs.go:276] 0 containers: []
W0718 19:25:40.597716 64349 logs.go:278] No container was found matching "kindnet"
I0718 19:25:40.597728 64349 logs.go:123] Gathering logs for kubelet ...
I0718 19:25:40.597742 64349 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0718 19:25:40.661581 64349 logs.go:123] Gathering logs for dmesg ...
I0718 19:25:40.661618 64349 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0718 19:25:40.681929 64349 logs.go:123] Gathering logs for describe nodes ...
I0718 19:25:40.681957 64349 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0718 19:25:40.814396 64349 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0718 19:25:40.814418 64349 logs.go:123] Gathering logs for CRI-O ...
I0718 19:25:40.814429 64349 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0718 19:25:40.908635 64349 logs.go:123] Gathering logs for container status ...
I0718 19:25:40.908667 64349 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0718 19:25:40.952086 64349 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0718 19:25:40.952126 64349 out.go:239] *
*
W0718 19:25:40.952200 64349 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0718 19:25:40.952227 64349 out.go:239] *
*
W0718 19:25:40.952948 64349 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0718 19:25:40.956603 64349 out.go:177]
W0718 19:25:40.957837 64349 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0718 19:25:40.957878 64349 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0718 19:25:40.957903 64349 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0718 19:25:40.959113 64349 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-572355 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-572355 -n old-k8s-version-572355
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-572355 -n old-k8s-version-572355: exit status 6 (223.765758ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0718 19:25:41.223028 66633 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-572355" does not appear in /home/jenkins/minikube-integration/19297-13059/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-572355" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (280.27s)