=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-425599 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-425599 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m37.926645447s)
-- stdout --
* [old-k8s-version-425599] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19679
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19679-237658/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19679-237658/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-425599" primary control-plane node in "old-k8s-version-425599" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0920 18:55:18.836294 296081 out.go:345] Setting OutFile to fd 1 ...
I0920 18:55:18.836553 296081 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 18:55:18.836563 296081 out.go:358] Setting ErrFile to fd 2...
I0920 18:55:18.836568 296081 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 18:55:18.836760 296081 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19679-237658/.minikube/bin
I0920 18:55:18.837440 296081 out.go:352] Setting JSON to false
I0920 18:55:18.838773 296081 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-9","uptime":9462,"bootTime":1726849057,"procs":303,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0920 18:55:18.838923 296081 start.go:139] virtualization: kvm guest
I0920 18:55:18.841638 296081 out.go:177] * [old-k8s-version-425599] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I0920 18:55:18.843122 296081 out.go:177] - MINIKUBE_LOCATION=19679
I0920 18:55:18.843173 296081 notify.go:220] Checking for updates...
I0920 18:55:18.846095 296081 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0920 18:55:18.847759 296081 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19679-237658/kubeconfig
I0920 18:55:18.849227 296081 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19679-237658/.minikube
I0920 18:55:18.850784 296081 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0920 18:55:18.852367 296081 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0920 18:55:18.854255 296081 config.go:182] Loaded profile config "bridge-793540": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0920 18:55:18.854394 296081 config.go:182] Loaded profile config "enable-default-cni-793540": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0920 18:55:18.854501 296081 config.go:182] Loaded profile config "flannel-793540": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0920 18:55:18.854625 296081 driver.go:394] Setting default libvirt URI to qemu:///system
I0920 18:55:18.895170 296081 out.go:177] * Using the kvm2 driver based on user configuration
I0920 18:55:18.896465 296081 start.go:297] selected driver: kvm2
I0920 18:55:18.896484 296081 start.go:901] validating driver "kvm2" against <nil>
I0920 18:55:18.896509 296081 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0920 18:55:18.897289 296081 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0920 18:55:18.897415 296081 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19679-237658/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0920 18:55:18.914709 296081 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0
I0920 18:55:18.914780 296081 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0920 18:55:18.915151 296081 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0920 18:55:18.915199 296081 cni.go:84] Creating CNI manager for ""
I0920 18:55:18.915271 296081 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0920 18:55:18.915286 296081 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0920 18:55:18.915368 296081 start.go:340] cluster config:
{Name:old-k8s-version-425599 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-425599 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0920 18:55:18.915536 296081 iso.go:125] acquiring lock: {Name:mkf1fd63548b1395dd1434eb4ce769a8a5f4b32e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0920 18:55:18.917597 296081 out.go:177] * Starting "old-k8s-version-425599" primary control-plane node in "old-k8s-version-425599" cluster
I0920 18:55:18.918821 296081 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0920 18:55:18.918886 296081 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19679-237658/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0920 18:55:18.918899 296081 cache.go:56] Caching tarball of preloaded images
I0920 18:55:18.919013 296081 preload.go:172] Found /home/jenkins/minikube-integration/19679-237658/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0920 18:55:18.919028 296081 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0920 18:55:18.919172 296081 profile.go:143] Saving config to /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/config.json ...
I0920 18:55:18.919213 296081 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/config.json: {Name:mkf8afc00fb3d0b674416c7b8a214b174708b830 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:55:18.919406 296081 start.go:360] acquireMachinesLock for old-k8s-version-425599: {Name:mk82bb1df7851a4709a11d77a00ab21beb32e067 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0920 18:55:24.454913 296081 start.go:364] duration metric: took 5.53547385s to acquireMachinesLock for "old-k8s-version-425599"
I0920 18:55:24.454994 296081 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-425599 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19649/minikube-v1.34.0-1726481713-19649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-425599 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0920 18:55:24.455134 296081 start.go:125] createHost starting for "" (driver="kvm2")
I0920 18:55:24.456870 296081 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0920 18:55:24.457181 296081 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0920 18:55:24.457224 296081 main.go:141] libmachine: Launching plugin server for driver kvm2
I0920 18:55:24.475916 296081 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45417
I0920 18:55:24.476445 296081 main.go:141] libmachine: () Calling .GetVersion
I0920 18:55:24.477063 296081 main.go:141] libmachine: Using API Version 1
I0920 18:55:24.477087 296081 main.go:141] libmachine: () Calling .SetConfigRaw
I0920 18:55:24.477459 296081 main.go:141] libmachine: () Calling .GetMachineName
I0920 18:55:24.477686 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetMachineName
I0920 18:55:24.477861 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .DriverName
I0920 18:55:24.478120 296081 start.go:159] libmachine.API.Create for "old-k8s-version-425599" (driver="kvm2")
I0920 18:55:24.478150 296081 client.go:168] LocalClient.Create starting
I0920 18:55:24.478185 296081 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19679-237658/.minikube/certs/ca.pem
I0920 18:55:24.478227 296081 main.go:141] libmachine: Decoding PEM data...
I0920 18:55:24.478247 296081 main.go:141] libmachine: Parsing certificate...
I0920 18:55:24.478327 296081 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19679-237658/.minikube/certs/cert.pem
I0920 18:55:24.478358 296081 main.go:141] libmachine: Decoding PEM data...
I0920 18:55:24.478371 296081 main.go:141] libmachine: Parsing certificate...
I0920 18:55:24.478393 296081 main.go:141] libmachine: Running pre-create checks...
I0920 18:55:24.478406 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .PreCreateCheck
I0920 18:55:24.478809 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetConfigRaw
I0920 18:55:24.479303 296081 main.go:141] libmachine: Creating machine...
I0920 18:55:24.479322 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .Create
I0920 18:55:24.479468 296081 main.go:141] libmachine: (old-k8s-version-425599) Creating KVM machine...
I0920 18:55:24.480956 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found existing default KVM network
I0920 18:55:24.482869 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:24.482688 296179 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0003021b0}
I0920 18:55:24.482898 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | created network xml:
I0920 18:55:24.482908 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | <network>
I0920 18:55:24.482917 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | <name>mk-old-k8s-version-425599</name>
I0920 18:55:24.482924 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | <dns enable='no'/>
I0920 18:55:24.482932 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG |
I0920 18:55:24.482940 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0920 18:55:24.482948 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | <dhcp>
I0920 18:55:24.482955 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0920 18:55:24.482963 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | </dhcp>
I0920 18:55:24.482969 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | </ip>
I0920 18:55:24.482976 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG |
I0920 18:55:24.482983 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | </network>
I0920 18:55:24.482992 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG |
I0920 18:55:24.488492 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | trying to create private KVM network mk-old-k8s-version-425599 192.168.39.0/24...
I0920 18:55:24.569561 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | private KVM network mk-old-k8s-version-425599 192.168.39.0/24 created
I0920 18:55:24.569590 296081 main.go:141] libmachine: (old-k8s-version-425599) Setting up store path in /home/jenkins/minikube-integration/19679-237658/.minikube/machines/old-k8s-version-425599 ...
I0920 18:55:24.569609 296081 main.go:141] libmachine: (old-k8s-version-425599) Building disk image from file:///home/jenkins/minikube-integration/19679-237658/.minikube/cache/iso/amd64/minikube-v1.34.0-1726481713-19649-amd64.iso
I0920 18:55:24.569625 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:24.569560 296179 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19679-237658/.minikube
I0920 18:55:24.569837 296081 main.go:141] libmachine: (old-k8s-version-425599) Downloading /home/jenkins/minikube-integration/19679-237658/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19679-237658/.minikube/cache/iso/amd64/minikube-v1.34.0-1726481713-19649-amd64.iso...
I0920 18:55:24.881260 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:24.881075 296179 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19679-237658/.minikube/machines/old-k8s-version-425599/id_rsa...
I0920 18:55:25.217981 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:25.217805 296179 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19679-237658/.minikube/machines/old-k8s-version-425599/old-k8s-version-425599.rawdisk...
I0920 18:55:25.218082 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | Writing magic tar header
I0920 18:55:25.218331 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | Writing SSH key tar header
I0920 18:55:25.218542 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:25.218453 296179 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19679-237658/.minikube/machines/old-k8s-version-425599 ...
I0920 18:55:25.218633 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19679-237658/.minikube/machines/old-k8s-version-425599
I0920 18:55:25.218744 296081 main.go:141] libmachine: (old-k8s-version-425599) Setting executable bit set on /home/jenkins/minikube-integration/19679-237658/.minikube/machines/old-k8s-version-425599 (perms=drwx------)
I0920 18:55:25.218767 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19679-237658/.minikube/machines
I0920 18:55:25.218779 296081 main.go:141] libmachine: (old-k8s-version-425599) Setting executable bit set on /home/jenkins/minikube-integration/19679-237658/.minikube/machines (perms=drwxr-xr-x)
I0920 18:55:25.218796 296081 main.go:141] libmachine: (old-k8s-version-425599) Setting executable bit set on /home/jenkins/minikube-integration/19679-237658/.minikube (perms=drwxr-xr-x)
I0920 18:55:25.218809 296081 main.go:141] libmachine: (old-k8s-version-425599) Setting executable bit set on /home/jenkins/minikube-integration/19679-237658 (perms=drwxrwxr-x)
I0920 18:55:25.218841 296081 main.go:141] libmachine: (old-k8s-version-425599) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0920 18:55:25.218859 296081 main.go:141] libmachine: (old-k8s-version-425599) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0920 18:55:25.218880 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19679-237658/.minikube
I0920 18:55:25.218896 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19679-237658
I0920 18:55:25.218908 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0920 18:55:25.218920 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | Checking permissions on dir: /home/jenkins
I0920 18:55:25.218929 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | Checking permissions on dir: /home
I0920 18:55:25.218941 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | Skipping /home - not owner
I0920 18:55:25.218950 296081 main.go:141] libmachine: (old-k8s-version-425599) Creating domain...
I0920 18:55:25.220660 296081 main.go:141] libmachine: (old-k8s-version-425599) define libvirt domain using xml:
I0920 18:55:25.220693 296081 main.go:141] libmachine: (old-k8s-version-425599) <domain type='kvm'>
I0920 18:55:25.220705 296081 main.go:141] libmachine: (old-k8s-version-425599) <name>old-k8s-version-425599</name>
I0920 18:55:25.220712 296081 main.go:141] libmachine: (old-k8s-version-425599) <memory unit='MiB'>2200</memory>
I0920 18:55:25.220720 296081 main.go:141] libmachine: (old-k8s-version-425599) <vcpu>2</vcpu>
I0920 18:55:25.220727 296081 main.go:141] libmachine: (old-k8s-version-425599) <features>
I0920 18:55:25.220736 296081 main.go:141] libmachine: (old-k8s-version-425599) <acpi/>
I0920 18:55:25.220743 296081 main.go:141] libmachine: (old-k8s-version-425599) <apic/>
I0920 18:55:25.220757 296081 main.go:141] libmachine: (old-k8s-version-425599) <pae/>
I0920 18:55:25.220767 296081 main.go:141] libmachine: (old-k8s-version-425599)
I0920 18:55:25.220779 296081 main.go:141] libmachine: (old-k8s-version-425599) </features>
I0920 18:55:25.220786 296081 main.go:141] libmachine: (old-k8s-version-425599) <cpu mode='host-passthrough'>
I0920 18:55:25.220793 296081 main.go:141] libmachine: (old-k8s-version-425599)
I0920 18:55:25.220805 296081 main.go:141] libmachine: (old-k8s-version-425599) </cpu>
I0920 18:55:25.220813 296081 main.go:141] libmachine: (old-k8s-version-425599) <os>
I0920 18:55:25.220820 296081 main.go:141] libmachine: (old-k8s-version-425599) <type>hvm</type>
I0920 18:55:25.220829 296081 main.go:141] libmachine: (old-k8s-version-425599) <boot dev='cdrom'/>
I0920 18:55:25.220839 296081 main.go:141] libmachine: (old-k8s-version-425599) <boot dev='hd'/>
I0920 18:55:25.220847 296081 main.go:141] libmachine: (old-k8s-version-425599) <bootmenu enable='no'/>
I0920 18:55:25.220858 296081 main.go:141] libmachine: (old-k8s-version-425599) </os>
I0920 18:55:25.220866 296081 main.go:141] libmachine: (old-k8s-version-425599) <devices>
I0920 18:55:25.220872 296081 main.go:141] libmachine: (old-k8s-version-425599) <disk type='file' device='cdrom'>
I0920 18:55:25.220885 296081 main.go:141] libmachine: (old-k8s-version-425599) <source file='/home/jenkins/minikube-integration/19679-237658/.minikube/machines/old-k8s-version-425599/boot2docker.iso'/>
I0920 18:55:25.220897 296081 main.go:141] libmachine: (old-k8s-version-425599) <target dev='hdc' bus='scsi'/>
I0920 18:55:25.220905 296081 main.go:141] libmachine: (old-k8s-version-425599) <readonly/>
I0920 18:55:25.220912 296081 main.go:141] libmachine: (old-k8s-version-425599) </disk>
I0920 18:55:25.220920 296081 main.go:141] libmachine: (old-k8s-version-425599) <disk type='file' device='disk'>
I0920 18:55:25.220931 296081 main.go:141] libmachine: (old-k8s-version-425599) <driver name='qemu' type='raw' cache='default' io='threads' />
I0920 18:55:25.220960 296081 main.go:141] libmachine: (old-k8s-version-425599) <source file='/home/jenkins/minikube-integration/19679-237658/.minikube/machines/old-k8s-version-425599/old-k8s-version-425599.rawdisk'/>
I0920 18:55:25.220988 296081 main.go:141] libmachine: (old-k8s-version-425599) <target dev='hda' bus='virtio'/>
I0920 18:55:25.221000 296081 main.go:141] libmachine: (old-k8s-version-425599) </disk>
I0920 18:55:25.221006 296081 main.go:141] libmachine: (old-k8s-version-425599) <interface type='network'>
I0920 18:55:25.221014 296081 main.go:141] libmachine: (old-k8s-version-425599) <source network='mk-old-k8s-version-425599'/>
I0920 18:55:25.221022 296081 main.go:141] libmachine: (old-k8s-version-425599) <model type='virtio'/>
I0920 18:55:25.221027 296081 main.go:141] libmachine: (old-k8s-version-425599) </interface>
I0920 18:55:25.221034 296081 main.go:141] libmachine: (old-k8s-version-425599) <interface type='network'>
I0920 18:55:25.221041 296081 main.go:141] libmachine: (old-k8s-version-425599) <source network='default'/>
I0920 18:55:25.221050 296081 main.go:141] libmachine: (old-k8s-version-425599) <model type='virtio'/>
I0920 18:55:25.221058 296081 main.go:141] libmachine: (old-k8s-version-425599) </interface>
I0920 18:55:25.221069 296081 main.go:141] libmachine: (old-k8s-version-425599) <serial type='pty'>
I0920 18:55:25.221079 296081 main.go:141] libmachine: (old-k8s-version-425599) <target port='0'/>
I0920 18:55:25.221089 296081 main.go:141] libmachine: (old-k8s-version-425599) </serial>
I0920 18:55:25.221098 296081 main.go:141] libmachine: (old-k8s-version-425599) <console type='pty'>
I0920 18:55:25.221108 296081 main.go:141] libmachine: (old-k8s-version-425599) <target type='serial' port='0'/>
I0920 18:55:25.221116 296081 main.go:141] libmachine: (old-k8s-version-425599) </console>
I0920 18:55:25.221126 296081 main.go:141] libmachine: (old-k8s-version-425599) <rng model='virtio'>
I0920 18:55:25.221132 296081 main.go:141] libmachine: (old-k8s-version-425599) <backend model='random'>/dev/random</backend>
I0920 18:55:25.221143 296081 main.go:141] libmachine: (old-k8s-version-425599) </rng>
I0920 18:55:25.221149 296081 main.go:141] libmachine: (old-k8s-version-425599)
I0920 18:55:25.221155 296081 main.go:141] libmachine: (old-k8s-version-425599)
I0920 18:55:25.221166 296081 main.go:141] libmachine: (old-k8s-version-425599) </devices>
I0920 18:55:25.221172 296081 main.go:141] libmachine: (old-k8s-version-425599) </domain>
I0920 18:55:25.221186 296081 main.go:141] libmachine: (old-k8s-version-425599)
I0920 18:55:25.226225 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:05:2e:69 in network default
I0920 18:55:25.227033 296081 main.go:141] libmachine: (old-k8s-version-425599) Ensuring networks are active...
I0920 18:55:25.227055 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:25.227958 296081 main.go:141] libmachine: (old-k8s-version-425599) Ensuring network default is active
I0920 18:55:25.228424 296081 main.go:141] libmachine: (old-k8s-version-425599) Ensuring network mk-old-k8s-version-425599 is active
I0920 18:55:25.229113 296081 main.go:141] libmachine: (old-k8s-version-425599) Getting domain xml...
I0920 18:55:25.230146 296081 main.go:141] libmachine: (old-k8s-version-425599) Creating domain...
I0920 18:55:26.943994 296081 main.go:141] libmachine: (old-k8s-version-425599) Waiting to get IP...
I0920 18:55:26.945101 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:26.945748 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | unable to find current IP address of domain old-k8s-version-425599 in network mk-old-k8s-version-425599
I0920 18:55:26.945782 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:26.945710 296179 retry.go:31] will retry after 311.403231ms: waiting for machine to come up
I0920 18:55:27.259648 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:27.260350 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | unable to find current IP address of domain old-k8s-version-425599 in network mk-old-k8s-version-425599
I0920 18:55:27.260373 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:27.260300 296179 retry.go:31] will retry after 385.247321ms: waiting for machine to come up
I0920 18:55:27.647012 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:27.647675 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | unable to find current IP address of domain old-k8s-version-425599 in network mk-old-k8s-version-425599
I0920 18:55:27.647699 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:27.647633 296179 retry.go:31] will retry after 305.281611ms: waiting for machine to come up
I0920 18:55:27.954352 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:27.955014 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | unable to find current IP address of domain old-k8s-version-425599 in network mk-old-k8s-version-425599
I0920 18:55:27.955048 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:27.954954 296179 retry.go:31] will retry after 464.857769ms: waiting for machine to come up
I0920 18:55:28.421606 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:28.422249 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | unable to find current IP address of domain old-k8s-version-425599 in network mk-old-k8s-version-425599
I0920 18:55:28.422284 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:28.422187 296179 retry.go:31] will retry after 721.681786ms: waiting for machine to come up
I0920 18:55:29.145402 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:29.146147 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | unable to find current IP address of domain old-k8s-version-425599 in network mk-old-k8s-version-425599
I0920 18:55:29.146170 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:29.146105 296179 retry.go:31] will retry after 714.02087ms: waiting for machine to come up
I0920 18:55:29.861696 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:29.862344 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | unable to find current IP address of domain old-k8s-version-425599 in network mk-old-k8s-version-425599
I0920 18:55:29.862372 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:29.862293 296179 retry.go:31] will retry after 984.516027ms: waiting for machine to come up
I0920 18:55:30.848232 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:30.848831 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | unable to find current IP address of domain old-k8s-version-425599 in network mk-old-k8s-version-425599
I0920 18:55:30.848857 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:30.848777 296179 retry.go:31] will retry after 1.108407851s: waiting for machine to come up
I0920 18:55:31.959205 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:31.959752 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | unable to find current IP address of domain old-k8s-version-425599 in network mk-old-k8s-version-425599
I0920 18:55:31.959774 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:31.959698 296179 retry.go:31] will retry after 1.536532157s: waiting for machine to come up
I0920 18:55:33.497530 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:33.498183 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | unable to find current IP address of domain old-k8s-version-425599 in network mk-old-k8s-version-425599
I0920 18:55:33.498212 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:33.498128 296179 retry.go:31] will retry after 2.082065103s: waiting for machine to come up
I0920 18:55:35.581599 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:35.582131 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | unable to find current IP address of domain old-k8s-version-425599 in network mk-old-k8s-version-425599
I0920 18:55:35.582153 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:35.582074 296179 retry.go:31] will retry after 2.66141745s: waiting for machine to come up
I0920 18:55:38.245417 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:38.246107 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | unable to find current IP address of domain old-k8s-version-425599 in network mk-old-k8s-version-425599
I0920 18:55:38.246137 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:38.246052 296179 retry.go:31] will retry after 2.563339564s: waiting for machine to come up
I0920 18:55:40.810968 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:40.811542 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | unable to find current IP address of domain old-k8s-version-425599 in network mk-old-k8s-version-425599
I0920 18:55:40.811570 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:40.811495 296179 retry.go:31] will retry after 3.711580937s: waiting for machine to come up
I0920 18:55:44.525096 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:44.525694 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | unable to find current IP address of domain old-k8s-version-425599 in network mk-old-k8s-version-425599
I0920 18:55:44.525720 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | I0920 18:55:44.525656 296179 retry.go:31] will retry after 4.191584874s: waiting for machine to come up
I0920 18:55:48.719456 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:48.720097 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has current primary IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:48.720122 296081 main.go:141] libmachine: (old-k8s-version-425599) Found IP for machine: 192.168.39.53
I0920 18:55:48.720135 296081 main.go:141] libmachine: (old-k8s-version-425599) Reserving static IP address...
I0920 18:55:48.720471 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-425599", mac: "52:54:00:d2:a5:70", ip: "192.168.39.53"} in network mk-old-k8s-version-425599
I0920 18:55:48.809787 296081 main.go:141] libmachine: (old-k8s-version-425599) Reserved static IP address: 192.168.39.53
I0920 18:55:48.809816 296081 main.go:141] libmachine: (old-k8s-version-425599) Waiting for SSH to be available...
I0920 18:55:48.809826 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | Getting to WaitForSSH function...
I0920 18:55:48.813297 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:48.813920 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:minikube Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:48.813954 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:48.814234 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | Using SSH client type: external
I0920 18:55:48.814264 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | Using SSH private key: /home/jenkins/minikube-integration/19679-237658/.minikube/machines/old-k8s-version-425599/id_rsa (-rw-------)
I0920 18:55:48.814298 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.53 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19679-237658/.minikube/machines/old-k8s-version-425599/id_rsa -p 22] /usr/bin/ssh <nil>}
I0920 18:55:48.814315 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | About to run SSH command:
I0920 18:55:48.814419 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | exit 0
I0920 18:55:48.946060 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | SSH cmd err, output: <nil>:
I0920 18:55:48.946325 296081 main.go:141] libmachine: (old-k8s-version-425599) KVM machine creation complete!
I0920 18:55:48.946757 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetConfigRaw
I0920 18:55:48.947311 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .DriverName
I0920 18:55:48.947533 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .DriverName
I0920 18:55:48.947685 296081 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0920 18:55:48.947698 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetState
I0920 18:55:48.949155 296081 main.go:141] libmachine: Detecting operating system of created instance...
I0920 18:55:48.949171 296081 main.go:141] libmachine: Waiting for SSH to be available...
I0920 18:55:48.949177 296081 main.go:141] libmachine: Getting to WaitForSSH function...
I0920 18:55:48.949186 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHHostname
I0920 18:55:48.952109 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:48.952624 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:old-k8s-version-425599 Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:48.952656 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:48.952824 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHPort
I0920 18:55:48.953023 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHKeyPath
I0920 18:55:48.953258 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHKeyPath
I0920 18:55:48.953434 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHUsername
I0920 18:55:48.953689 296081 main.go:141] libmachine: Using SSH client type: native
I0920 18:55:48.953886 296081 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.39.53 22 <nil> <nil>}
I0920 18:55:48.953898 296081 main.go:141] libmachine: About to run SSH command:
exit 0
I0920 18:55:49.061480 296081 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0920 18:55:49.061504 296081 main.go:141] libmachine: Detecting the provisioner...
I0920 18:55:49.061511 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHHostname
I0920 18:55:49.064342 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:49.064785 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:old-k8s-version-425599 Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:49.064808 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:49.064995 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHPort
I0920 18:55:49.065213 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHKeyPath
I0920 18:55:49.065423 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHKeyPath
I0920 18:55:49.065635 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHUsername
I0920 18:55:49.065845 296081 main.go:141] libmachine: Using SSH client type: native
I0920 18:55:49.066040 296081 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.39.53 22 <nil> <nil>}
I0920 18:55:49.066052 296081 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0920 18:55:49.166633 296081 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0920 18:55:49.166756 296081 main.go:141] libmachine: found compatible host: buildroot
I0920 18:55:49.166772 296081 main.go:141] libmachine: Provisioning with buildroot...
I0920 18:55:49.166784 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetMachineName
I0920 18:55:49.167055 296081 buildroot.go:166] provisioning hostname "old-k8s-version-425599"
I0920 18:55:49.167084 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetMachineName
I0920 18:55:49.167307 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHHostname
I0920 18:55:49.170107 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:49.170479 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:old-k8s-version-425599 Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:49.170504 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:49.170685 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHPort
I0920 18:55:49.170904 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHKeyPath
I0920 18:55:49.171047 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHKeyPath
I0920 18:55:49.171184 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHUsername
I0920 18:55:49.171366 296081 main.go:141] libmachine: Using SSH client type: native
I0920 18:55:49.171576 296081 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.39.53 22 <nil> <nil>}
I0920 18:55:49.171593 296081 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-425599 && echo "old-k8s-version-425599" | sudo tee /etc/hostname
I0920 18:55:49.292910 296081 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-425599
I0920 18:55:49.292945 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHHostname
I0920 18:55:49.295708 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:49.296120 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:old-k8s-version-425599 Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:49.296166 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:49.296412 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHPort
I0920 18:55:49.296620 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHKeyPath
I0920 18:55:49.296798 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHKeyPath
I0920 18:55:49.296962 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHUsername
I0920 18:55:49.297176 296081 main.go:141] libmachine: Using SSH client type: native
I0920 18:55:49.297452 296081 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.39.53 22 <nil> <nil>}
I0920 18:55:49.297475 296081 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-425599' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-425599/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-425599' | sudo tee -a /etc/hosts;
fi
fi
I0920 18:55:49.409448 296081 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0920 18:55:49.409487 296081 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19679-237658/.minikube CaCertPath:/home/jenkins/minikube-integration/19679-237658/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19679-237658/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19679-237658/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19679-237658/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19679-237658/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19679-237658/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19679-237658/.minikube}
I0920 18:55:49.409527 296081 buildroot.go:174] setting up certificates
I0920 18:55:49.409543 296081 provision.go:84] configureAuth start
I0920 18:55:49.409561 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetMachineName
I0920 18:55:49.409879 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetIP
I0920 18:55:49.413381 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:49.413808 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:old-k8s-version-425599 Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:49.413847 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:49.414066 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHHostname
I0920 18:55:49.416877 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:49.417320 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:old-k8s-version-425599 Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:49.417349 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:49.417492 296081 provision.go:143] copyHostCerts
I0920 18:55:49.417559 296081 exec_runner.go:144] found /home/jenkins/minikube-integration/19679-237658/.minikube/ca.pem, removing ...
I0920 18:55:49.417577 296081 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19679-237658/.minikube/ca.pem
I0920 18:55:49.417639 296081 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19679-237658/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19679-237658/.minikube/ca.pem (1078 bytes)
I0920 18:55:49.417829 296081 exec_runner.go:144] found /home/jenkins/minikube-integration/19679-237658/.minikube/cert.pem, removing ...
I0920 18:55:49.417844 296081 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19679-237658/.minikube/cert.pem
I0920 18:55:49.417875 296081 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19679-237658/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19679-237658/.minikube/cert.pem (1123 bytes)
I0920 18:55:49.417998 296081 exec_runner.go:144] found /home/jenkins/minikube-integration/19679-237658/.minikube/key.pem, removing ...
I0920 18:55:49.418010 296081 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19679-237658/.minikube/key.pem
I0920 18:55:49.418036 296081 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19679-237658/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19679-237658/.minikube/key.pem (1679 bytes)
I0920 18:55:49.418104 296081 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19679-237658/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19679-237658/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19679-237658/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-425599 san=[127.0.0.1 192.168.39.53 localhost minikube old-k8s-version-425599]
I0920 18:55:49.665681 296081 provision.go:177] copyRemoteCerts
I0920 18:55:49.665748 296081 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0920 18:55:49.665777 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHHostname
I0920 18:55:49.668982 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:49.669433 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:old-k8s-version-425599 Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:49.669461 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:49.669677 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHPort
I0920 18:55:49.669939 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHKeyPath
I0920 18:55:49.670111 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHUsername
I0920 18:55:49.670297 296081 sshutil.go:53] new ssh client: &{IP:192.168.39.53 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19679-237658/.minikube/machines/old-k8s-version-425599/id_rsa Username:docker}
I0920 18:55:49.752844 296081 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-237658/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0920 18:55:49.778591 296081 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-237658/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0920 18:55:49.806412 296081 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-237658/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0920 18:55:49.832230 296081 provision.go:87] duration metric: took 422.667199ms to configureAuth
I0920 18:55:49.832268 296081 buildroot.go:189] setting minikube options for container-runtime
I0920 18:55:49.832440 296081 config.go:182] Loaded profile config "old-k8s-version-425599": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0920 18:55:49.832520 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHHostname
I0920 18:55:49.836089 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:49.836452 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:old-k8s-version-425599 Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:49.836489 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:49.836700 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHPort
I0920 18:55:49.836950 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHKeyPath
I0920 18:55:49.837160 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHKeyPath
I0920 18:55:49.837332 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHUsername
I0920 18:55:49.837514 296081 main.go:141] libmachine: Using SSH client type: native
I0920 18:55:49.837699 296081 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.39.53 22 <nil> <nil>}
I0920 18:55:49.837715 296081 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0920 18:55:50.071576 296081 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0920 18:55:50.071612 296081 main.go:141] libmachine: Checking connection to Docker...
I0920 18:55:50.071623 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetURL
I0920 18:55:50.073064 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | Using libvirt version 6000000
I0920 18:55:50.075356 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:50.075707 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:old-k8s-version-425599 Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:50.075738 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:50.075989 296081 main.go:141] libmachine: Docker is up and running!
I0920 18:55:50.076006 296081 main.go:141] libmachine: Reticulating splines...
I0920 18:55:50.076014 296081 client.go:171] duration metric: took 25.597856053s to LocalClient.Create
I0920 18:55:50.076032 296081 start.go:167] duration metric: took 25.597917658s to libmachine.API.Create "old-k8s-version-425599"
I0920 18:55:50.076042 296081 start.go:293] postStartSetup for "old-k8s-version-425599" (driver="kvm2")
I0920 18:55:50.076051 296081 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0920 18:55:50.076068 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .DriverName
I0920 18:55:50.076303 296081 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0920 18:55:50.076330 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHHostname
I0920 18:55:50.078872 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:50.079250 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:old-k8s-version-425599 Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:50.079282 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:50.079428 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHPort
I0920 18:55:50.079630 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHKeyPath
I0920 18:55:50.079793 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHUsername
I0920 18:55:50.079940 296081 sshutil.go:53] new ssh client: &{IP:192.168.39.53 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19679-237658/.minikube/machines/old-k8s-version-425599/id_rsa Username:docker}
I0920 18:55:50.164124 296081 ssh_runner.go:195] Run: cat /etc/os-release
I0920 18:55:50.168081 296081 info.go:137] Remote host: Buildroot 2023.02.9
I0920 18:55:50.168107 296081 filesync.go:126] Scanning /home/jenkins/minikube-integration/19679-237658/.minikube/addons for local assets ...
I0920 18:55:50.168167 296081 filesync.go:126] Scanning /home/jenkins/minikube-integration/19679-237658/.minikube/files for local assets ...
I0920 18:55:50.168251 296081 filesync.go:149] local asset: /home/jenkins/minikube-integration/19679-237658/.minikube/files/etc/ssl/certs/2448492.pem -> 2448492.pem in /etc/ssl/certs
I0920 18:55:50.168337 296081 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0920 18:55:50.177176 296081 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-237658/.minikube/files/etc/ssl/certs/2448492.pem --> /etc/ssl/certs/2448492.pem (1708 bytes)
I0920 18:55:50.202210 296081 start.go:296] duration metric: took 126.150276ms for postStartSetup
I0920 18:55:50.202263 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetConfigRaw
I0920 18:55:50.202912 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetIP
I0920 18:55:50.205988 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:50.206517 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:old-k8s-version-425599 Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:50.206552 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:50.206913 296081 profile.go:143] Saving config to /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/config.json ...
I0920 18:55:50.207143 296081 start.go:128] duration metric: took 25.751992006s to createHost
I0920 18:55:50.207177 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHHostname
I0920 18:55:50.209726 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:50.210127 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:old-k8s-version-425599 Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:50.210159 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:50.210309 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHPort
I0920 18:55:50.210488 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHKeyPath
I0920 18:55:50.210677 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHKeyPath
I0920 18:55:50.210870 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHUsername
I0920 18:55:50.211027 296081 main.go:141] libmachine: Using SSH client type: native
I0920 18:55:50.211228 296081 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 192.168.39.53 22 <nil> <nil>}
I0920 18:55:50.211244 296081 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0920 18:55:50.314633 296081 main.go:141] libmachine: SSH cmd err, output: <nil>: 1726858550.288142907
I0920 18:55:50.314669 296081 fix.go:216] guest clock: 1726858550.288142907
I0920 18:55:50.314680 296081 fix.go:229] Guest: 2024-09-20 18:55:50.288142907 +0000 UTC Remote: 2024-09-20 18:55:50.207159097 +0000 UTC m=+31.411807018 (delta=80.98381ms)
I0920 18:55:50.314703 296081 fix.go:200] guest clock delta is within tolerance: 80.98381ms
I0920 18:55:50.314709 296081 start.go:83] releasing machines lock for "old-k8s-version-425599", held for 25.859752403s
I0920 18:55:50.314733 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .DriverName
I0920 18:55:50.315043 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetIP
I0920 18:55:50.318268 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:50.318627 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:old-k8s-version-425599 Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:50.318658 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:50.318833 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .DriverName
I0920 18:55:50.319453 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .DriverName
I0920 18:55:50.319665 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .DriverName
I0920 18:55:50.319767 296081 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0920 18:55:50.319834 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHHostname
I0920 18:55:50.319901 296081 ssh_runner.go:195] Run: cat /version.json
I0920 18:55:50.319922 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHHostname
I0920 18:55:50.323088 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:50.323489 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:old-k8s-version-425599 Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:50.323520 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:50.323544 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:50.323787 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHPort
I0920 18:55:50.323979 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHKeyPath
I0920 18:55:50.324001 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:old-k8s-version-425599 Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:50.324023 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:50.324164 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHUsername
I0920 18:55:50.324196 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHPort
I0920 18:55:50.324350 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHKeyPath
I0920 18:55:50.324349 296081 sshutil.go:53] new ssh client: &{IP:192.168.39.53 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19679-237658/.minikube/machines/old-k8s-version-425599/id_rsa Username:docker}
I0920 18:55:50.324520 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetSSHUsername
I0920 18:55:50.324682 296081 sshutil.go:53] new ssh client: &{IP:192.168.39.53 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19679-237658/.minikube/machines/old-k8s-version-425599/id_rsa Username:docker}
I0920 18:55:50.437064 296081 ssh_runner.go:195] Run: systemctl --version
I0920 18:55:50.444731 296081 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0920 18:55:50.612200 296081 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0920 18:55:50.626444 296081 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0920 18:55:50.626538 296081 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0920 18:55:50.645069 296081 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0920 18:55:50.645099 296081 start.go:495] detecting cgroup driver to use...
I0920 18:55:50.645178 296081 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0920 18:55:50.662943 296081 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0920 18:55:50.678612 296081 docker.go:217] disabling cri-docker service (if available) ...
I0920 18:55:50.678686 296081 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0920 18:55:50.693445 296081 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0920 18:55:50.709588 296081 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0920 18:55:50.831999 296081 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0920 18:55:51.022454 296081 docker.go:233] disabling docker service ...
I0920 18:55:51.022541 296081 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0920 18:55:51.039473 296081 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0920 18:55:51.054288 296081 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0920 18:55:51.207909 296081 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0920 18:55:51.355820 296081 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0920 18:55:51.375775 296081 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0920 18:55:51.397179 296081 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0920 18:55:51.397266 296081 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0920 18:55:51.409288 296081 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0920 18:55:51.409372 296081 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0920 18:55:51.421543 296081 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0920 18:55:51.432224 296081 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0920 18:55:51.444358 296081 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0920 18:55:51.457081 296081 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0920 18:55:51.468486 296081 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0920 18:55:51.468561 296081 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0920 18:55:51.485490 296081 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0920 18:55:51.496499 296081 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 18:55:51.612479 296081 ssh_runner.go:195] Run: sudo systemctl restart crio
I0920 18:55:51.718865 296081 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0920 18:55:51.718959 296081 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0920 18:55:51.724509 296081 start.go:563] Will wait 60s for crictl version
I0920 18:55:51.724594 296081 ssh_runner.go:195] Run: which crictl
I0920 18:55:51.729455 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0920 18:55:51.784837 296081 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0920 18:55:51.784958 296081 ssh_runner.go:195] Run: crio --version
I0920 18:55:51.822886 296081 ssh_runner.go:195] Run: crio --version
I0920 18:55:51.861090 296081 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0920 18:55:51.862478 296081 main.go:141] libmachine: (old-k8s-version-425599) Calling .GetIP
I0920 18:55:51.866218 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:51.866677 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d2:a5:70", ip: ""} in network mk-old-k8s-version-425599: {Iface:virbr1 ExpiryTime:2024-09-20 19:55:40 +0000 UTC Type:0 Mac:52:54:00:d2:a5:70 Iaid: IPaddr:192.168.39.53 Prefix:24 Hostname:old-k8s-version-425599 Clientid:01:52:54:00:d2:a5:70}
I0920 18:55:51.866710 296081 main.go:141] libmachine: (old-k8s-version-425599) DBG | domain old-k8s-version-425599 has defined IP address 192.168.39.53 and MAC address 52:54:00:d2:a5:70 in network mk-old-k8s-version-425599
I0920 18:55:51.866991 296081 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0920 18:55:51.871984 296081 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0920 18:55:51.888125 296081 kubeadm.go:883] updating cluster {Name:old-k8s-version-425599 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19649/minikube-v1.34.0-1726481713-19649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-425599 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.53 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0920 18:55:51.888235 296081 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0920 18:55:51.888277 296081 ssh_runner.go:195] Run: sudo crictl images --output json
I0920 18:55:51.924240 296081 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0920 18:55:51.924329 296081 ssh_runner.go:195] Run: which lz4
I0920 18:55:51.928746 296081 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0920 18:55:51.933302 296081 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0920 18:55:51.933350 296081 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-237658/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0920 18:55:53.551927 296081 crio.go:462] duration metric: took 1.623215918s to copy over tarball
I0920 18:55:53.552008 296081 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0920 18:55:56.636769 296081 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.084726595s)
I0920 18:55:56.636804 296081 crio.go:469] duration metric: took 3.084841783s to extract the tarball
I0920 18:55:56.636814 296081 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0920 18:55:56.681811 296081 ssh_runner.go:195] Run: sudo crictl images --output json
I0920 18:55:56.732407 296081 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0920 18:55:56.732435 296081 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0920 18:55:56.732477 296081 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0920 18:55:56.732765 296081 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0920 18:55:56.732868 296081 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0920 18:55:56.732972 296081 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0920 18:55:56.733084 296081 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0920 18:55:56.733193 296081 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0920 18:55:56.733320 296081 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0920 18:55:56.733417 296081 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0920 18:55:56.734762 296081 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0920 18:55:56.734833 296081 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0920 18:55:56.734960 296081 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0920 18:55:56.735017 296081 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0920 18:55:56.735055 296081 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0920 18:55:56.735132 296081 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0920 18:55:56.735225 296081 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0920 18:55:56.735233 296081 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0920 18:55:56.954654 296081 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0920 18:55:56.994982 296081 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0920 18:55:56.995039 296081 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0920 18:55:56.995093 296081 ssh_runner.go:195] Run: which crictl
I0920 18:55:57.001862 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0920 18:55:57.040260 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0920 18:55:57.042421 296081 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0920 18:55:57.052092 296081 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0920 18:55:57.052180 296081 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0920 18:55:57.056807 296081 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0920 18:55:57.058901 296081 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0920 18:55:57.078954 296081 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0920 18:55:57.089044 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0920 18:55:57.201505 296081 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0920 18:55:57.201569 296081 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0920 18:55:57.201632 296081 ssh_runner.go:195] Run: which crictl
I0920 18:55:57.262404 296081 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0920 18:55:57.262444 296081 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0920 18:55:57.262456 296081 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0920 18:55:57.262460 296081 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0920 18:55:57.262479 296081 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0920 18:55:57.262483 296081 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0920 18:55:57.262514 296081 ssh_runner.go:195] Run: which crictl
I0920 18:55:57.262528 296081 ssh_runner.go:195] Run: which crictl
I0920 18:55:57.262546 296081 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0920 18:55:57.262580 296081 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0920 18:55:57.262551 296081 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0920 18:55:57.262601 296081 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0920 18:55:57.262615 296081 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19679-237658/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0920 18:55:57.262631 296081 ssh_runner.go:195] Run: which crictl
I0920 18:55:57.262620 296081 ssh_runner.go:195] Run: which crictl
I0920 18:55:57.262677 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0920 18:55:57.262514 296081 ssh_runner.go:195] Run: which crictl
I0920 18:55:57.275780 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0920 18:55:57.324693 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0920 18:55:57.324722 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0920 18:55:57.324723 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0920 18:55:57.324773 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0920 18:55:57.324788 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0920 18:55:57.324847 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0920 18:55:57.456120 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0920 18:55:57.456140 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0920 18:55:57.456120 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0920 18:55:57.456120 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0920 18:55:57.458793 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0920 18:55:57.458832 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0920 18:55:57.569021 296081 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19679-237658/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0920 18:55:57.586674 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0920 18:55:57.586711 296081 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19679-237658/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0920 18:55:57.586758 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0920 18:55:57.601269 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0920 18:55:57.601374 296081 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0920 18:55:57.671584 296081 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19679-237658/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0920 18:55:57.671647 296081 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19679-237658/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0920 18:55:57.683663 296081 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19679-237658/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0920 18:55:57.695560 296081 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19679-237658/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0920 18:55:57.953265 296081 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0920 18:55:58.101519 296081 cache_images.go:92] duration metric: took 1.36906322s to LoadCachedImages
W0920 18:55:58.101621 296081 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19679-237658/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19679-237658/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0920 18:55:58.101643 296081 kubeadm.go:934] updating node { 192.168.39.53 8443 v1.20.0 crio true true} ...
I0920 18:55:58.101772 296081 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-425599 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.53
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-425599 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0920 18:55:58.101871 296081 ssh_runner.go:195] Run: crio config
I0920 18:55:58.154765 296081 cni.go:84] Creating CNI manager for ""
I0920 18:55:58.154800 296081 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0920 18:55:58.154813 296081 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0920 18:55:58.154842 296081 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.53 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-425599 NodeName:old-k8s-version-425599 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.53"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.53 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0920 18:55:58.154999 296081 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.53
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-425599"
kubeletExtraArgs:
node-ip: 192.168.39.53
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.53"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0920 18:55:58.155062 296081 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0920 18:55:58.165743 296081 binaries.go:44] Found k8s binaries, skipping transfer
I0920 18:55:58.165830 296081 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0920 18:55:58.175823 296081 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0920 18:55:58.197671 296081 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0920 18:55:58.219836 296081 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0920 18:55:58.237674 296081 ssh_runner.go:195] Run: grep 192.168.39.53 control-plane.minikube.internal$ /etc/hosts
I0920 18:55:58.241963 296081 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.53 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0920 18:55:58.254828 296081 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 18:55:58.398268 296081 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0920 18:55:58.419581 296081 certs.go:68] Setting up /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599 for IP: 192.168.39.53
I0920 18:55:58.419649 296081 certs.go:194] generating shared ca certs ...
I0920 18:55:58.419673 296081 certs.go:226] acquiring lock for ca certs: {Name:mk70b63defa4107ec1dc68841b10b0b5e2cd1033 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:55:58.419909 296081 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19679-237658/.minikube/ca.key
I0920 18:55:58.419968 296081 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19679-237658/.minikube/proxy-client-ca.key
I0920 18:55:58.420004 296081 certs.go:256] generating profile certs ...
I0920 18:55:58.420095 296081 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/client.key
I0920 18:55:58.420114 296081 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/client.crt with IP's: []
I0920 18:55:58.516056 296081 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/client.crt ...
I0920 18:55:58.516099 296081 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/client.crt: {Name:mk9e1da856eaf419bf6d9789c9baaf08b42d0165 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:55:58.516322 296081 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/client.key ...
I0920 18:55:58.516344 296081 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/client.key: {Name:mkc0b9cdc694da5c229f099f7e3ccbed481f136f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:55:58.516471 296081 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/apiserver.key.e78cb154
I0920 18:55:58.516497 296081 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/apiserver.crt.e78cb154 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.53]
I0920 18:55:58.860100 296081 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/apiserver.crt.e78cb154 ...
I0920 18:55:58.860140 296081 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/apiserver.crt.e78cb154: {Name:mk0e19baa258bdf2c934e24642835788642b409a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:55:58.860327 296081 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/apiserver.key.e78cb154 ...
I0920 18:55:58.860343 296081 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/apiserver.key.e78cb154: {Name:mk2c1865960ee5824e7236fc30964714beb9bc59 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:55:58.860419 296081 certs.go:381] copying /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/apiserver.crt.e78cb154 -> /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/apiserver.crt
I0920 18:55:58.860492 296081 certs.go:385] copying /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/apiserver.key.e78cb154 -> /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/apiserver.key
I0920 18:55:58.860544 296081 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/proxy-client.key
I0920 18:55:58.860559 296081 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/proxy-client.crt with IP's: []
I0920 18:55:58.997978 296081 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/proxy-client.crt ...
I0920 18:55:58.998011 296081 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/proxy-client.crt: {Name:mkecf9db9be4b52ef3ae54fe09994140c8e8432a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:55:58.998165 296081 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/proxy-client.key ...
I0920 18:55:58.998180 296081 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/proxy-client.key: {Name:mkc6c02551e3bdd6fdb1111b353f25f5169d3bd1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 18:55:58.998352 296081 certs.go:484] found cert: /home/jenkins/minikube-integration/19679-237658/.minikube/certs/244849.pem (1338 bytes)
W0920 18:55:58.998387 296081 certs.go:480] ignoring /home/jenkins/minikube-integration/19679-237658/.minikube/certs/244849_empty.pem, impossibly tiny 0 bytes
I0920 18:55:58.998398 296081 certs.go:484] found cert: /home/jenkins/minikube-integration/19679-237658/.minikube/certs/ca-key.pem (1675 bytes)
I0920 18:55:58.998419 296081 certs.go:484] found cert: /home/jenkins/minikube-integration/19679-237658/.minikube/certs/ca.pem (1078 bytes)
I0920 18:55:58.998443 296081 certs.go:484] found cert: /home/jenkins/minikube-integration/19679-237658/.minikube/certs/cert.pem (1123 bytes)
I0920 18:55:58.998463 296081 certs.go:484] found cert: /home/jenkins/minikube-integration/19679-237658/.minikube/certs/key.pem (1679 bytes)
I0920 18:55:58.998499 296081 certs.go:484] found cert: /home/jenkins/minikube-integration/19679-237658/.minikube/files/etc/ssl/certs/2448492.pem (1708 bytes)
I0920 18:55:58.999071 296081 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-237658/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0920 18:55:59.029979 296081 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-237658/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0920 18:55:59.061638 296081 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-237658/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0920 18:55:59.086685 296081 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-237658/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0920 18:55:59.112904 296081 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0920 18:55:59.139512 296081 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0920 18:55:59.177295 296081 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0920 18:55:59.203534 296081 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-237658/.minikube/profiles/old-k8s-version-425599/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0920 18:55:59.228481 296081 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-237658/.minikube/files/etc/ssl/certs/2448492.pem --> /usr/share/ca-certificates/2448492.pem (1708 bytes)
I0920 18:55:59.253757 296081 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-237658/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0920 18:55:59.279661 296081 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-237658/.minikube/certs/244849.pem --> /usr/share/ca-certificates/244849.pem (1338 bytes)
I0920 18:55:59.303791 296081 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0920 18:55:59.332366 296081 ssh_runner.go:195] Run: openssl version
I0920 18:55:59.341404 296081 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2448492.pem && ln -fs /usr/share/ca-certificates/2448492.pem /etc/ssl/certs/2448492.pem"
I0920 18:55:59.354456 296081 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2448492.pem
I0920 18:55:59.359977 296081 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 20 17:55 /usr/share/ca-certificates/2448492.pem
I0920 18:55:59.360045 296081 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2448492.pem
I0920 18:55:59.366588 296081 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/2448492.pem /etc/ssl/certs/3ec20f2e.0"
I0920 18:55:59.380524 296081 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0920 18:55:59.392472 296081 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0920 18:55:59.397237 296081 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 20 17:36 /usr/share/ca-certificates/minikubeCA.pem
I0920 18:55:59.397309 296081 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0920 18:55:59.405405 296081 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0920 18:55:59.416803 296081 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/244849.pem && ln -fs /usr/share/ca-certificates/244849.pem /etc/ssl/certs/244849.pem"
I0920 18:55:59.427972 296081 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/244849.pem
I0920 18:55:59.432806 296081 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 20 17:55 /usr/share/ca-certificates/244849.pem
I0920 18:55:59.432905 296081 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/244849.pem
I0920 18:55:59.440580 296081 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/244849.pem /etc/ssl/certs/51391683.0"
I0920 18:55:59.451895 296081 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0920 18:55:59.456241 296081 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0920 18:55:59.456307 296081 kubeadm.go:392] StartCluster: {Name:old-k8s-version-425599 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19649/minikube-v1.34.0-1726481713-19649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-425599 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.53 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0920 18:55:59.456406 296081 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0920 18:55:59.456476 296081 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0920 18:55:59.503671 296081 cri.go:89] found id: ""
I0920 18:55:59.503777 296081 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0920 18:55:59.514616 296081 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0920 18:55:59.524544 296081 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0920 18:55:59.535826 296081 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0920 18:55:59.535850 296081 kubeadm.go:157] found existing configuration files:
I0920 18:55:59.535897 296081 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0920 18:55:59.549435 296081 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0920 18:55:59.549510 296081 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0920 18:55:59.562342 296081 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0920 18:55:59.574015 296081 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0920 18:55:59.574086 296081 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0920 18:55:59.583870 296081 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0920 18:55:59.593523 296081 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0920 18:55:59.593602 296081 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0920 18:55:59.604098 296081 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0920 18:55:59.613660 296081 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0920 18:55:59.613741 296081 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0920 18:55:59.623548 296081 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0920 18:55:59.765672 296081 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0920 18:55:59.765753 296081 kubeadm.go:310] [preflight] Running pre-flight checks
I0920 18:55:59.912246 296081 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0920 18:55:59.912392 296081 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0920 18:55:59.912538 296081 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0920 18:56:00.119694 296081 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0920 18:56:00.202205 296081 out.go:235] - Generating certificates and keys ...
I0920 18:56:00.202344 296081 kubeadm.go:310] [certs] Using existing ca certificate authority
I0920 18:56:00.202441 296081 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0920 18:56:00.260756 296081 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0920 18:56:00.435691 296081 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0920 18:56:00.501767 296081 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0920 18:56:00.637011 296081 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0920 18:56:00.753696 296081 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0920 18:56:00.753918 296081 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-425599] and IPs [192.168.39.53 127.0.0.1 ::1]
I0920 18:56:00.867100 296081 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0920 18:56:00.867423 296081 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-425599] and IPs [192.168.39.53 127.0.0.1 ::1]
I0920 18:56:01.046723 296081 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0920 18:56:01.160192 296081 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0920 18:56:01.306076 296081 kubeadm.go:310] [certs] Generating "sa" key and public key
I0920 18:56:01.306426 296081 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0920 18:56:01.659949 296081 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0920 18:56:01.769340 296081 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0920 18:56:02.189025 296081 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0920 18:56:02.905485 296081 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0920 18:56:02.922990 296081 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0920 18:56:02.923972 296081 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0920 18:56:02.924093 296081 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0920 18:56:03.112120 296081 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0920 18:56:03.114236 296081 out.go:235] - Booting up control plane ...
I0920 18:56:03.114391 296081 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0920 18:56:03.130609 296081 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0920 18:56:03.132121 296081 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0920 18:56:03.133227 296081 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0920 18:56:03.139747 296081 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0920 18:56:43.133051 296081 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0920 18:56:43.133207 296081 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:56:43.133445 296081 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:56:48.134333 296081 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:56:48.134671 296081 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:56:58.133743 296081 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:56:58.134068 296081 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:57:18.133625 296081 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:57:18.133857 296081 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:57:58.136059 296081 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:57:58.136514 296081 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:57:58.136553 296081 kubeadm.go:310]
I0920 18:57:58.136641 296081 kubeadm.go:310] Unfortunately, an error has occurred:
I0920 18:57:58.136744 296081 kubeadm.go:310] timed out waiting for the condition
I0920 18:57:58.136768 296081 kubeadm.go:310]
I0920 18:57:58.136852 296081 kubeadm.go:310] This error is likely caused by:
I0920 18:57:58.136939 296081 kubeadm.go:310] - The kubelet is not running
I0920 18:57:58.137173 296081 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0920 18:57:58.137193 296081 kubeadm.go:310]
I0920 18:57:58.137456 296081 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0920 18:57:58.137534 296081 kubeadm.go:310] - 'systemctl status kubelet'
I0920 18:57:58.137606 296081 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0920 18:57:58.137633 296081 kubeadm.go:310]
I0920 18:57:58.137963 296081 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0920 18:57:58.138173 296081 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0920 18:57:58.138185 296081 kubeadm.go:310]
I0920 18:57:58.138393 296081 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0920 18:57:58.138570 296081 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0920 18:57:58.138772 296081 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0920 18:57:58.138949 296081 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0920 18:57:58.138982 296081 kubeadm.go:310]
I0920 18:57:58.139457 296081 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0920 18:57:58.139913 296081 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0920 18:57:58.140010 296081 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0920 18:57:58.140113 296081 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-425599] and IPs [192.168.39.53 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-425599] and IPs [192.168.39.53 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-425599] and IPs [192.168.39.53 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-425599] and IPs [192.168.39.53 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0920 18:57:58.140157 296081 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0920 18:57:59.376638 296081 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.236453573s)
I0920 18:57:59.376721 296081 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0920 18:57:59.390943 296081 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0920 18:57:59.400634 296081 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0920 18:57:59.400658 296081 kubeadm.go:157] found existing configuration files:
I0920 18:57:59.400709 296081 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0920 18:57:59.410548 296081 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0920 18:57:59.410632 296081 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0920 18:57:59.420932 296081 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0920 18:57:59.430821 296081 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0920 18:57:59.430888 296081 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0920 18:57:59.440779 296081 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0920 18:57:59.450168 296081 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0920 18:57:59.450226 296081 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0920 18:57:59.460227 296081 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0920 18:57:59.470037 296081 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0920 18:57:59.470116 296081 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0920 18:57:59.480057 296081 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0920 18:57:59.695473 296081 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0920 18:59:56.052128 296081 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0920 18:59:56.052264 296081 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0920 18:59:56.053955 296081 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0920 18:59:56.054017 296081 kubeadm.go:310] [preflight] Running pre-flight checks
I0920 18:59:56.054080 296081 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0920 18:59:56.054190 296081 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0920 18:59:56.054307 296081 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0920 18:59:56.054404 296081 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0920 18:59:56.057171 296081 out.go:235] - Generating certificates and keys ...
I0920 18:59:56.057275 296081 kubeadm.go:310] [certs] Using existing ca certificate authority
I0920 18:59:56.057346 296081 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0920 18:59:56.057438 296081 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0920 18:59:56.057528 296081 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0920 18:59:56.057627 296081 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0920 18:59:56.057719 296081 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0920 18:59:56.057835 296081 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0920 18:59:56.057955 296081 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0920 18:59:56.058036 296081 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0920 18:59:56.058122 296081 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0920 18:59:56.058181 296081 kubeadm.go:310] [certs] Using the existing "sa" key
I0920 18:59:56.058230 296081 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0920 18:59:56.058300 296081 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0920 18:59:56.058363 296081 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0920 18:59:56.058418 296081 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0920 18:59:56.058465 296081 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0920 18:59:56.058588 296081 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0920 18:59:56.058701 296081 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0920 18:59:56.058736 296081 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0920 18:59:56.058820 296081 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0920 18:59:56.060773 296081 out.go:235] - Booting up control plane ...
I0920 18:59:56.060907 296081 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0920 18:59:56.060993 296081 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0920 18:59:56.061068 296081 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0920 18:59:56.061151 296081 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0920 18:59:56.061296 296081 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0920 18:59:56.061351 296081 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0920 18:59:56.061405 296081 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:59:56.061586 296081 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:59:56.061660 296081 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:59:56.061819 296081 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:59:56.061885 296081 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:59:56.062054 296081 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:59:56.062112 296081 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:59:56.062291 296081 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:59:56.062354 296081 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0920 18:59:56.062509 296081 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0920 18:59:56.062520 296081 kubeadm.go:310]
I0920 18:59:56.062554 296081 kubeadm.go:310] Unfortunately, an error has occurred:
I0920 18:59:56.062592 296081 kubeadm.go:310] timed out waiting for the condition
I0920 18:59:56.062598 296081 kubeadm.go:310]
I0920 18:59:56.062635 296081 kubeadm.go:310] This error is likely caused by:
I0920 18:59:56.062666 296081 kubeadm.go:310] - The kubelet is not running
I0920 18:59:56.062778 296081 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0920 18:59:56.062793 296081 kubeadm.go:310]
I0920 18:59:56.062899 296081 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0920 18:59:56.062952 296081 kubeadm.go:310] - 'systemctl status kubelet'
I0920 18:59:56.063001 296081 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0920 18:59:56.063010 296081 kubeadm.go:310]
I0920 18:59:56.063151 296081 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0920 18:59:56.063248 296081 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0920 18:59:56.063270 296081 kubeadm.go:310]
I0920 18:59:56.063369 296081 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0920 18:59:56.063490 296081 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0920 18:59:56.063608 296081 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0920 18:59:56.063713 296081 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0920 18:59:56.063781 296081 kubeadm.go:394] duration metric: took 3m56.60748231s to StartCluster
I0920 18:59:56.063805 296081 kubeadm.go:310]
I0920 18:59:56.063821 296081 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0920 18:59:56.063873 296081 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0920 18:59:56.112555 296081 cri.go:89] found id: ""
I0920 18:59:56.112589 296081 logs.go:276] 0 containers: []
W0920 18:59:56.112598 296081 logs.go:278] No container was found matching "kube-apiserver"
I0920 18:59:56.112635 296081 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0920 18:59:56.112748 296081 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0920 18:59:56.154637 296081 cri.go:89] found id: ""
I0920 18:59:56.154670 296081 logs.go:276] 0 containers: []
W0920 18:59:56.154678 296081 logs.go:278] No container was found matching "etcd"
I0920 18:59:56.154685 296081 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0920 18:59:56.154750 296081 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0920 18:59:56.194716 296081 cri.go:89] found id: ""
I0920 18:59:56.194748 296081 logs.go:276] 0 containers: []
W0920 18:59:56.194757 296081 logs.go:278] No container was found matching "coredns"
I0920 18:59:56.194763 296081 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0920 18:59:56.194828 296081 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0920 18:59:56.240796 296081 cri.go:89] found id: ""
I0920 18:59:56.240828 296081 logs.go:276] 0 containers: []
W0920 18:59:56.240836 296081 logs.go:278] No container was found matching "kube-scheduler"
I0920 18:59:56.240843 296081 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0920 18:59:56.240895 296081 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0920 18:59:56.273465 296081 cri.go:89] found id: ""
I0920 18:59:56.273495 296081 logs.go:276] 0 containers: []
W0920 18:59:56.273504 296081 logs.go:278] No container was found matching "kube-proxy"
I0920 18:59:56.273511 296081 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0920 18:59:56.273573 296081 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0920 18:59:56.307744 296081 cri.go:89] found id: ""
I0920 18:59:56.307785 296081 logs.go:276] 0 containers: []
W0920 18:59:56.307799 296081 logs.go:278] No container was found matching "kube-controller-manager"
I0920 18:59:56.307809 296081 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0920 18:59:56.307881 296081 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0920 18:59:56.342150 296081 cri.go:89] found id: ""
I0920 18:59:56.342186 296081 logs.go:276] 0 containers: []
W0920 18:59:56.342196 296081 logs.go:278] No container was found matching "kindnet"
I0920 18:59:56.342207 296081 logs.go:123] Gathering logs for container status ...
I0920 18:59:56.342222 296081 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0920 18:59:56.380519 296081 logs.go:123] Gathering logs for kubelet ...
I0920 18:59:56.380554 296081 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0920 18:59:56.429236 296081 logs.go:123] Gathering logs for dmesg ...
I0920 18:59:56.429276 296081 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0920 18:59:56.444964 296081 logs.go:123] Gathering logs for describe nodes ...
I0920 18:59:56.444995 296081 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0920 18:59:56.590875 296081 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0920 18:59:56.590903 296081 logs.go:123] Gathering logs for CRI-O ...
I0920 18:59:56.590915 296081 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
W0920 18:59:56.703798 296081 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0920 18:59:56.703878 296081 out.go:270] *
*
W0920 18:59:56.703938 296081 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0920 18:59:56.703964 296081 out.go:270] *
*
W0920 18:59:56.704808 296081 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0920 18:59:56.708214 296081 out.go:201]
W0920 18:59:56.709689 296081 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0920 18:59:56.709748 296081 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0920 18:59:56.709767 296081 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0920 18:59:56.711543 296081 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-425599 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-425599 -n old-k8s-version-425599
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-425599 -n old-k8s-version-425599: exit status 6 (232.679173ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0920 18:59:56.987780 302693 status.go:451] kubeconfig endpoint: get endpoint: "old-k8s-version-425599" does not appear in /home/jenkins/minikube-integration/19679-237658/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-425599" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (278.22s)