=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-570778 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-570778 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m51.364357219s)
-- stdout --
* [old-k8s-version-570778] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20319
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20319-18835/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20319-18835/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-570778" primary control-plane node in "old-k8s-version-570778" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0127 11:37:40.635455 66618 out.go:345] Setting OutFile to fd 1 ...
I0127 11:37:40.635544 66618 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 11:37:40.635548 66618 out.go:358] Setting ErrFile to fd 2...
I0127 11:37:40.635551 66618 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 11:37:40.635749 66618 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20319-18835/.minikube/bin
I0127 11:37:40.636352 66618 out.go:352] Setting JSON to false
I0127 11:37:40.637261 66618 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-2","uptime":8361,"bootTime":1737969500,"procs":208,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1074-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0127 11:37:40.637349 66618 start.go:139] virtualization: kvm guest
I0127 11:37:40.639724 66618 out.go:177] * [old-k8s-version-570778] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0127 11:37:40.641216 66618 notify.go:220] Checking for updates...
I0127 11:37:40.641297 66618 out.go:177] - MINIKUBE_LOCATION=20319
I0127 11:37:40.642681 66618 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0127 11:37:40.643964 66618 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20319-18835/kubeconfig
I0127 11:37:40.645144 66618 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20319-18835/.minikube
I0127 11:37:40.646343 66618 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0127 11:37:40.647441 66618 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0127 11:37:40.649004 66618 config.go:182] Loaded profile config "NoKubernetes-200407": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v0.0.0
I0127 11:37:40.649126 66618 config.go:182] Loaded profile config "cert-expiration-091274": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0127 11:37:40.649240 66618 config.go:182] Loaded profile config "kubernetes-upgrade-480798": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0127 11:37:40.649380 66618 driver.go:394] Setting default libvirt URI to qemu:///system
I0127 11:37:40.684093 66618 out.go:177] * Using the kvm2 driver based on user configuration
I0127 11:37:40.685303 66618 start.go:297] selected driver: kvm2
I0127 11:37:40.685324 66618 start.go:901] validating driver "kvm2" against <nil>
I0127 11:37:40.685357 66618 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0127 11:37:40.686090 66618 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0127 11:37:40.686168 66618 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20319-18835/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0127 11:37:40.704642 66618 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0127 11:37:40.704697 66618 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0127 11:37:40.704925 66618 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0127 11:37:40.704952 66618 cni.go:84] Creating CNI manager for ""
I0127 11:37:40.704991 66618 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0127 11:37:40.705003 66618 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0127 11:37:40.705047 66618 start.go:340] cluster config:
{Name:old-k8s-version-570778 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-570778 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0127 11:37:40.705151 66618 iso.go:125] acquiring lock: {Name:mk0f883495a3f513e89101f4329551c4a3feacbd Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0127 11:37:40.707748 66618 out.go:177] * Starting "old-k8s-version-570778" primary control-plane node in "old-k8s-version-570778" cluster
I0127 11:37:40.708943 66618 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0127 11:37:40.708974 66618 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20319-18835/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0127 11:37:40.708980 66618 cache.go:56] Caching tarball of preloaded images
I0127 11:37:40.709075 66618 preload.go:172] Found /home/jenkins/minikube-integration/20319-18835/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0127 11:37:40.709088 66618 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0127 11:37:40.709166 66618 profile.go:143] Saving config to /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/config.json ...
I0127 11:37:40.709182 66618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/config.json: {Name:mk23d3a9ca4b9d360303435eee7748f8ce432235 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 11:37:40.709330 66618 start.go:360] acquireMachinesLock for old-k8s-version-570778: {Name:mk0d593693f827996a7db5925a1ca2a419892abf Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0127 11:38:02.980412 66618 start.go:364] duration metric: took 22.271039544s to acquireMachinesLock for "old-k8s-version-570778"
I0127 11:38:02.980476 66618 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-570778 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-570778 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0127 11:38:02.980606 66618 start.go:125] createHost starting for "" (driver="kvm2")
I0127 11:38:02.982428 66618 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0127 11:38:02.982681 66618 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0127 11:38:02.982718 66618 main.go:141] libmachine: Launching plugin server for driver kvm2
I0127 11:38:02.999176 66618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46057
I0127 11:38:02.999599 66618 main.go:141] libmachine: () Calling .GetVersion
I0127 11:38:03.000181 66618 main.go:141] libmachine: Using API Version 1
I0127 11:38:03.000205 66618 main.go:141] libmachine: () Calling .SetConfigRaw
I0127 11:38:03.000545 66618 main.go:141] libmachine: () Calling .GetMachineName
I0127 11:38:03.000738 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetMachineName
I0127 11:38:03.000901 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .DriverName
I0127 11:38:03.001090 66618 start.go:159] libmachine.API.Create for "old-k8s-version-570778" (driver="kvm2")
I0127 11:38:03.001134 66618 client.go:168] LocalClient.Create starting
I0127 11:38:03.001172 66618 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20319-18835/.minikube/certs/ca.pem
I0127 11:38:03.001211 66618 main.go:141] libmachine: Decoding PEM data...
I0127 11:38:03.001231 66618 main.go:141] libmachine: Parsing certificate...
I0127 11:38:03.001298 66618 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20319-18835/.minikube/certs/cert.pem
I0127 11:38:03.001329 66618 main.go:141] libmachine: Decoding PEM data...
I0127 11:38:03.001345 66618 main.go:141] libmachine: Parsing certificate...
I0127 11:38:03.001370 66618 main.go:141] libmachine: Running pre-create checks...
I0127 11:38:03.001381 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .PreCreateCheck
I0127 11:38:03.001776 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetConfigRaw
I0127 11:38:03.002138 66618 main.go:141] libmachine: Creating machine...
I0127 11:38:03.002153 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .Create
I0127 11:38:03.002294 66618 main.go:141] libmachine: (old-k8s-version-570778) creating KVM machine...
I0127 11:38:03.002309 66618 main.go:141] libmachine: (old-k8s-version-570778) creating network...
I0127 11:38:03.003411 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found existing default KVM network
I0127 11:38:03.004429 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:03.004290 66914 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:41:6f:38} reservation:<nil>}
I0127 11:38:03.005625 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:03.005519 66914 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00027c5a0}
I0127 11:38:03.005654 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | created network xml:
I0127 11:38:03.005665 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | <network>
I0127 11:38:03.005678 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | <name>mk-old-k8s-version-570778</name>
I0127 11:38:03.005689 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | <dns enable='no'/>
I0127 11:38:03.005699 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG |
I0127 11:38:03.005711 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0127 11:38:03.005726 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | <dhcp>
I0127 11:38:03.005744 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0127 11:38:03.005754 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | </dhcp>
I0127 11:38:03.005761 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | </ip>
I0127 11:38:03.005768 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG |
I0127 11:38:03.005775 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | </network>
I0127 11:38:03.005784 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG |
I0127 11:38:03.011132 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | trying to create private KVM network mk-old-k8s-version-570778 192.168.50.0/24...
I0127 11:38:03.080809 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | private KVM network mk-old-k8s-version-570778 192.168.50.0/24 created
I0127 11:38:03.080852 66618 main.go:141] libmachine: (old-k8s-version-570778) setting up store path in /home/jenkins/minikube-integration/20319-18835/.minikube/machines/old-k8s-version-570778 ...
I0127 11:38:03.080873 66618 main.go:141] libmachine: (old-k8s-version-570778) building disk image from file:///home/jenkins/minikube-integration/20319-18835/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0127 11:38:03.080937 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:03.080813 66914 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20319-18835/.minikube
I0127 11:38:03.081016 66618 main.go:141] libmachine: (old-k8s-version-570778) Downloading /home/jenkins/minikube-integration/20319-18835/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20319-18835/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0127 11:38:03.329583 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:03.329433 66914 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20319-18835/.minikube/machines/old-k8s-version-570778/id_rsa...
I0127 11:38:03.601085 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:03.600958 66914 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20319-18835/.minikube/machines/old-k8s-version-570778/old-k8s-version-570778.rawdisk...
I0127 11:38:03.601120 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | Writing magic tar header
I0127 11:38:03.601134 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | Writing SSH key tar header
I0127 11:38:03.601146 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:03.601080 66914 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20319-18835/.minikube/machines/old-k8s-version-570778 ...
I0127 11:38:03.601276 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20319-18835/.minikube/machines/old-k8s-version-570778
I0127 11:38:03.601313 66618 main.go:141] libmachine: (old-k8s-version-570778) setting executable bit set on /home/jenkins/minikube-integration/20319-18835/.minikube/machines/old-k8s-version-570778 (perms=drwx------)
I0127 11:38:03.601333 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20319-18835/.minikube/machines
I0127 11:38:03.601348 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20319-18835/.minikube
I0127 11:38:03.601364 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20319-18835
I0127 11:38:03.601379 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0127 11:38:03.601397 66618 main.go:141] libmachine: (old-k8s-version-570778) setting executable bit set on /home/jenkins/minikube-integration/20319-18835/.minikube/machines (perms=drwxr-xr-x)
I0127 11:38:03.601419 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | checking permissions on dir: /home/jenkins
I0127 11:38:03.601433 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | checking permissions on dir: /home
I0127 11:38:03.601443 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | skipping /home - not owner
I0127 11:38:03.601464 66618 main.go:141] libmachine: (old-k8s-version-570778) setting executable bit set on /home/jenkins/minikube-integration/20319-18835/.minikube (perms=drwxr-xr-x)
I0127 11:38:03.601480 66618 main.go:141] libmachine: (old-k8s-version-570778) setting executable bit set on /home/jenkins/minikube-integration/20319-18835 (perms=drwxrwxr-x)
I0127 11:38:03.601493 66618 main.go:141] libmachine: (old-k8s-version-570778) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0127 11:38:03.601504 66618 main.go:141] libmachine: (old-k8s-version-570778) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0127 11:38:03.601517 66618 main.go:141] libmachine: (old-k8s-version-570778) creating domain...
I0127 11:38:03.602592 66618 main.go:141] libmachine: (old-k8s-version-570778) define libvirt domain using xml:
I0127 11:38:03.602615 66618 main.go:141] libmachine: (old-k8s-version-570778) <domain type='kvm'>
I0127 11:38:03.602626 66618 main.go:141] libmachine: (old-k8s-version-570778) <name>old-k8s-version-570778</name>
I0127 11:38:03.602633 66618 main.go:141] libmachine: (old-k8s-version-570778) <memory unit='MiB'>2200</memory>
I0127 11:38:03.602642 66618 main.go:141] libmachine: (old-k8s-version-570778) <vcpu>2</vcpu>
I0127 11:38:03.602655 66618 main.go:141] libmachine: (old-k8s-version-570778) <features>
I0127 11:38:03.602663 66618 main.go:141] libmachine: (old-k8s-version-570778) <acpi/>
I0127 11:38:03.602675 66618 main.go:141] libmachine: (old-k8s-version-570778) <apic/>
I0127 11:38:03.602681 66618 main.go:141] libmachine: (old-k8s-version-570778) <pae/>
I0127 11:38:03.602689 66618 main.go:141] libmachine: (old-k8s-version-570778)
I0127 11:38:03.602695 66618 main.go:141] libmachine: (old-k8s-version-570778) </features>
I0127 11:38:03.602701 66618 main.go:141] libmachine: (old-k8s-version-570778) <cpu mode='host-passthrough'>
I0127 11:38:03.602706 66618 main.go:141] libmachine: (old-k8s-version-570778)
I0127 11:38:03.602715 66618 main.go:141] libmachine: (old-k8s-version-570778) </cpu>
I0127 11:38:03.602720 66618 main.go:141] libmachine: (old-k8s-version-570778) <os>
I0127 11:38:03.602726 66618 main.go:141] libmachine: (old-k8s-version-570778) <type>hvm</type>
I0127 11:38:03.602734 66618 main.go:141] libmachine: (old-k8s-version-570778) <boot dev='cdrom'/>
I0127 11:38:03.602741 66618 main.go:141] libmachine: (old-k8s-version-570778) <boot dev='hd'/>
I0127 11:38:03.602751 66618 main.go:141] libmachine: (old-k8s-version-570778) <bootmenu enable='no'/>
I0127 11:38:03.602762 66618 main.go:141] libmachine: (old-k8s-version-570778) </os>
I0127 11:38:03.602770 66618 main.go:141] libmachine: (old-k8s-version-570778) <devices>
I0127 11:38:03.602779 66618 main.go:141] libmachine: (old-k8s-version-570778) <disk type='file' device='cdrom'>
I0127 11:38:03.602794 66618 main.go:141] libmachine: (old-k8s-version-570778) <source file='/home/jenkins/minikube-integration/20319-18835/.minikube/machines/old-k8s-version-570778/boot2docker.iso'/>
I0127 11:38:03.602805 66618 main.go:141] libmachine: (old-k8s-version-570778) <target dev='hdc' bus='scsi'/>
I0127 11:38:03.602839 66618 main.go:141] libmachine: (old-k8s-version-570778) <readonly/>
I0127 11:38:03.602869 66618 main.go:141] libmachine: (old-k8s-version-570778) </disk>
I0127 11:38:03.602881 66618 main.go:141] libmachine: (old-k8s-version-570778) <disk type='file' device='disk'>
I0127 11:38:03.602905 66618 main.go:141] libmachine: (old-k8s-version-570778) <driver name='qemu' type='raw' cache='default' io='threads' />
I0127 11:38:03.602946 66618 main.go:141] libmachine: (old-k8s-version-570778) <source file='/home/jenkins/minikube-integration/20319-18835/.minikube/machines/old-k8s-version-570778/old-k8s-version-570778.rawdisk'/>
I0127 11:38:03.602972 66618 main.go:141] libmachine: (old-k8s-version-570778) <target dev='hda' bus='virtio'/>
I0127 11:38:03.602987 66618 main.go:141] libmachine: (old-k8s-version-570778) </disk>
I0127 11:38:03.602997 66618 main.go:141] libmachine: (old-k8s-version-570778) <interface type='network'>
I0127 11:38:03.603012 66618 main.go:141] libmachine: (old-k8s-version-570778) <source network='mk-old-k8s-version-570778'/>
I0127 11:38:03.603023 66618 main.go:141] libmachine: (old-k8s-version-570778) <model type='virtio'/>
I0127 11:38:03.603036 66618 main.go:141] libmachine: (old-k8s-version-570778) </interface>
I0127 11:38:03.603048 66618 main.go:141] libmachine: (old-k8s-version-570778) <interface type='network'>
I0127 11:38:03.603059 66618 main.go:141] libmachine: (old-k8s-version-570778) <source network='default'/>
I0127 11:38:03.603072 66618 main.go:141] libmachine: (old-k8s-version-570778) <model type='virtio'/>
I0127 11:38:03.603082 66618 main.go:141] libmachine: (old-k8s-version-570778) </interface>
I0127 11:38:03.603092 66618 main.go:141] libmachine: (old-k8s-version-570778) <serial type='pty'>
I0127 11:38:03.603103 66618 main.go:141] libmachine: (old-k8s-version-570778) <target port='0'/>
I0127 11:38:03.603113 66618 main.go:141] libmachine: (old-k8s-version-570778) </serial>
I0127 11:38:03.603123 66618 main.go:141] libmachine: (old-k8s-version-570778) <console type='pty'>
I0127 11:38:03.603134 66618 main.go:141] libmachine: (old-k8s-version-570778) <target type='serial' port='0'/>
I0127 11:38:03.603150 66618 main.go:141] libmachine: (old-k8s-version-570778) </console>
I0127 11:38:03.603166 66618 main.go:141] libmachine: (old-k8s-version-570778) <rng model='virtio'>
I0127 11:38:03.603180 66618 main.go:141] libmachine: (old-k8s-version-570778) <backend model='random'>/dev/random</backend>
I0127 11:38:03.603192 66618 main.go:141] libmachine: (old-k8s-version-570778) </rng>
I0127 11:38:03.603203 66618 main.go:141] libmachine: (old-k8s-version-570778)
I0127 11:38:03.603211 66618 main.go:141] libmachine: (old-k8s-version-570778)
I0127 11:38:03.603221 66618 main.go:141] libmachine: (old-k8s-version-570778) </devices>
I0127 11:38:03.603235 66618 main.go:141] libmachine: (old-k8s-version-570778) </domain>
I0127 11:38:03.603246 66618 main.go:141] libmachine: (old-k8s-version-570778)
I0127 11:38:03.607776 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:3b:8c:b3 in network default
I0127 11:38:03.608517 66618 main.go:141] libmachine: (old-k8s-version-570778) starting domain...
I0127 11:38:03.608542 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:03.608551 66618 main.go:141] libmachine: (old-k8s-version-570778) ensuring networks are active...
I0127 11:38:03.609250 66618 main.go:141] libmachine: (old-k8s-version-570778) Ensuring network default is active
I0127 11:38:03.609535 66618 main.go:141] libmachine: (old-k8s-version-570778) Ensuring network mk-old-k8s-version-570778 is active
I0127 11:38:03.609983 66618 main.go:141] libmachine: (old-k8s-version-570778) getting domain XML...
I0127 11:38:03.610622 66618 main.go:141] libmachine: (old-k8s-version-570778) creating domain...
I0127 11:38:04.942059 66618 main.go:141] libmachine: (old-k8s-version-570778) waiting for IP...
I0127 11:38:04.943203 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:04.943751 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | unable to find current IP address of domain old-k8s-version-570778 in network mk-old-k8s-version-570778
I0127 11:38:04.943775 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:04.943658 66914 retry.go:31] will retry after 282.561949ms: waiting for domain to come up
I0127 11:38:05.228336 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:05.228870 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | unable to find current IP address of domain old-k8s-version-570778 in network mk-old-k8s-version-570778
I0127 11:38:05.228894 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:05.228849 66914 retry.go:31] will retry after 259.528148ms: waiting for domain to come up
I0127 11:38:05.490594 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:05.491229 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | unable to find current IP address of domain old-k8s-version-570778 in network mk-old-k8s-version-570778
I0127 11:38:05.491268 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:05.491224 66914 retry.go:31] will retry after 466.586665ms: waiting for domain to come up
I0127 11:38:05.959916 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:05.960731 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | unable to find current IP address of domain old-k8s-version-570778 in network mk-old-k8s-version-570778
I0127 11:38:05.960961 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:05.960859 66914 retry.go:31] will retry after 586.984746ms: waiting for domain to come up
I0127 11:38:06.549842 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:06.550346 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | unable to find current IP address of domain old-k8s-version-570778 in network mk-old-k8s-version-570778
I0127 11:38:06.550371 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:06.550314 66914 retry.go:31] will retry after 758.255338ms: waiting for domain to come up
I0127 11:38:07.310054 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:07.310708 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | unable to find current IP address of domain old-k8s-version-570778 in network mk-old-k8s-version-570778
I0127 11:38:07.310756 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:07.310684 66914 retry.go:31] will retry after 576.302639ms: waiting for domain to come up
I0127 11:38:07.888465 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:07.889043 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | unable to find current IP address of domain old-k8s-version-570778 in network mk-old-k8s-version-570778
I0127 11:38:07.889073 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:07.889014 66914 retry.go:31] will retry after 1.184547089s: waiting for domain to come up
I0127 11:38:09.075439 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:09.075976 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | unable to find current IP address of domain old-k8s-version-570778 in network mk-old-k8s-version-570778
I0127 11:38:09.076014 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:09.075960 66914 retry.go:31] will retry after 1.315512805s: waiting for domain to come up
I0127 11:38:10.393279 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:10.393790 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | unable to find current IP address of domain old-k8s-version-570778 in network mk-old-k8s-version-570778
I0127 11:38:10.393821 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:10.393748 66914 retry.go:31] will retry after 1.738470256s: waiting for domain to come up
I0127 11:38:12.134551 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:12.134964 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | unable to find current IP address of domain old-k8s-version-570778 in network mk-old-k8s-version-570778
I0127 11:38:12.135022 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:12.134955 66914 retry.go:31] will retry after 1.452756423s: waiting for domain to come up
I0127 11:38:13.590074 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:13.590626 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | unable to find current IP address of domain old-k8s-version-570778 in network mk-old-k8s-version-570778
I0127 11:38:13.590655 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:13.590588 66914 retry.go:31] will retry after 2.629020333s: waiting for domain to come up
I0127 11:38:16.220958 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:16.221479 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | unable to find current IP address of domain old-k8s-version-570778 in network mk-old-k8s-version-570778
I0127 11:38:16.221511 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:16.221447 66914 retry.go:31] will retry after 3.017388038s: waiting for domain to come up
I0127 11:38:19.240692 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:19.241135 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | unable to find current IP address of domain old-k8s-version-570778 in network mk-old-k8s-version-570778
I0127 11:38:19.241200 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:19.241137 66914 retry.go:31] will retry after 2.998081825s: waiting for domain to come up
I0127 11:38:22.243322 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:22.243822 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | unable to find current IP address of domain old-k8s-version-570778 in network mk-old-k8s-version-570778
I0127 11:38:22.243841 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | I0127 11:38:22.243796 66914 retry.go:31] will retry after 4.355751083s: waiting for domain to come up
I0127 11:38:26.603443 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:26.604085 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has current primary IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:26.604118 66618 main.go:141] libmachine: (old-k8s-version-570778) found domain IP: 192.168.50.193
I0127 11:38:26.604132 66618 main.go:141] libmachine: (old-k8s-version-570778) reserving static IP address...
I0127 11:38:26.604609 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-570778", mac: "52:54:00:8c:78:99", ip: "192.168.50.193"} in network mk-old-k8s-version-570778
I0127 11:38:26.677340 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | Getting to WaitForSSH function...
I0127 11:38:26.677380 66618 main.go:141] libmachine: (old-k8s-version-570778) reserved static IP address 192.168.50.193 for domain old-k8s-version-570778
I0127 11:38:26.677394 66618 main.go:141] libmachine: (old-k8s-version-570778) waiting for SSH...
I0127 11:38:26.680536 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:26.680977 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:minikube Clientid:01:52:54:00:8c:78:99}
I0127 11:38:26.681015 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:26.681089 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | Using SSH client type: external
I0127 11:38:26.681133 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | Using SSH private key: /home/jenkins/minikube-integration/20319-18835/.minikube/machines/old-k8s-version-570778/id_rsa (-rw-------)
I0127 11:38:26.681167 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.193 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20319-18835/.minikube/machines/old-k8s-version-570778/id_rsa -p 22] /usr/bin/ssh <nil>}
I0127 11:38:26.681182 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | About to run SSH command:
I0127 11:38:26.681197 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | exit 0
I0127 11:38:26.807399 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | SSH cmd err, output: <nil>:
I0127 11:38:26.807633 66618 main.go:141] libmachine: (old-k8s-version-570778) KVM machine creation complete
I0127 11:38:26.807968 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetConfigRaw
I0127 11:38:26.808535 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .DriverName
I0127 11:38:26.808735 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .DriverName
I0127 11:38:26.808856 66618 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0127 11:38:26.808871 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetState
I0127 11:38:26.810162 66618 main.go:141] libmachine: Detecting operating system of created instance...
I0127 11:38:26.810176 66618 main.go:141] libmachine: Waiting for SSH to be available...
I0127 11:38:26.810181 66618 main.go:141] libmachine: Getting to WaitForSSH function...
I0127 11:38:26.810186 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHHostname
I0127 11:38:26.812564 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:26.812953 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:old-k8s-version-570778 Clientid:01:52:54:00:8c:78:99}
I0127 11:38:26.812982 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:26.813130 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHPort
I0127 11:38:26.813285 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHKeyPath
I0127 11:38:26.813445 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHKeyPath
I0127 11:38:26.813593 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHUsername
I0127 11:38:26.813719 66618 main.go:141] libmachine: Using SSH client type: native
I0127 11:38:26.813902 66618 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.193 22 <nil> <nil>}
I0127 11:38:26.813915 66618 main.go:141] libmachine: About to run SSH command:
exit 0
I0127 11:38:26.918805 66618 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0127 11:38:26.918826 66618 main.go:141] libmachine: Detecting the provisioner...
I0127 11:38:26.918833 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHHostname
I0127 11:38:26.921474 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:26.921902 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:old-k8s-version-570778 Clientid:01:52:54:00:8c:78:99}
I0127 11:38:26.921922 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:26.922054 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHPort
I0127 11:38:26.922209 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHKeyPath
I0127 11:38:26.922384 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHKeyPath
I0127 11:38:26.922495 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHUsername
I0127 11:38:26.922654 66618 main.go:141] libmachine: Using SSH client type: native
I0127 11:38:26.922819 66618 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.193 22 <nil> <nil>}
I0127 11:38:26.922832 66618 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0127 11:38:27.028364 66618 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0127 11:38:27.028471 66618 main.go:141] libmachine: found compatible host: buildroot
I0127 11:38:27.028487 66618 main.go:141] libmachine: Provisioning with buildroot...
I0127 11:38:27.028503 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetMachineName
I0127 11:38:27.028781 66618 buildroot.go:166] provisioning hostname "old-k8s-version-570778"
I0127 11:38:27.028806 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetMachineName
I0127 11:38:27.029021 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHHostname
I0127 11:38:27.031835 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.032210 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:old-k8s-version-570778 Clientid:01:52:54:00:8c:78:99}
I0127 11:38:27.032238 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.032454 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHPort
I0127 11:38:27.032626 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHKeyPath
I0127 11:38:27.032771 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHKeyPath
I0127 11:38:27.032942 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHUsername
I0127 11:38:27.033139 66618 main.go:141] libmachine: Using SSH client type: native
I0127 11:38:27.033338 66618 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.193 22 <nil> <nil>}
I0127 11:38:27.033351 66618 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-570778 && echo "old-k8s-version-570778" | sudo tee /etc/hostname
I0127 11:38:27.152837 66618 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-570778
I0127 11:38:27.152871 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHHostname
I0127 11:38:27.155982 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.156336 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:old-k8s-version-570778 Clientid:01:52:54:00:8c:78:99}
I0127 11:38:27.156367 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.156545 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHPort
I0127 11:38:27.156758 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHKeyPath
I0127 11:38:27.156944 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHKeyPath
I0127 11:38:27.157106 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHUsername
I0127 11:38:27.157287 66618 main.go:141] libmachine: Using SSH client type: native
I0127 11:38:27.157454 66618 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.193 22 <nil> <nil>}
I0127 11:38:27.157469 66618 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-570778' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-570778/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-570778' | sudo tee -a /etc/hosts;
fi
fi
I0127 11:38:27.271979 66618 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0127 11:38:27.272002 66618 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20319-18835/.minikube CaCertPath:/home/jenkins/minikube-integration/20319-18835/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20319-18835/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20319-18835/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20319-18835/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20319-18835/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20319-18835/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20319-18835/.minikube}
I0127 11:38:27.272037 66618 buildroot.go:174] setting up certificates
I0127 11:38:27.272051 66618 provision.go:84] configureAuth start
I0127 11:38:27.272064 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetMachineName
I0127 11:38:27.272369 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetIP
I0127 11:38:27.275183 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.275565 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:old-k8s-version-570778 Clientid:01:52:54:00:8c:78:99}
I0127 11:38:27.275593 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.275785 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHHostname
I0127 11:38:27.278185 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.278619 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:old-k8s-version-570778 Clientid:01:52:54:00:8c:78:99}
I0127 11:38:27.278648 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.278856 66618 provision.go:143] copyHostCerts
I0127 11:38:27.278935 66618 exec_runner.go:144] found /home/jenkins/minikube-integration/20319-18835/.minikube/ca.pem, removing ...
I0127 11:38:27.278958 66618 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20319-18835/.minikube/ca.pem
I0127 11:38:27.279030 66618 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20319-18835/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20319-18835/.minikube/ca.pem (1078 bytes)
I0127 11:38:27.279149 66618 exec_runner.go:144] found /home/jenkins/minikube-integration/20319-18835/.minikube/cert.pem, removing ...
I0127 11:38:27.279163 66618 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20319-18835/.minikube/cert.pem
I0127 11:38:27.279196 66618 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20319-18835/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20319-18835/.minikube/cert.pem (1123 bytes)
I0127 11:38:27.279280 66618 exec_runner.go:144] found /home/jenkins/minikube-integration/20319-18835/.minikube/key.pem, removing ...
I0127 11:38:27.279290 66618 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20319-18835/.minikube/key.pem
I0127 11:38:27.279323 66618 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20319-18835/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20319-18835/.minikube/key.pem (1675 bytes)
I0127 11:38:27.279421 66618 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20319-18835/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20319-18835/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20319-18835/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-570778 san=[127.0.0.1 192.168.50.193 localhost minikube old-k8s-version-570778]
I0127 11:38:27.361552 66618 provision.go:177] copyRemoteCerts
I0127 11:38:27.361607 66618 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0127 11:38:27.361629 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHHostname
I0127 11:38:27.364404 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.364748 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:old-k8s-version-570778 Clientid:01:52:54:00:8c:78:99}
I0127 11:38:27.364800 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.364937 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHPort
I0127 11:38:27.365125 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHKeyPath
I0127 11:38:27.365280 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHUsername
I0127 11:38:27.365427 66618 sshutil.go:53] new ssh client: &{IP:192.168.50.193 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20319-18835/.minikube/machines/old-k8s-version-570778/id_rsa Username:docker}
I0127 11:38:27.445466 66618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20319-18835/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0127 11:38:27.468244 66618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20319-18835/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0127 11:38:27.490398 66618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20319-18835/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0127 11:38:27.512476 66618 provision.go:87] duration metric: took 240.407655ms to configureAuth
I0127 11:38:27.512505 66618 buildroot.go:189] setting minikube options for container-runtime
I0127 11:38:27.512653 66618 config.go:182] Loaded profile config "old-k8s-version-570778": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0127 11:38:27.512716 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHHostname
I0127 11:38:27.515477 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.515865 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:old-k8s-version-570778 Clientid:01:52:54:00:8c:78:99}
I0127 11:38:27.515894 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.516157 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHPort
I0127 11:38:27.516456 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHKeyPath
I0127 11:38:27.516642 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHKeyPath
I0127 11:38:27.516806 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHUsername
I0127 11:38:27.516988 66618 main.go:141] libmachine: Using SSH client type: native
I0127 11:38:27.517173 66618 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.193 22 <nil> <nil>}
I0127 11:38:27.517194 66618 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0127 11:38:27.748583 66618 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0127 11:38:27.748611 66618 main.go:141] libmachine: Checking connection to Docker...
I0127 11:38:27.748621 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetURL
I0127 11:38:27.749953 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | using libvirt version 6000000
I0127 11:38:27.752412 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.752826 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:old-k8s-version-570778 Clientid:01:52:54:00:8c:78:99}
I0127 11:38:27.752871 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.753059 66618 main.go:141] libmachine: Docker is up and running!
I0127 11:38:27.753070 66618 main.go:141] libmachine: Reticulating splines...
I0127 11:38:27.753076 66618 client.go:171] duration metric: took 24.751932809s to LocalClient.Create
I0127 11:38:27.753100 66618 start.go:167] duration metric: took 24.75201255s to libmachine.API.Create "old-k8s-version-570778"
I0127 11:38:27.753115 66618 start.go:293] postStartSetup for "old-k8s-version-570778" (driver="kvm2")
I0127 11:38:27.753126 66618 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0127 11:38:27.753147 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .DriverName
I0127 11:38:27.753369 66618 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0127 11:38:27.753398 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHHostname
I0127 11:38:27.755625 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.756001 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:old-k8s-version-570778 Clientid:01:52:54:00:8c:78:99}
I0127 11:38:27.756035 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.756141 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHPort
I0127 11:38:27.756352 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHKeyPath
I0127 11:38:27.756545 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHUsername
I0127 11:38:27.756687 66618 sshutil.go:53] new ssh client: &{IP:192.168.50.193 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20319-18835/.minikube/machines/old-k8s-version-570778/id_rsa Username:docker}
I0127 11:38:27.837543 66618 ssh_runner.go:195] Run: cat /etc/os-release
I0127 11:38:27.841456 66618 info.go:137] Remote host: Buildroot 2023.02.9
I0127 11:38:27.841477 66618 filesync.go:126] Scanning /home/jenkins/minikube-integration/20319-18835/.minikube/addons for local assets ...
I0127 11:38:27.841537 66618 filesync.go:126] Scanning /home/jenkins/minikube-integration/20319-18835/.minikube/files for local assets ...
I0127 11:38:27.841606 66618 filesync.go:149] local asset: /home/jenkins/minikube-integration/20319-18835/.minikube/files/etc/ssl/certs/260722.pem -> 260722.pem in /etc/ssl/certs
I0127 11:38:27.841688 66618 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0127 11:38:27.850955 66618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20319-18835/.minikube/files/etc/ssl/certs/260722.pem --> /etc/ssl/certs/260722.pem (1708 bytes)
I0127 11:38:27.873059 66618 start.go:296] duration metric: took 119.931308ms for postStartSetup
I0127 11:38:27.873098 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetConfigRaw
I0127 11:38:27.873702 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetIP
I0127 11:38:27.876375 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.876769 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:old-k8s-version-570778 Clientid:01:52:54:00:8c:78:99}
I0127 11:38:27.876800 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.877047 66618 profile.go:143] Saving config to /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/config.json ...
I0127 11:38:27.877222 66618 start.go:128] duration metric: took 24.896595223s to createHost
I0127 11:38:27.877242 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHHostname
I0127 11:38:27.879776 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.880132 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:old-k8s-version-570778 Clientid:01:52:54:00:8c:78:99}
I0127 11:38:27.880166 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.880298 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHPort
I0127 11:38:27.880476 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHKeyPath
I0127 11:38:27.880653 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHKeyPath
I0127 11:38:27.880811 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHUsername
I0127 11:38:27.880962 66618 main.go:141] libmachine: Using SSH client type: native
I0127 11:38:27.881120 66618 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.50.193 22 <nil> <nil>}
I0127 11:38:27.881135 66618 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0127 11:38:27.987894 66618 main.go:141] libmachine: SSH cmd err, output: <nil>: 1737977907.961458772
I0127 11:38:27.987919 66618 fix.go:216] guest clock: 1737977907.961458772
I0127 11:38:27.987926 66618 fix.go:229] Guest: 2025-01-27 11:38:27.961458772 +0000 UTC Remote: 2025-01-27 11:38:27.877231928 +0000 UTC m=+47.279373079 (delta=84.226844ms)
I0127 11:38:27.987945 66618 fix.go:200] guest clock delta is within tolerance: 84.226844ms
I0127 11:38:27.987950 66618 start.go:83] releasing machines lock for "old-k8s-version-570778", held for 25.007510015s
I0127 11:38:27.987975 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .DriverName
I0127 11:38:27.988259 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetIP
I0127 11:38:27.991077 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.991641 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:old-k8s-version-570778 Clientid:01:52:54:00:8c:78:99}
I0127 11:38:27.991671 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.991896 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .DriverName
I0127 11:38:27.992507 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .DriverName
I0127 11:38:27.992700 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .DriverName
I0127 11:38:27.992793 66618 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0127 11:38:27.992848 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHHostname
I0127 11:38:27.992898 66618 ssh_runner.go:195] Run: cat /version.json
I0127 11:38:27.992922 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHHostname
I0127 11:38:27.995816 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.996162 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.996192 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:old-k8s-version-570778 Clientid:01:52:54:00:8c:78:99}
I0127 11:38:27.996232 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.996364 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHPort
I0127 11:38:27.996538 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHKeyPath
I0127 11:38:27.996677 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHUsername
I0127 11:38:27.996714 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:old-k8s-version-570778 Clientid:01:52:54:00:8c:78:99}
I0127 11:38:27.996740 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:27.996797 66618 sshutil.go:53] new ssh client: &{IP:192.168.50.193 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20319-18835/.minikube/machines/old-k8s-version-570778/id_rsa Username:docker}
I0127 11:38:27.996987 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHPort
I0127 11:38:27.997157 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHKeyPath
I0127 11:38:27.997301 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetSSHUsername
I0127 11:38:27.997418 66618 sshutil.go:53] new ssh client: &{IP:192.168.50.193 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20319-18835/.minikube/machines/old-k8s-version-570778/id_rsa Username:docker}
I0127 11:38:28.081376 66618 ssh_runner.go:195] Run: systemctl --version
I0127 11:38:28.106825 66618 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0127 11:38:28.273866 66618 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0127 11:38:28.279893 66618 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0127 11:38:28.279958 66618 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0127 11:38:28.297893 66618 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0127 11:38:28.297919 66618 start.go:495] detecting cgroup driver to use...
I0127 11:38:28.297975 66618 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0127 11:38:28.315908 66618 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0127 11:38:28.332033 66618 docker.go:217] disabling cri-docker service (if available) ...
I0127 11:38:28.332102 66618 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0127 11:38:28.348215 66618 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0127 11:38:28.363088 66618 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0127 11:38:28.503395 66618 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0127 11:38:28.666095 66618 docker.go:233] disabling docker service ...
I0127 11:38:28.666172 66618 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0127 11:38:28.682182 66618 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0127 11:38:28.694810 66618 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0127 11:38:28.832671 66618 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0127 11:38:28.947733 66618 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0127 11:38:28.961783 66618 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0127 11:38:28.980946 66618 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0127 11:38:28.980999 66618 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0127 11:38:28.991022 66618 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0127 11:38:28.991081 66618 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0127 11:38:29.001179 66618 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0127 11:38:29.014048 66618 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0127 11:38:29.024472 66618 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0127 11:38:29.037585 66618 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0127 11:38:29.046718 66618 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0127 11:38:29.046780 66618 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0127 11:38:29.059631 66618 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0127 11:38:29.071726 66618 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 11:38:29.197344 66618 ssh_runner.go:195] Run: sudo systemctl restart crio
I0127 11:38:29.296950 66618 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0127 11:38:29.297013 66618 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0127 11:38:29.301813 66618 start.go:563] Will wait 60s for crictl version
I0127 11:38:29.301866 66618 ssh_runner.go:195] Run: which crictl
I0127 11:38:29.305664 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0127 11:38:29.341331 66618 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0127 11:38:29.341420 66618 ssh_runner.go:195] Run: crio --version
I0127 11:38:29.368520 66618 ssh_runner.go:195] Run: crio --version
I0127 11:38:29.398777 66618 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0127 11:38:29.400187 66618 main.go:141] libmachine: (old-k8s-version-570778) Calling .GetIP
I0127 11:38:29.403363 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:29.403915 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:8c:78:99", ip: ""} in network mk-old-k8s-version-570778: {Iface:virbr3 ExpiryTime:2025-01-27 12:38:17 +0000 UTC Type:0 Mac:52:54:00:8c:78:99 Iaid: IPaddr:192.168.50.193 Prefix:24 Hostname:old-k8s-version-570778 Clientid:01:52:54:00:8c:78:99}
I0127 11:38:29.403950 66618 main.go:141] libmachine: (old-k8s-version-570778) DBG | domain old-k8s-version-570778 has defined IP address 192.168.50.193 and MAC address 52:54:00:8c:78:99 in network mk-old-k8s-version-570778
I0127 11:38:29.404137 66618 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0127 11:38:29.408206 66618 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 11:38:29.422858 66618 kubeadm.go:883] updating cluster {Name:old-k8s-version-570778 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-570778 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.193 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:
DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0127 11:38:29.422979 66618 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0127 11:38:29.423046 66618 ssh_runner.go:195] Run: sudo crictl images --output json
I0127 11:38:29.462144 66618 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0127 11:38:29.462217 66618 ssh_runner.go:195] Run: which lz4
I0127 11:38:29.466223 66618 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0127 11:38:29.470467 66618 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0127 11:38:29.470491 66618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20319-18835/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0127 11:38:30.909989 66618 crio.go:462] duration metric: took 1.443786337s to copy over tarball
I0127 11:38:30.910082 66618 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0127 11:38:33.520394 66618 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.61027457s)
I0127 11:38:33.520427 66618 crio.go:469] duration metric: took 2.61040072s to extract the tarball
I0127 11:38:33.520437 66618 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0127 11:38:33.563195 66618 ssh_runner.go:195] Run: sudo crictl images --output json
I0127 11:38:33.606972 66618 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0127 11:38:33.606999 66618 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0127 11:38:33.607069 66618 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 11:38:33.607126 66618 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0127 11:38:33.607135 66618 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 11:38:33.607079 66618 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0127 11:38:33.607088 66618 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0127 11:38:33.607119 66618 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 11:38:33.607102 66618 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0127 11:38:33.607532 66618 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0127 11:38:33.608926 66618 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0127 11:38:33.608999 66618 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 11:38:33.609023 66618 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0127 11:38:33.609054 66618 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0127 11:38:33.609086 66618 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 11:38:33.608926 66618 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0127 11:38:33.608930 66618 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 11:38:33.609102 66618 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0127 11:38:33.751683 66618 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0127 11:38:33.754366 66618 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0127 11:38:33.758667 66618 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0127 11:38:33.759696 66618 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0127 11:38:33.760972 66618 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0127 11:38:33.764606 66618 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0127 11:38:33.799803 66618 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0127 11:38:33.886339 66618 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0127 11:38:33.886397 66618 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 11:38:33.886446 66618 ssh_runner.go:195] Run: which crictl
I0127 11:38:33.900852 66618 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0127 11:38:33.900899 66618 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0127 11:38:33.900945 66618 ssh_runner.go:195] Run: which crictl
I0127 11:38:33.912762 66618 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0127 11:38:33.912808 66618 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 11:38:33.912853 66618 ssh_runner.go:195] Run: which crictl
I0127 11:38:33.915439 66618 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0127 11:38:33.915475 66618 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0127 11:38:33.915514 66618 ssh_runner.go:195] Run: which crictl
I0127 11:38:33.915530 66618 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0127 11:38:33.915562 66618 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0127 11:38:33.915574 66618 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0127 11:38:33.915599 66618 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 11:38:33.915623 66618 ssh_runner.go:195] Run: which crictl
I0127 11:38:33.915655 66618 ssh_runner.go:195] Run: which crictl
I0127 11:38:33.938580 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 11:38:33.938620 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 11:38:33.938650 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 11:38:33.938662 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 11:38:33.938675 66618 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0127 11:38:33.938689 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 11:38:33.938693 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 11:38:33.938712 66618 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0127 11:38:33.938743 66618 ssh_runner.go:195] Run: which crictl
I0127 11:38:34.061532 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 11:38:34.069502 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 11:38:34.069599 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 11:38:34.069689 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 11:38:34.069772 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 11:38:34.069885 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 11:38:34.089088 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 11:38:34.169639 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 11:38:34.206483 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 11:38:34.206543 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 11:38:34.229629 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 11:38:34.229698 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 11:38:34.229655 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 11:38:34.268119 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 11:38:34.298928 66618 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20319-18835/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0127 11:38:34.326869 66618 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20319-18835/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0127 11:38:34.326952 66618 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 11:38:34.357964 66618 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20319-18835/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0127 11:38:34.364726 66618 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20319-18835/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0127 11:38:34.364747 66618 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20319-18835/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0127 11:38:34.384193 66618 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20319-18835/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0127 11:38:34.392144 66618 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20319-18835/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0127 11:38:34.634933 66618 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0127 11:38:34.781918 66618 cache_images.go:92] duration metric: took 1.174898632s to LoadCachedImages
W0127 11:38:34.782021 66618 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20319-18835/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20319-18835/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
I0127 11:38:34.782036 66618 kubeadm.go:934] updating node { 192.168.50.193 8443 v1.20.0 crio true true} ...
I0127 11:38:34.782171 66618 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-570778 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.193
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-570778 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0127 11:38:34.782256 66618 ssh_runner.go:195] Run: crio config
I0127 11:38:34.827713 66618 cni.go:84] Creating CNI manager for ""
I0127 11:38:34.827741 66618 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0127 11:38:34.827753 66618 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0127 11:38:34.827779 66618 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.193 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-570778 NodeName:old-k8s-version-570778 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.193"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.193 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0127 11:38:34.827946 66618 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.193
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-570778"
kubeletExtraArgs:
node-ip: 192.168.50.193
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.193"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0127 11:38:34.828025 66618 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0127 11:38:34.844382 66618 binaries.go:44] Found k8s binaries, skipping transfer
I0127 11:38:34.844454 66618 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0127 11:38:34.853728 66618 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0127 11:38:34.871092 66618 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0127 11:38:34.888038 66618 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0127 11:38:34.903849 66618 ssh_runner.go:195] Run: grep 192.168.50.193 control-plane.minikube.internal$ /etc/hosts
I0127 11:38:34.908402 66618 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.193 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 11:38:34.920447 66618 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 11:38:35.039786 66618 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0127 11:38:35.058051 66618 certs.go:68] Setting up /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778 for IP: 192.168.50.193
I0127 11:38:35.058079 66618 certs.go:194] generating shared ca certs ...
I0127 11:38:35.058101 66618 certs.go:226] acquiring lock for ca certs: {Name:mk28a488136a8ad706c6def5e8c32b522421b34e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 11:38:35.058276 66618 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20319-18835/.minikube/ca.key
I0127 11:38:35.058391 66618 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20319-18835/.minikube/proxy-client-ca.key
I0127 11:38:35.058408 66618 certs.go:256] generating profile certs ...
I0127 11:38:35.058476 66618 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/client.key
I0127 11:38:35.058500 66618 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/client.crt with IP's: []
I0127 11:38:35.199751 66618 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/client.crt ...
I0127 11:38:35.199789 66618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/client.crt: {Name:mk582486663219c6dfe142f6373fc6f9f80df2f5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 11:38:35.199987 66618 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/client.key ...
I0127 11:38:35.200007 66618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/client.key: {Name:mk557c3c6758c0b5a5909995dce5456716801fc4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 11:38:35.200088 66618 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/apiserver.key.1541225f
I0127 11:38:35.200104 66618 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/apiserver.crt.1541225f with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.193]
I0127 11:38:35.393500 66618 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/apiserver.crt.1541225f ...
I0127 11:38:35.393531 66618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/apiserver.crt.1541225f: {Name:mk511c7c79f894854fad379c0ec4a9f118a9809b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 11:38:35.393722 66618 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/apiserver.key.1541225f ...
I0127 11:38:35.393746 66618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/apiserver.key.1541225f: {Name:mkc4fd91ba23f77ea1995240c452c3646cf53b39 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 11:38:35.393865 66618 certs.go:381] copying /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/apiserver.crt.1541225f -> /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/apiserver.crt
I0127 11:38:35.393952 66618 certs.go:385] copying /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/apiserver.key.1541225f -> /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/apiserver.key
I0127 11:38:35.394002 66618 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/proxy-client.key
I0127 11:38:35.394016 66618 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/proxy-client.crt with IP's: []
I0127 11:38:35.511380 66618 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/proxy-client.crt ...
I0127 11:38:35.511424 66618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/proxy-client.crt: {Name:mkb4534ab689c2a3bc608cd3ab7fcc969705f547 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 11:38:35.511675 66618 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/proxy-client.key ...
I0127 11:38:35.511696 66618 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/proxy-client.key: {Name:mk31ffc61f00e1fd4e2c63eda0c649679c40002c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 11:38:35.511949 66618 certs.go:484] found cert: /home/jenkins/minikube-integration/20319-18835/.minikube/certs/26072.pem (1338 bytes)
W0127 11:38:35.512003 66618 certs.go:480] ignoring /home/jenkins/minikube-integration/20319-18835/.minikube/certs/26072_empty.pem, impossibly tiny 0 bytes
I0127 11:38:35.512015 66618 certs.go:484] found cert: /home/jenkins/minikube-integration/20319-18835/.minikube/certs/ca-key.pem (1675 bytes)
I0127 11:38:35.512049 66618 certs.go:484] found cert: /home/jenkins/minikube-integration/20319-18835/.minikube/certs/ca.pem (1078 bytes)
I0127 11:38:35.512084 66618 certs.go:484] found cert: /home/jenkins/minikube-integration/20319-18835/.minikube/certs/cert.pem (1123 bytes)
I0127 11:38:35.512116 66618 certs.go:484] found cert: /home/jenkins/minikube-integration/20319-18835/.minikube/certs/key.pem (1675 bytes)
I0127 11:38:35.512170 66618 certs.go:484] found cert: /home/jenkins/minikube-integration/20319-18835/.minikube/files/etc/ssl/certs/260722.pem (1708 bytes)
I0127 11:38:35.512849 66618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20319-18835/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0127 11:38:35.539212 66618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20319-18835/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0127 11:38:35.563506 66618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20319-18835/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0127 11:38:35.588853 66618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20319-18835/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0127 11:38:35.612888 66618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0127 11:38:35.636882 66618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0127 11:38:35.659527 66618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0127 11:38:35.683639 66618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20319-18835/.minikube/profiles/old-k8s-version-570778/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0127 11:38:35.708931 66618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20319-18835/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0127 11:38:35.732514 66618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20319-18835/.minikube/certs/26072.pem --> /usr/share/ca-certificates/26072.pem (1338 bytes)
I0127 11:38:35.758244 66618 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20319-18835/.minikube/files/etc/ssl/certs/260722.pem --> /usr/share/ca-certificates/260722.pem (1708 bytes)
I0127 11:38:35.780662 66618 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0127 11:38:35.796643 66618 ssh_runner.go:195] Run: openssl version
I0127 11:38:35.802552 66618 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0127 11:38:35.813513 66618 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0127 11:38:35.818379 66618 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jan 27 10:32 /usr/share/ca-certificates/minikubeCA.pem
I0127 11:38:35.818447 66618 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0127 11:38:35.823987 66618 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0127 11:38:35.835489 66618 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/26072.pem && ln -fs /usr/share/ca-certificates/26072.pem /etc/ssl/certs/26072.pem"
I0127 11:38:35.846279 66618 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/26072.pem
I0127 11:38:35.850773 66618 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jan 27 10:40 /usr/share/ca-certificates/26072.pem
I0127 11:38:35.850817 66618 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/26072.pem
I0127 11:38:35.856458 66618 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/26072.pem /etc/ssl/certs/51391683.0"
I0127 11:38:35.869792 66618 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/260722.pem && ln -fs /usr/share/ca-certificates/260722.pem /etc/ssl/certs/260722.pem"
I0127 11:38:35.896310 66618 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/260722.pem
I0127 11:38:35.901320 66618 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jan 27 10:40 /usr/share/ca-certificates/260722.pem
I0127 11:38:35.901421 66618 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/260722.pem
I0127 11:38:35.909897 66618 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/260722.pem /etc/ssl/certs/3ec20f2e.0"
I0127 11:38:35.925504 66618 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0127 11:38:35.933005 66618 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0127 11:38:35.933061 66618 kubeadm.go:392] StartCluster: {Name:old-k8s-version-570778 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-570778 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.193 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Dis
ableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0127 11:38:35.933124 66618 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0127 11:38:35.933168 66618 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0127 11:38:35.980100 66618 cri.go:89] found id: ""
I0127 11:38:35.980176 66618 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0127 11:38:35.990316 66618 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0127 11:38:35.999369 66618 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0127 11:38:36.009325 66618 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0127 11:38:36.009346 66618 kubeadm.go:157] found existing configuration files:
I0127 11:38:36.009395 66618 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0127 11:38:36.018364 66618 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0127 11:38:36.018437 66618 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0127 11:38:36.027497 66618 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0127 11:38:36.036100 66618 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0127 11:38:36.036159 66618 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0127 11:38:36.045082 66618 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0127 11:38:36.053624 66618 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0127 11:38:36.053666 66618 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0127 11:38:36.062403 66618 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0127 11:38:36.070641 66618 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0127 11:38:36.070694 66618 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0127 11:38:36.079388 66618 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0127 11:38:36.340239 66618 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0127 11:40:34.126951 66618 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0127 11:40:34.127038 66618 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0127 11:40:34.128792 66618 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0127 11:40:34.128867 66618 kubeadm.go:310] [preflight] Running pre-flight checks
I0127 11:40:34.128956 66618 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0127 11:40:34.129069 66618 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0127 11:40:34.129193 66618 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0127 11:40:34.129267 66618 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0127 11:40:34.130937 66618 out.go:235] - Generating certificates and keys ...
I0127 11:40:34.131030 66618 kubeadm.go:310] [certs] Using existing ca certificate authority
I0127 11:40:34.131113 66618 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0127 11:40:34.131228 66618 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0127 11:40:34.131326 66618 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0127 11:40:34.131413 66618 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0127 11:40:34.131485 66618 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0127 11:40:34.131562 66618 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0127 11:40:34.131744 66618 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-570778] and IPs [192.168.50.193 127.0.0.1 ::1]
I0127 11:40:34.131821 66618 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0127 11:40:34.131978 66618 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-570778] and IPs [192.168.50.193 127.0.0.1 ::1]
I0127 11:40:34.132050 66618 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0127 11:40:34.132132 66618 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0127 11:40:34.132223 66618 kubeadm.go:310] [certs] Generating "sa" key and public key
I0127 11:40:34.132313 66618 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0127 11:40:34.132387 66618 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0127 11:40:34.132467 66618 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0127 11:40:34.132575 66618 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0127 11:40:34.132679 66618 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0127 11:40:34.132797 66618 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0127 11:40:34.132895 66618 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0127 11:40:34.132938 66618 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0127 11:40:34.133037 66618 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0127 11:40:34.134535 66618 out.go:235] - Booting up control plane ...
I0127 11:40:34.134662 66618 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0127 11:40:34.134782 66618 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0127 11:40:34.134941 66618 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0127 11:40:34.135028 66618 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0127 11:40:34.135149 66618 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0127 11:40:34.135189 66618 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0127 11:40:34.135256 66618 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 11:40:34.135551 66618 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 11:40:34.135704 66618 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 11:40:34.135951 66618 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 11:40:34.136077 66618 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 11:40:34.136323 66618 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 11:40:34.136417 66618 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 11:40:34.136683 66618 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 11:40:34.136816 66618 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 11:40:34.137088 66618 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 11:40:34.137108 66618 kubeadm.go:310]
I0127 11:40:34.137168 66618 kubeadm.go:310] Unfortunately, an error has occurred:
I0127 11:40:34.137241 66618 kubeadm.go:310] timed out waiting for the condition
I0127 11:40:34.137261 66618 kubeadm.go:310]
I0127 11:40:34.137313 66618 kubeadm.go:310] This error is likely caused by:
I0127 11:40:34.137355 66618 kubeadm.go:310] - The kubelet is not running
I0127 11:40:34.137518 66618 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0127 11:40:34.137530 66618 kubeadm.go:310]
I0127 11:40:34.137659 66618 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0127 11:40:34.137714 66618 kubeadm.go:310] - 'systemctl status kubelet'
I0127 11:40:34.137769 66618 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0127 11:40:34.137782 66618 kubeadm.go:310]
I0127 11:40:34.137935 66618 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0127 11:40:34.138043 66618 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0127 11:40:34.138054 66618 kubeadm.go:310]
I0127 11:40:34.138180 66618 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0127 11:40:34.138321 66618 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0127 11:40:34.138440 66618 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0127 11:40:34.138586 66618 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0127 11:40:34.138637 66618 kubeadm.go:310]
W0127 11:40:34.138745 66618 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-570778] and IPs [192.168.50.193 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-570778] and IPs [192.168.50.193 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-570778] and IPs [192.168.50.193 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-570778] and IPs [192.168.50.193 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0127 11:40:34.138788 66618 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0127 11:40:34.607135 66618 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0127 11:40:34.626917 66618 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0127 11:40:34.639727 66618 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0127 11:40:34.639753 66618 kubeadm.go:157] found existing configuration files:
I0127 11:40:34.639806 66618 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0127 11:40:34.651101 66618 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0127 11:40:34.651183 66618 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0127 11:40:34.660512 66618 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0127 11:40:34.668791 66618 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0127 11:40:34.668857 66618 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0127 11:40:34.677529 66618 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0127 11:40:34.687243 66618 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0127 11:40:34.687323 66618 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0127 11:40:34.695916 66618 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0127 11:40:34.704175 66618 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0127 11:40:34.704233 66618 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0127 11:40:34.713056 66618 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0127 11:40:34.785812 66618 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0127 11:40:34.785916 66618 kubeadm.go:310] [preflight] Running pre-flight checks
I0127 11:40:34.936075 66618 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0127 11:40:34.936222 66618 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0127 11:40:34.936368 66618 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0127 11:40:35.127190 66618 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0127 11:40:35.216365 66618 out.go:235] - Generating certificates and keys ...
I0127 11:40:35.216492 66618 kubeadm.go:310] [certs] Using existing ca certificate authority
I0127 11:40:35.216572 66618 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0127 11:40:35.216665 66618 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0127 11:40:35.216752 66618 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0127 11:40:35.216890 66618 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0127 11:40:35.216973 66618 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0127 11:40:35.217053 66618 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0127 11:40:35.217147 66618 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0127 11:40:35.217249 66618 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0127 11:40:35.217346 66618 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0127 11:40:35.217397 66618 kubeadm.go:310] [certs] Using the existing "sa" key
I0127 11:40:35.217473 66618 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0127 11:40:35.459110 66618 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0127 11:40:35.866498 66618 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0127 11:40:35.943163 66618 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0127 11:40:36.155548 66618 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0127 11:40:36.177145 66618 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0127 11:40:36.177913 66618 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0127 11:40:36.177959 66618 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0127 11:40:36.311407 66618 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0127 11:40:36.425687 66618 out.go:235] - Booting up control plane ...
I0127 11:40:36.425839 66618 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0127 11:40:36.425963 66618 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0127 11:40:36.426038 66618 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0127 11:40:36.426105 66618 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0127 11:40:36.426243 66618 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0127 11:41:16.334099 66618 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0127 11:41:16.334196 66618 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 11:41:16.334401 66618 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 11:41:21.334869 66618 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 11:41:21.335073 66618 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 11:41:31.335733 66618 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 11:41:31.335910 66618 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 11:41:51.334931 66618 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 11:41:51.335197 66618 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 11:42:31.334411 66618 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 11:42:31.334628 66618 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 11:42:31.334639 66618 kubeadm.go:310]
I0127 11:42:31.334684 66618 kubeadm.go:310] Unfortunately, an error has occurred:
I0127 11:42:31.334766 66618 kubeadm.go:310] timed out waiting for the condition
I0127 11:42:31.334797 66618 kubeadm.go:310]
I0127 11:42:31.334851 66618 kubeadm.go:310] This error is likely caused by:
I0127 11:42:31.334906 66618 kubeadm.go:310] - The kubelet is not running
I0127 11:42:31.335068 66618 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0127 11:42:31.335083 66618 kubeadm.go:310]
I0127 11:42:31.335212 66618 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0127 11:42:31.335266 66618 kubeadm.go:310] - 'systemctl status kubelet'
I0127 11:42:31.335306 66618 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0127 11:42:31.335319 66618 kubeadm.go:310]
I0127 11:42:31.335459 66618 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0127 11:42:31.335598 66618 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0127 11:42:31.335626 66618 kubeadm.go:310]
I0127 11:42:31.335790 66618 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0127 11:42:31.335916 66618 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0127 11:42:31.336034 66618 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0127 11:42:31.336157 66618 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0127 11:42:31.336169 66618 kubeadm.go:310]
I0127 11:42:31.336532 66618 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0127 11:42:31.336654 66618 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0127 11:42:31.336744 66618 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0127 11:42:31.336811 66618 kubeadm.go:394] duration metric: took 3m55.403751579s to StartCluster
I0127 11:42:31.336864 66618 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0127 11:42:31.336915 66618 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0127 11:42:31.371730 66618 cri.go:89] found id: ""
I0127 11:42:31.371749 66618 logs.go:282] 0 containers: []
W0127 11:42:31.371757 66618 logs.go:284] No container was found matching "kube-apiserver"
I0127 11:42:31.371765 66618 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0127 11:42:31.371819 66618 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0127 11:42:31.412650 66618 cri.go:89] found id: ""
I0127 11:42:31.412676 66618 logs.go:282] 0 containers: []
W0127 11:42:31.412695 66618 logs.go:284] No container was found matching "etcd"
I0127 11:42:31.412702 66618 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0127 11:42:31.412758 66618 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0127 11:42:31.452358 66618 cri.go:89] found id: ""
I0127 11:42:31.452381 66618 logs.go:282] 0 containers: []
W0127 11:42:31.452402 66618 logs.go:284] No container was found matching "coredns"
I0127 11:42:31.452409 66618 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0127 11:42:31.452462 66618 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0127 11:42:31.487405 66618 cri.go:89] found id: ""
I0127 11:42:31.487433 66618 logs.go:282] 0 containers: []
W0127 11:42:31.487444 66618 logs.go:284] No container was found matching "kube-scheduler"
I0127 11:42:31.487451 66618 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0127 11:42:31.487512 66618 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0127 11:42:31.524256 66618 cri.go:89] found id: ""
I0127 11:42:31.524288 66618 logs.go:282] 0 containers: []
W0127 11:42:31.524299 66618 logs.go:284] No container was found matching "kube-proxy"
I0127 11:42:31.524312 66618 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0127 11:42:31.524371 66618 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0127 11:42:31.562304 66618 cri.go:89] found id: ""
I0127 11:42:31.562333 66618 logs.go:282] 0 containers: []
W0127 11:42:31.562345 66618 logs.go:284] No container was found matching "kube-controller-manager"
I0127 11:42:31.562353 66618 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0127 11:42:31.562413 66618 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0127 11:42:31.594211 66618 cri.go:89] found id: ""
I0127 11:42:31.594236 66618 logs.go:282] 0 containers: []
W0127 11:42:31.594244 66618 logs.go:284] No container was found matching "kindnet"
I0127 11:42:31.594254 66618 logs.go:123] Gathering logs for container status ...
I0127 11:42:31.594264 66618 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0127 11:42:31.649936 66618 logs.go:123] Gathering logs for kubelet ...
I0127 11:42:31.649974 66618 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0127 11:42:31.702475 66618 logs.go:123] Gathering logs for dmesg ...
I0127 11:42:31.702508 66618 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0127 11:42:31.722562 66618 logs.go:123] Gathering logs for describe nodes ...
I0127 11:42:31.722590 66618 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0127 11:42:31.835146 66618 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0127 11:42:31.835166 66618 logs.go:123] Gathering logs for CRI-O ...
I0127 11:42:31.835180 66618 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
W0127 11:42:31.945685 66618 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 11:42:31.945741 66618 out.go:270] *
*
W0127 11:42:31.945794 66618 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 11:42:31.945809 66618 out.go:270] *
*
W0127 11:42:31.946604 66618 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0127 11:42:31.949683 66618 out.go:201]
W0127 11:42:31.951229 66618 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 11:42:31.951259 66618 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0127 11:42:31.951277 66618 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0127 11:42:31.952727 66618 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-570778 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-570778 -n old-k8s-version-570778
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-570778 -n old-k8s-version-570778: exit status 6 (228.466535ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0127 11:42:32.219375 69912 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-570778" does not appear in /home/jenkins/minikube-integration/20319-18835/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-570778" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (291.64s)