=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-954411 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-954411 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (5m7.047643421s)
-- stdout --
* [old-k8s-version-954411] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20623
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20623-2183077/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20623-2183077/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-954411" primary control-plane node in "old-k8s-version-954411" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0414 14:01:06.919681 2231425 out.go:345] Setting OutFile to fd 1 ...
I0414 14:01:06.919776 2231425 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 14:01:06.919781 2231425 out.go:358] Setting ErrFile to fd 2...
I0414 14:01:06.919785 2231425 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 14:01:06.919986 2231425 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20623-2183077/.minikube/bin
I0414 14:01:06.920601 2231425 out.go:352] Setting JSON to false
I0414 14:01:06.921663 2231425 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-5","uptime":168206,"bootTime":1744471061,"procs":199,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1078-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0414 14:01:06.921766 2231425 start.go:139] virtualization: kvm guest
I0414 14:01:06.923788 2231425 out.go:177] * [old-k8s-version-954411] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0414 14:01:06.925039 2231425 out.go:177] - MINIKUBE_LOCATION=20623
I0414 14:01:06.925039 2231425 notify.go:220] Checking for updates...
I0414 14:01:06.927258 2231425 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0414 14:01:06.928385 2231425 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20623-2183077/kubeconfig
I0414 14:01:06.929632 2231425 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20623-2183077/.minikube
I0414 14:01:06.930732 2231425 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0414 14:01:06.931920 2231425 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0414 14:01:06.933590 2231425 config.go:182] Loaded profile config "force-systemd-flag-509258": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0414 14:01:06.933680 2231425 config.go:182] Loaded profile config "kubernetes-upgrade-461086": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0414 14:01:06.933788 2231425 config.go:182] Loaded profile config "pause-648153": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0414 14:01:06.933880 2231425 driver.go:394] Setting default libvirt URI to qemu:///system
I0414 14:01:06.967994 2231425 out.go:177] * Using the kvm2 driver based on user configuration
I0414 14:01:06.969213 2231425 start.go:297] selected driver: kvm2
I0414 14:01:06.969240 2231425 start.go:901] validating driver "kvm2" against <nil>
I0414 14:01:06.969257 2231425 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0414 14:01:06.969946 2231425 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0414 14:01:06.970043 2231425 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20623-2183077/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0414 14:01:06.985778 2231425 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0414 14:01:06.985827 2231425 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0414 14:01:06.986086 2231425 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0414 14:01:06.986129 2231425 cni.go:84] Creating CNI manager for ""
I0414 14:01:06.986171 2231425 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0414 14:01:06.986180 2231425 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0414 14:01:06.986226 2231425 start.go:340] cluster config:
{Name:old-k8s-version-954411 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-954411 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0414 14:01:06.986308 2231425 iso.go:125] acquiring lock: {Name:mk1b6bc811d798b73231639961523f4c8d001a9f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0414 14:01:06.987931 2231425 out.go:177] * Starting "old-k8s-version-954411" primary control-plane node in "old-k8s-version-954411" cluster
I0414 14:01:06.988888 2231425 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0414 14:01:06.988939 2231425 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20623-2183077/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0414 14:01:06.988959 2231425 cache.go:56] Caching tarball of preloaded images
I0414 14:01:06.989051 2231425 preload.go:172] Found /home/jenkins/minikube-integration/20623-2183077/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0414 14:01:06.989068 2231425 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0414 14:01:06.989172 2231425 profile.go:143] Saving config to /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/config.json ...
I0414 14:01:06.989191 2231425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/config.json: {Name:mkf395d3ac6ac7a536f2c134a728f8da0d0418cc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 14:01:06.989380 2231425 start.go:360] acquireMachinesLock for old-k8s-version-954411: {Name:mka8bf7d0904b7ab9a32ecac2c5513c5d5418afd Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0414 14:01:42.385450 2231425 start.go:364] duration metric: took 35.396017033s to acquireMachinesLock for "old-k8s-version-954411"
I0414 14:01:42.385550 2231425 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-954411 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 C
lusterName:old-k8s-version-954411 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p M
ountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0414 14:01:42.385687 2231425 start.go:125] createHost starting for "" (driver="kvm2")
I0414 14:01:42.387303 2231425 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0414 14:01:42.387570 2231425 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0414 14:01:42.387643 2231425 main.go:141] libmachine: Launching plugin server for driver kvm2
I0414 14:01:42.408560 2231425 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46147
I0414 14:01:42.409136 2231425 main.go:141] libmachine: () Calling .GetVersion
I0414 14:01:42.409723 2231425 main.go:141] libmachine: Using API Version 1
I0414 14:01:42.409750 2231425 main.go:141] libmachine: () Calling .SetConfigRaw
I0414 14:01:42.410166 2231425 main.go:141] libmachine: () Calling .GetMachineName
I0414 14:01:42.410355 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetMachineName
I0414 14:01:42.410521 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .DriverName
I0414 14:01:42.410672 2231425 start.go:159] libmachine.API.Create for "old-k8s-version-954411" (driver="kvm2")
I0414 14:01:42.410709 2231425 client.go:168] LocalClient.Create starting
I0414 14:01:42.410743 2231425 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20623-2183077/.minikube/certs/ca.pem
I0414 14:01:42.410794 2231425 main.go:141] libmachine: Decoding PEM data...
I0414 14:01:42.410813 2231425 main.go:141] libmachine: Parsing certificate...
I0414 14:01:42.410892 2231425 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20623-2183077/.minikube/certs/cert.pem
I0414 14:01:42.410921 2231425 main.go:141] libmachine: Decoding PEM data...
I0414 14:01:42.410939 2231425 main.go:141] libmachine: Parsing certificate...
I0414 14:01:42.410963 2231425 main.go:141] libmachine: Running pre-create checks...
I0414 14:01:42.410974 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .PreCreateCheck
I0414 14:01:42.411361 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetConfigRaw
I0414 14:01:42.411765 2231425 main.go:141] libmachine: Creating machine...
I0414 14:01:42.411782 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .Create
I0414 14:01:42.411958 2231425 main.go:141] libmachine: (old-k8s-version-954411) creating KVM machine...
I0414 14:01:42.411979 2231425 main.go:141] libmachine: (old-k8s-version-954411) creating network...
I0414 14:01:42.413183 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found existing default KVM network
I0414 14:01:42.414239 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:42.414087 2231858 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000201190}
I0414 14:01:42.414263 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | created network xml:
I0414 14:01:42.414282 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | <network>
I0414 14:01:42.414295 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | <name>mk-old-k8s-version-954411</name>
I0414 14:01:42.414309 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | <dns enable='no'/>
I0414 14:01:42.414320 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG |
I0414 14:01:42.414333 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0414 14:01:42.414344 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | <dhcp>
I0414 14:01:42.414353 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0414 14:01:42.414365 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | </dhcp>
I0414 14:01:42.414373 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | </ip>
I0414 14:01:42.414386 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG |
I0414 14:01:42.414395 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | </network>
I0414 14:01:42.414404 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG |
I0414 14:01:42.419672 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | trying to create private KVM network mk-old-k8s-version-954411 192.168.39.0/24...
I0414 14:01:42.495567 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | private KVM network mk-old-k8s-version-954411 192.168.39.0/24 created
I0414 14:01:42.495599 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:42.495526 2231858 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20623-2183077/.minikube
I0414 14:01:42.495614 2231425 main.go:141] libmachine: (old-k8s-version-954411) setting up store path in /home/jenkins/minikube-integration/20623-2183077/.minikube/machines/old-k8s-version-954411 ...
I0414 14:01:42.495631 2231425 main.go:141] libmachine: (old-k8s-version-954411) building disk image from file:///home/jenkins/minikube-integration/20623-2183077/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0414 14:01:42.495727 2231425 main.go:141] libmachine: (old-k8s-version-954411) Downloading /home/jenkins/minikube-integration/20623-2183077/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20623-2183077/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0414 14:01:42.779984 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:42.779839 2231858 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20623-2183077/.minikube/machines/old-k8s-version-954411/id_rsa...
I0414 14:01:42.941486 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:42.941322 2231858 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20623-2183077/.minikube/machines/old-k8s-version-954411/old-k8s-version-954411.rawdisk...
I0414 14:01:42.941548 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | Writing magic tar header
I0414 14:01:42.941570 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | Writing SSH key tar header
I0414 14:01:42.941589 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:42.941479 2231858 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20623-2183077/.minikube/machines/old-k8s-version-954411 ...
I0414 14:01:42.941603 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20623-2183077/.minikube/machines/old-k8s-version-954411
I0414 14:01:42.941624 2231425 main.go:141] libmachine: (old-k8s-version-954411) setting executable bit set on /home/jenkins/minikube-integration/20623-2183077/.minikube/machines/old-k8s-version-954411 (perms=drwx------)
I0414 14:01:42.941642 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20623-2183077/.minikube/machines
I0414 14:01:42.941652 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20623-2183077/.minikube
I0414 14:01:42.941790 2231425 main.go:141] libmachine: (old-k8s-version-954411) setting executable bit set on /home/jenkins/minikube-integration/20623-2183077/.minikube/machines (perms=drwxr-xr-x)
I0414 14:01:42.941856 2231425 main.go:141] libmachine: (old-k8s-version-954411) setting executable bit set on /home/jenkins/minikube-integration/20623-2183077/.minikube (perms=drwxr-xr-x)
I0414 14:01:42.941870 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20623-2183077
I0414 14:01:42.941895 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0414 14:01:42.941910 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | checking permissions on dir: /home/jenkins
I0414 14:01:42.941929 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | checking permissions on dir: /home
I0414 14:01:42.941942 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | skipping /home - not owner
I0414 14:01:42.941978 2231425 main.go:141] libmachine: (old-k8s-version-954411) setting executable bit set on /home/jenkins/minikube-integration/20623-2183077 (perms=drwxrwxr-x)
I0414 14:01:42.942005 2231425 main.go:141] libmachine: (old-k8s-version-954411) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0414 14:01:42.942019 2231425 main.go:141] libmachine: (old-k8s-version-954411) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0414 14:01:42.942030 2231425 main.go:141] libmachine: (old-k8s-version-954411) creating domain...
I0414 14:01:42.943234 2231425 main.go:141] libmachine: (old-k8s-version-954411) define libvirt domain using xml:
I0414 14:01:42.943260 2231425 main.go:141] libmachine: (old-k8s-version-954411) <domain type='kvm'>
I0414 14:01:42.943295 2231425 main.go:141] libmachine: (old-k8s-version-954411) <name>old-k8s-version-954411</name>
I0414 14:01:42.943319 2231425 main.go:141] libmachine: (old-k8s-version-954411) <memory unit='MiB'>2200</memory>
I0414 14:01:42.943331 2231425 main.go:141] libmachine: (old-k8s-version-954411) <vcpu>2</vcpu>
I0414 14:01:42.943342 2231425 main.go:141] libmachine: (old-k8s-version-954411) <features>
I0414 14:01:42.943353 2231425 main.go:141] libmachine: (old-k8s-version-954411) <acpi/>
I0414 14:01:42.943364 2231425 main.go:141] libmachine: (old-k8s-version-954411) <apic/>
I0414 14:01:42.943378 2231425 main.go:141] libmachine: (old-k8s-version-954411) <pae/>
I0414 14:01:42.943393 2231425 main.go:141] libmachine: (old-k8s-version-954411)
I0414 14:01:42.943402 2231425 main.go:141] libmachine: (old-k8s-version-954411) </features>
I0414 14:01:42.943413 2231425 main.go:141] libmachine: (old-k8s-version-954411) <cpu mode='host-passthrough'>
I0414 14:01:42.943425 2231425 main.go:141] libmachine: (old-k8s-version-954411)
I0414 14:01:42.943433 2231425 main.go:141] libmachine: (old-k8s-version-954411) </cpu>
I0414 14:01:42.943442 2231425 main.go:141] libmachine: (old-k8s-version-954411) <os>
I0414 14:01:42.943453 2231425 main.go:141] libmachine: (old-k8s-version-954411) <type>hvm</type>
I0414 14:01:42.943476 2231425 main.go:141] libmachine: (old-k8s-version-954411) <boot dev='cdrom'/>
I0414 14:01:42.943496 2231425 main.go:141] libmachine: (old-k8s-version-954411) <boot dev='hd'/>
I0414 14:01:42.943525 2231425 main.go:141] libmachine: (old-k8s-version-954411) <bootmenu enable='no'/>
I0414 14:01:42.943535 2231425 main.go:141] libmachine: (old-k8s-version-954411) </os>
I0414 14:01:42.943544 2231425 main.go:141] libmachine: (old-k8s-version-954411) <devices>
I0414 14:01:42.943556 2231425 main.go:141] libmachine: (old-k8s-version-954411) <disk type='file' device='cdrom'>
I0414 14:01:42.943587 2231425 main.go:141] libmachine: (old-k8s-version-954411) <source file='/home/jenkins/minikube-integration/20623-2183077/.minikube/machines/old-k8s-version-954411/boot2docker.iso'/>
I0414 14:01:42.943601 2231425 main.go:141] libmachine: (old-k8s-version-954411) <target dev='hdc' bus='scsi'/>
I0414 14:01:42.943607 2231425 main.go:141] libmachine: (old-k8s-version-954411) <readonly/>
I0414 14:01:42.943615 2231425 main.go:141] libmachine: (old-k8s-version-954411) </disk>
I0414 14:01:42.943624 2231425 main.go:141] libmachine: (old-k8s-version-954411) <disk type='file' device='disk'>
I0414 14:01:42.943644 2231425 main.go:141] libmachine: (old-k8s-version-954411) <driver name='qemu' type='raw' cache='default' io='threads' />
I0414 14:01:42.943664 2231425 main.go:141] libmachine: (old-k8s-version-954411) <source file='/home/jenkins/minikube-integration/20623-2183077/.minikube/machines/old-k8s-version-954411/old-k8s-version-954411.rawdisk'/>
I0414 14:01:42.943677 2231425 main.go:141] libmachine: (old-k8s-version-954411) <target dev='hda' bus='virtio'/>
I0414 14:01:42.943688 2231425 main.go:141] libmachine: (old-k8s-version-954411) </disk>
I0414 14:01:42.943699 2231425 main.go:141] libmachine: (old-k8s-version-954411) <interface type='network'>
I0414 14:01:42.943710 2231425 main.go:141] libmachine: (old-k8s-version-954411) <source network='mk-old-k8s-version-954411'/>
I0414 14:01:42.943722 2231425 main.go:141] libmachine: (old-k8s-version-954411) <model type='virtio'/>
I0414 14:01:42.943735 2231425 main.go:141] libmachine: (old-k8s-version-954411) </interface>
I0414 14:01:42.943747 2231425 main.go:141] libmachine: (old-k8s-version-954411) <interface type='network'>
I0414 14:01:42.943757 2231425 main.go:141] libmachine: (old-k8s-version-954411) <source network='default'/>
I0414 14:01:42.943765 2231425 main.go:141] libmachine: (old-k8s-version-954411) <model type='virtio'/>
I0414 14:01:42.943775 2231425 main.go:141] libmachine: (old-k8s-version-954411) </interface>
I0414 14:01:42.943784 2231425 main.go:141] libmachine: (old-k8s-version-954411) <serial type='pty'>
I0414 14:01:42.943794 2231425 main.go:141] libmachine: (old-k8s-version-954411) <target port='0'/>
I0414 14:01:42.943802 2231425 main.go:141] libmachine: (old-k8s-version-954411) </serial>
I0414 14:01:42.943812 2231425 main.go:141] libmachine: (old-k8s-version-954411) <console type='pty'>
I0414 14:01:42.943821 2231425 main.go:141] libmachine: (old-k8s-version-954411) <target type='serial' port='0'/>
I0414 14:01:42.943835 2231425 main.go:141] libmachine: (old-k8s-version-954411) </console>
I0414 14:01:42.943847 2231425 main.go:141] libmachine: (old-k8s-version-954411) <rng model='virtio'>
I0414 14:01:42.943858 2231425 main.go:141] libmachine: (old-k8s-version-954411) <backend model='random'>/dev/random</backend>
I0414 14:01:42.943868 2231425 main.go:141] libmachine: (old-k8s-version-954411) </rng>
I0414 14:01:42.943877 2231425 main.go:141] libmachine: (old-k8s-version-954411)
I0414 14:01:42.943885 2231425 main.go:141] libmachine: (old-k8s-version-954411)
I0414 14:01:42.943894 2231425 main.go:141] libmachine: (old-k8s-version-954411) </devices>
I0414 14:01:42.943902 2231425 main.go:141] libmachine: (old-k8s-version-954411) </domain>
I0414 14:01:42.943915 2231425 main.go:141] libmachine: (old-k8s-version-954411)
I0414 14:01:42.947328 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:c0:7b:40 in network default
I0414 14:01:42.948005 2231425 main.go:141] libmachine: (old-k8s-version-954411) starting domain...
I0414 14:01:42.948024 2231425 main.go:141] libmachine: (old-k8s-version-954411) ensuring networks are active...
I0414 14:01:42.948036 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:01:42.948755 2231425 main.go:141] libmachine: (old-k8s-version-954411) Ensuring network default is active
I0414 14:01:42.949156 2231425 main.go:141] libmachine: (old-k8s-version-954411) Ensuring network mk-old-k8s-version-954411 is active
I0414 14:01:42.949711 2231425 main.go:141] libmachine: (old-k8s-version-954411) getting domain XML...
I0414 14:01:42.950550 2231425 main.go:141] libmachine: (old-k8s-version-954411) creating domain...
I0414 14:01:44.322603 2231425 main.go:141] libmachine: (old-k8s-version-954411) waiting for IP...
I0414 14:01:44.323750 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:01:44.324363 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | unable to find current IP address of domain old-k8s-version-954411 in network mk-old-k8s-version-954411
I0414 14:01:44.324410 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:44.324348 2231858 retry.go:31] will retry after 279.076334ms: waiting for domain to come up
I0414 14:01:44.605212 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:01:44.605923 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | unable to find current IP address of domain old-k8s-version-954411 in network mk-old-k8s-version-954411
I0414 14:01:44.605954 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:44.605856 2231858 retry.go:31] will retry after 254.872686ms: waiting for domain to come up
I0414 14:01:44.862616 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:01:44.863190 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | unable to find current IP address of domain old-k8s-version-954411 in network mk-old-k8s-version-954411
I0414 14:01:44.863226 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:44.863176 2231858 retry.go:31] will retry after 298.853913ms: waiting for domain to come up
I0414 14:01:45.164114 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:01:45.164912 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | unable to find current IP address of domain old-k8s-version-954411 in network mk-old-k8s-version-954411
I0414 14:01:45.164985 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:45.164894 2231858 retry.go:31] will retry after 536.754794ms: waiting for domain to come up
I0414 14:01:45.703716 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:01:45.704247 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | unable to find current IP address of domain old-k8s-version-954411 in network mk-old-k8s-version-954411
I0414 14:01:45.704275 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:45.704222 2231858 retry.go:31] will retry after 518.01594ms: waiting for domain to come up
I0414 14:01:46.224061 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:01:46.224567 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | unable to find current IP address of domain old-k8s-version-954411 in network mk-old-k8s-version-954411
I0414 14:01:46.224597 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:46.224521 2231858 retry.go:31] will retry after 811.819388ms: waiting for domain to come up
I0414 14:01:47.037624 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:01:47.038212 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | unable to find current IP address of domain old-k8s-version-954411 in network mk-old-k8s-version-954411
I0414 14:01:47.038246 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:47.038178 2231858 retry.go:31] will retry after 810.475581ms: waiting for domain to come up
I0414 14:01:47.850153 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:01:47.850836 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | unable to find current IP address of domain old-k8s-version-954411 in network mk-old-k8s-version-954411
I0414 14:01:47.850903 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:47.850807 2231858 retry.go:31] will retry after 1.485492391s: waiting for domain to come up
I0414 14:01:49.338172 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:01:49.338706 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | unable to find current IP address of domain old-k8s-version-954411 in network mk-old-k8s-version-954411
I0414 14:01:49.338734 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:49.338676 2231858 retry.go:31] will retry after 1.687724196s: waiting for domain to come up
I0414 14:01:51.027867 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:01:51.028424 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | unable to find current IP address of domain old-k8s-version-954411 in network mk-old-k8s-version-954411
I0414 14:01:51.028464 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:51.028392 2231858 retry.go:31] will retry after 1.522926636s: waiting for domain to come up
I0414 14:01:52.553464 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:01:52.554194 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | unable to find current IP address of domain old-k8s-version-954411 in network mk-old-k8s-version-954411
I0414 14:01:52.554224 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:52.554173 2231858 retry.go:31] will retry after 2.433606804s: waiting for domain to come up
I0414 14:01:54.989985 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:01:54.990668 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | unable to find current IP address of domain old-k8s-version-954411 in network mk-old-k8s-version-954411
I0414 14:01:54.990699 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:54.990618 2231858 retry.go:31] will retry after 2.83892329s: waiting for domain to come up
I0414 14:01:57.831294 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:01:57.831749 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | unable to find current IP address of domain old-k8s-version-954411 in network mk-old-k8s-version-954411
I0414 14:01:57.831776 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:01:57.831713 2231858 retry.go:31] will retry after 3.144381263s: waiting for domain to come up
I0414 14:02:00.978061 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:00.978497 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | unable to find current IP address of domain old-k8s-version-954411 in network mk-old-k8s-version-954411
I0414 14:02:00.978544 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | I0414 14:02:00.978471 2231858 retry.go:31] will retry after 4.522230468s: waiting for domain to come up
I0414 14:02:05.503464 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:05.504013 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has current primary IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:05.504042 2231425 main.go:141] libmachine: (old-k8s-version-954411) found domain IP: 192.168.39.90
I0414 14:02:05.504053 2231425 main.go:141] libmachine: (old-k8s-version-954411) reserving static IP address...
I0414 14:02:05.504350 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-954411", mac: "52:54:00:e4:99:d7", ip: "192.168.39.90"} in network mk-old-k8s-version-954411
I0414 14:02:05.589888 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | Getting to WaitForSSH function...
I0414 14:02:05.589928 2231425 main.go:141] libmachine: (old-k8s-version-954411) reserved static IP address 192.168.39.90 for domain old-k8s-version-954411
I0414 14:02:05.589942 2231425 main.go:141] libmachine: (old-k8s-version-954411) waiting for SSH...
I0414 14:02:05.593022 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:05.593446 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:minikube Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:05.593475 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:05.593616 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | Using SSH client type: external
I0414 14:02:05.593648 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | Using SSH private key: /home/jenkins/minikube-integration/20623-2183077/.minikube/machines/old-k8s-version-954411/id_rsa (-rw-------)
I0414 14:02:05.593692 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.90 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20623-2183077/.minikube/machines/old-k8s-version-954411/id_rsa -p 22] /usr/bin/ssh <nil>}
I0414 14:02:05.593708 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | About to run SSH command:
I0414 14:02:05.593719 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | exit 0
I0414 14:02:05.721121 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | SSH cmd err, output: <nil>:
I0414 14:02:05.721417 2231425 main.go:141] libmachine: (old-k8s-version-954411) KVM machine creation complete
I0414 14:02:05.721714 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetConfigRaw
I0414 14:02:05.722325 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .DriverName
I0414 14:02:05.722519 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .DriverName
I0414 14:02:05.722666 2231425 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0414 14:02:05.722679 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetState
I0414 14:02:05.723891 2231425 main.go:141] libmachine: Detecting operating system of created instance...
I0414 14:02:05.723906 2231425 main.go:141] libmachine: Waiting for SSH to be available...
I0414 14:02:05.723913 2231425 main.go:141] libmachine: Getting to WaitForSSH function...
I0414 14:02:05.723921 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHHostname
I0414 14:02:05.726302 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:05.726658 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:old-k8s-version-954411 Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:05.726689 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:05.726828 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHPort
I0414 14:02:05.727025 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHKeyPath
I0414 14:02:05.727169 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHKeyPath
I0414 14:02:05.727287 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHUsername
I0414 14:02:05.727485 2231425 main.go:141] libmachine: Using SSH client type: native
I0414 14:02:05.727810 2231425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.90 22 <nil> <nil>}
I0414 14:02:05.727823 2231425 main.go:141] libmachine: About to run SSH command:
exit 0
I0414 14:02:05.836170 2231425 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0414 14:02:05.836199 2231425 main.go:141] libmachine: Detecting the provisioner...
I0414 14:02:05.836207 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHHostname
I0414 14:02:05.839446 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:05.839864 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:old-k8s-version-954411 Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:05.839893 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:05.840067 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHPort
I0414 14:02:05.840266 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHKeyPath
I0414 14:02:05.840418 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHKeyPath
I0414 14:02:05.840577 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHUsername
I0414 14:02:05.840722 2231425 main.go:141] libmachine: Using SSH client type: native
I0414 14:02:05.840967 2231425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.90 22 <nil> <nil>}
I0414 14:02:05.840979 2231425 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0414 14:02:05.949867 2231425 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0414 14:02:05.949956 2231425 main.go:141] libmachine: found compatible host: buildroot
I0414 14:02:05.949969 2231425 main.go:141] libmachine: Provisioning with buildroot...
I0414 14:02:05.949980 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetMachineName
I0414 14:02:05.950250 2231425 buildroot.go:166] provisioning hostname "old-k8s-version-954411"
I0414 14:02:05.950288 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetMachineName
I0414 14:02:05.950465 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHHostname
I0414 14:02:05.953094 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:05.953502 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:old-k8s-version-954411 Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:05.953539 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:05.953661 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHPort
I0414 14:02:05.953876 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHKeyPath
I0414 14:02:05.954036 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHKeyPath
I0414 14:02:05.954254 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHUsername
I0414 14:02:05.954445 2231425 main.go:141] libmachine: Using SSH client type: native
I0414 14:02:05.954805 2231425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.90 22 <nil> <nil>}
I0414 14:02:05.954835 2231425 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-954411 && echo "old-k8s-version-954411" | sudo tee /etc/hostname
I0414 14:02:06.076251 2231425 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-954411
I0414 14:02:06.076292 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHHostname
I0414 14:02:06.080415 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.080847 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:old-k8s-version-954411 Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:06.080896 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.081131 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHPort
I0414 14:02:06.081336 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHKeyPath
I0414 14:02:06.081508 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHKeyPath
I0414 14:02:06.081666 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHUsername
I0414 14:02:06.081868 2231425 main.go:141] libmachine: Using SSH client type: native
I0414 14:02:06.082163 2231425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.90 22 <nil> <nil>}
I0414 14:02:06.082187 2231425 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-954411' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-954411/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-954411' | sudo tee -a /etc/hosts;
fi
fi
I0414 14:02:06.198986 2231425 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0414 14:02:06.199059 2231425 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20623-2183077/.minikube CaCertPath:/home/jenkins/minikube-integration/20623-2183077/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20623-2183077/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20623-2183077/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20623-2183077/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20623-2183077/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20623-2183077/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20623-2183077/.minikube}
I0414 14:02:06.199095 2231425 buildroot.go:174] setting up certificates
I0414 14:02:06.199119 2231425 provision.go:84] configureAuth start
I0414 14:02:06.199137 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetMachineName
I0414 14:02:06.199506 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetIP
I0414 14:02:06.202609 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.203013 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:old-k8s-version-954411 Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:06.203051 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.203181 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHHostname
I0414 14:02:06.205535 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.205856 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:old-k8s-version-954411 Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:06.205897 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.206020 2231425 provision.go:143] copyHostCerts
I0414 14:02:06.206100 2231425 exec_runner.go:144] found /home/jenkins/minikube-integration/20623-2183077/.minikube/cert.pem, removing ...
I0414 14:02:06.206125 2231425 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20623-2183077/.minikube/cert.pem
I0414 14:02:06.206204 2231425 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20623-2183077/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20623-2183077/.minikube/cert.pem (1123 bytes)
I0414 14:02:06.206322 2231425 exec_runner.go:144] found /home/jenkins/minikube-integration/20623-2183077/.minikube/key.pem, removing ...
I0414 14:02:06.206333 2231425 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20623-2183077/.minikube/key.pem
I0414 14:02:06.206366 2231425 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20623-2183077/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20623-2183077/.minikube/key.pem (1675 bytes)
I0414 14:02:06.206441 2231425 exec_runner.go:144] found /home/jenkins/minikube-integration/20623-2183077/.minikube/ca.pem, removing ...
I0414 14:02:06.206451 2231425 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20623-2183077/.minikube/ca.pem
I0414 14:02:06.206479 2231425 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20623-2183077/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20623-2183077/.minikube/ca.pem (1078 bytes)
I0414 14:02:06.206546 2231425 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20623-2183077/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20623-2183077/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20623-2183077/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-954411 san=[127.0.0.1 192.168.39.90 localhost minikube old-k8s-version-954411]
I0414 14:02:06.366218 2231425 provision.go:177] copyRemoteCerts
I0414 14:02:06.366301 2231425 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0414 14:02:06.366340 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHHostname
I0414 14:02:06.369647 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.370019 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:old-k8s-version-954411 Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:06.370054 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.370246 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHPort
I0414 14:02:06.370475 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHKeyPath
I0414 14:02:06.370666 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHUsername
I0414 14:02:06.370826 2231425 sshutil.go:53] new ssh client: &{IP:192.168.39.90 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20623-2183077/.minikube/machines/old-k8s-version-954411/id_rsa Username:docker}
I0414 14:02:06.455796 2231425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20623-2183077/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0414 14:02:06.482620 2231425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20623-2183077/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0414 14:02:06.507961 2231425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20623-2183077/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0414 14:02:06.534083 2231425 provision.go:87] duration metric: took 334.941964ms to configureAuth
I0414 14:02:06.534127 2231425 buildroot.go:189] setting minikube options for container-runtime
I0414 14:02:06.534326 2231425 config.go:182] Loaded profile config "old-k8s-version-954411": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0414 14:02:06.534404 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHHostname
I0414 14:02:06.537117 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.537459 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:old-k8s-version-954411 Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:06.537515 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.537675 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHPort
I0414 14:02:06.537900 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHKeyPath
I0414 14:02:06.538105 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHKeyPath
I0414 14:02:06.538265 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHUsername
I0414 14:02:06.538432 2231425 main.go:141] libmachine: Using SSH client type: native
I0414 14:02:06.538667 2231425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.90 22 <nil> <nil>}
I0414 14:02:06.538683 2231425 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0414 14:02:06.764766 2231425 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0414 14:02:06.764796 2231425 main.go:141] libmachine: Checking connection to Docker...
I0414 14:02:06.764805 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetURL
I0414 14:02:06.766384 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | using libvirt version 6000000
I0414 14:02:06.768517 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.768966 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:old-k8s-version-954411 Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:06.769028 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.769171 2231425 main.go:141] libmachine: Docker is up and running!
I0414 14:02:06.769190 2231425 main.go:141] libmachine: Reticulating splines...
I0414 14:02:06.769199 2231425 client.go:171] duration metric: took 24.35847885s to LocalClient.Create
I0414 14:02:06.769221 2231425 start.go:167] duration metric: took 24.358553067s to libmachine.API.Create "old-k8s-version-954411"
I0414 14:02:06.769228 2231425 start.go:293] postStartSetup for "old-k8s-version-954411" (driver="kvm2")
I0414 14:02:06.769237 2231425 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0414 14:02:06.769255 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .DriverName
I0414 14:02:06.769520 2231425 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0414 14:02:06.769548 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHHostname
I0414 14:02:06.772067 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.772471 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:old-k8s-version-954411 Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:06.772503 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.772718 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHPort
I0414 14:02:06.772928 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHKeyPath
I0414 14:02:06.773093 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHUsername
I0414 14:02:06.773260 2231425 sshutil.go:53] new ssh client: &{IP:192.168.39.90 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20623-2183077/.minikube/machines/old-k8s-version-954411/id_rsa Username:docker}
I0414 14:02:06.855695 2231425 ssh_runner.go:195] Run: cat /etc/os-release
I0414 14:02:06.860172 2231425 info.go:137] Remote host: Buildroot 2023.02.9
I0414 14:02:06.860224 2231425 filesync.go:126] Scanning /home/jenkins/minikube-integration/20623-2183077/.minikube/addons for local assets ...
I0414 14:02:06.860312 2231425 filesync.go:126] Scanning /home/jenkins/minikube-integration/20623-2183077/.minikube/files for local assets ...
I0414 14:02:06.860410 2231425 filesync.go:149] local asset: /home/jenkins/minikube-integration/20623-2183077/.minikube/files/etc/ssl/certs/21904002.pem -> 21904002.pem in /etc/ssl/certs
I0414 14:02:06.860522 2231425 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0414 14:02:06.870132 2231425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20623-2183077/.minikube/files/etc/ssl/certs/21904002.pem --> /etc/ssl/certs/21904002.pem (1708 bytes)
I0414 14:02:06.893118 2231425 start.go:296] duration metric: took 123.876511ms for postStartSetup
I0414 14:02:06.893177 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetConfigRaw
I0414 14:02:06.893787 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetIP
I0414 14:02:06.896471 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.896752 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:old-k8s-version-954411 Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:06.896789 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.897083 2231425 profile.go:143] Saving config to /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/config.json ...
I0414 14:02:06.897288 2231425 start.go:128] duration metric: took 24.51158765s to createHost
I0414 14:02:06.897315 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHHostname
I0414 14:02:06.899533 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.899839 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:old-k8s-version-954411 Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:06.899879 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:06.899988 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHPort
I0414 14:02:06.900155 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHKeyPath
I0414 14:02:06.900310 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHKeyPath
I0414 14:02:06.900421 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHUsername
I0414 14:02:06.900559 2231425 main.go:141] libmachine: Using SSH client type: native
I0414 14:02:06.900832 2231425 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.39.90 22 <nil> <nil>}
I0414 14:02:06.900844 2231425 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0414 14:02:07.010129 2231425 main.go:141] libmachine: SSH cmd err, output: <nil>: 1744639326.991378871
I0414 14:02:07.010176 2231425 fix.go:216] guest clock: 1744639326.991378871
I0414 14:02:07.010188 2231425 fix.go:229] Guest: 2025-04-14 14:02:06.991378871 +0000 UTC Remote: 2025-04-14 14:02:06.897300925 +0000 UTC m=+60.018632384 (delta=94.077946ms)
I0414 14:02:07.010242 2231425 fix.go:200] guest clock delta is within tolerance: 94.077946ms
I0414 14:02:07.010253 2231425 start.go:83] releasing machines lock for "old-k8s-version-954411", held for 24.624766435s
I0414 14:02:07.010296 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .DriverName
I0414 14:02:07.010630 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetIP
I0414 14:02:07.013833 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:07.014282 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:old-k8s-version-954411 Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:07.014303 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:07.014571 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .DriverName
I0414 14:02:07.015116 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .DriverName
I0414 14:02:07.015328 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .DriverName
I0414 14:02:07.015453 2231425 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0414 14:02:07.015500 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHHostname
I0414 14:02:07.015600 2231425 ssh_runner.go:195] Run: cat /version.json
I0414 14:02:07.015631 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHHostname
I0414 14:02:07.018330 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:07.018676 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:old-k8s-version-954411 Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:07.018706 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:07.018725 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:07.018814 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHPort
I0414 14:02:07.018995 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHKeyPath
I0414 14:02:07.019178 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHUsername
I0414 14:02:07.019193 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:old-k8s-version-954411 Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:07.019222 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:07.019346 2231425 sshutil.go:53] new ssh client: &{IP:192.168.39.90 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20623-2183077/.minikube/machines/old-k8s-version-954411/id_rsa Username:docker}
I0414 14:02:07.019391 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHPort
I0414 14:02:07.019510 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHKeyPath
I0414 14:02:07.019640 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetSSHUsername
I0414 14:02:07.019783 2231425 sshutil.go:53] new ssh client: &{IP:192.168.39.90 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20623-2183077/.minikube/machines/old-k8s-version-954411/id_rsa Username:docker}
I0414 14:02:07.098922 2231425 ssh_runner.go:195] Run: systemctl --version
I0414 14:02:07.127540 2231425 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0414 14:02:07.297830 2231425 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0414 14:02:07.305518 2231425 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0414 14:02:07.305596 2231425 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0414 14:02:07.322772 2231425 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0414 14:02:07.322805 2231425 start.go:495] detecting cgroup driver to use...
I0414 14:02:07.322887 2231425 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0414 14:02:07.338886 2231425 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0414 14:02:07.354169 2231425 docker.go:217] disabling cri-docker service (if available) ...
I0414 14:02:07.354246 2231425 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0414 14:02:07.370147 2231425 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0414 14:02:07.386422 2231425 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0414 14:02:07.503201 2231425 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0414 14:02:07.642194 2231425 docker.go:233] disabling docker service ...
I0414 14:02:07.642266 2231425 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0414 14:02:07.657618 2231425 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0414 14:02:07.671661 2231425 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0414 14:02:07.805253 2231425 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0414 14:02:07.936806 2231425 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0414 14:02:07.955665 2231425 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0414 14:02:07.977834 2231425 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0414 14:02:07.977898 2231425 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0414 14:02:07.990144 2231425 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0414 14:02:07.990219 2231425 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0414 14:02:08.001051 2231425 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0414 14:02:08.011866 2231425 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0414 14:02:08.022831 2231425 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0414 14:02:08.034294 2231425 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0414 14:02:08.044252 2231425 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0414 14:02:08.044309 2231425 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0414 14:02:08.057115 2231425 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0414 14:02:08.067172 2231425 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0414 14:02:08.181004 2231425 ssh_runner.go:195] Run: sudo systemctl restart crio
I0414 14:02:08.287832 2231425 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0414 14:02:08.287922 2231425 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0414 14:02:08.293140 2231425 start.go:563] Will wait 60s for crictl version
I0414 14:02:08.293201 2231425 ssh_runner.go:195] Run: which crictl
I0414 14:02:08.297185 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0414 14:02:08.350602 2231425 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0414 14:02:08.350693 2231425 ssh_runner.go:195] Run: crio --version
I0414 14:02:08.380823 2231425 ssh_runner.go:195] Run: crio --version
I0414 14:02:08.415360 2231425 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0414 14:02:08.416524 2231425 main.go:141] libmachine: (old-k8s-version-954411) Calling .GetIP
I0414 14:02:08.419481 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:08.419961 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e4:99:d7", ip: ""} in network mk-old-k8s-version-954411: {Iface:virbr1 ExpiryTime:2025-04-14 15:01:58 +0000 UTC Type:0 Mac:52:54:00:e4:99:d7 Iaid: IPaddr:192.168.39.90 Prefix:24 Hostname:old-k8s-version-954411 Clientid:01:52:54:00:e4:99:d7}
I0414 14:02:08.419993 2231425 main.go:141] libmachine: (old-k8s-version-954411) DBG | domain old-k8s-version-954411 has defined IP address 192.168.39.90 and MAC address 52:54:00:e4:99:d7 in network mk-old-k8s-version-954411
I0414 14:02:08.420212 2231425 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0414 14:02:08.424377 2231425 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0414 14:02:08.437464 2231425 kubeadm.go:883] updating cluster {Name:old-k8s-version-954411 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-
version-954411 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.90 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUI
D:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0414 14:02:08.437589 2231425 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0414 14:02:08.437646 2231425 ssh_runner.go:195] Run: sudo crictl images --output json
I0414 14:02:08.473351 2231425 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0414 14:02:08.473422 2231425 ssh_runner.go:195] Run: which lz4
I0414 14:02:08.478843 2231425 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0414 14:02:08.483912 2231425 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0414 14:02:08.483956 2231425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20623-2183077/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0414 14:02:10.254792 2231425 crio.go:462] duration metric: took 1.775988843s to copy over tarball
I0414 14:02:10.254915 2231425 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0414 14:02:12.899564 2231425 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.644617725s)
I0414 14:02:12.899592 2231425 crio.go:469] duration metric: took 2.644759434s to extract the tarball
I0414 14:02:12.899600 2231425 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0414 14:02:12.945037 2231425 ssh_runner.go:195] Run: sudo crictl images --output json
I0414 14:02:12.991509 2231425 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0414 14:02:12.991550 2231425 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0414 14:02:12.991629 2231425 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0414 14:02:12.991677 2231425 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0414 14:02:12.991715 2231425 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0414 14:02:12.991691 2231425 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0414 14:02:12.991713 2231425 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0414 14:02:12.991656 2231425 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0414 14:02:12.991748 2231425 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0414 14:02:12.991744 2231425 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0414 14:02:12.993375 2231425 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0414 14:02:12.993406 2231425 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0414 14:02:12.993492 2231425 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0414 14:02:12.993701 2231425 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0414 14:02:12.993717 2231425 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0414 14:02:12.993744 2231425 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0414 14:02:12.993776 2231425 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0414 14:02:12.993937 2231425 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0414 14:02:13.132156 2231425 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0414 14:02:13.138207 2231425 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0414 14:02:13.154674 2231425 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0414 14:02:13.198762 2231425 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0414 14:02:13.198816 2231425 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0414 14:02:13.198868 2231425 ssh_runner.go:195] Run: which crictl
I0414 14:02:13.205801 2231425 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0414 14:02:13.205852 2231425 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0414 14:02:13.205899 2231425 ssh_runner.go:195] Run: which crictl
I0414 14:02:13.229819 2231425 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0414 14:02:13.229862 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0414 14:02:13.229892 2231425 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0414 14:02:13.229935 2231425 ssh_runner.go:195] Run: which crictl
I0414 14:02:13.229952 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0414 14:02:13.278498 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0414 14:02:13.278527 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0414 14:02:13.278498 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0414 14:02:13.357903 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0414 14:02:13.357949 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0414 14:02:13.357949 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0414 14:02:13.427839 2231425 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20623-2183077/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0414 14:02:13.427875 2231425 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20623-2183077/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0414 14:02:13.427952 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0414 14:02:13.463208 2231425 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20623-2183077/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0414 14:02:13.664017 2231425 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0414 14:02:13.674692 2231425 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0414 14:02:13.676906 2231425 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0414 14:02:13.679772 2231425 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0414 14:02:13.752348 2231425 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0414 14:02:13.752407 2231425 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0414 14:02:13.752462 2231425 ssh_runner.go:195] Run: which crictl
I0414 14:02:13.760839 2231425 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0414 14:02:13.760888 2231425 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0414 14:02:13.760919 2231425 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0414 14:02:13.760956 2231425 ssh_runner.go:195] Run: which crictl
I0414 14:02:13.760959 2231425 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0414 14:02:13.761001 2231425 ssh_runner.go:195] Run: which crictl
I0414 14:02:13.791878 2231425 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0414 14:02:13.791930 2231425 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0414 14:02:13.791964 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0414 14:02:13.792008 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0414 14:02:13.791968 2231425 ssh_runner.go:195] Run: which crictl
I0414 14:02:13.792059 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0414 14:02:13.834942 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0414 14:02:13.878301 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0414 14:02:13.878390 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0414 14:02:13.878390 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0414 14:02:13.907901 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0414 14:02:13.958787 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0414 14:02:13.958832 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0414 14:02:13.979006 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0414 14:02:14.014817 2231425 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20623-2183077/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0414 14:02:14.044137 2231425 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20623-2183077/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0414 14:02:14.044240 2231425 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0414 14:02:14.063857 2231425 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20623-2183077/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0414 14:02:14.096492 2231425 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20623-2183077/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0414 14:02:15.808205 2231425 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0414 14:02:15.950831 2231425 cache_images.go:92] duration metric: took 2.959258613s to LoadCachedImages
W0414 14:02:15.950962 2231425 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20623-2183077/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20623-2183077/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I0414 14:02:15.950985 2231425 kubeadm.go:934] updating node { 192.168.39.90 8443 v1.20.0 crio true true} ...
I0414 14:02:15.951123 2231425 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-954411 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.90
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-954411 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0414 14:02:15.951224 2231425 ssh_runner.go:195] Run: crio config
I0414 14:02:16.007159 2231425 cni.go:84] Creating CNI manager for ""
I0414 14:02:16.007208 2231425 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0414 14:02:16.007223 2231425 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0414 14:02:16.007244 2231425 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.90 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-954411 NodeName:old-k8s-version-954411 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.90"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.90 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0414 14:02:16.007393 2231425 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.90
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-954411"
kubeletExtraArgs:
node-ip: 192.168.39.90
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.90"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0414 14:02:16.007460 2231425 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0414 14:02:16.017677 2231425 binaries.go:44] Found k8s binaries, skipping transfer
I0414 14:02:16.017751 2231425 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0414 14:02:16.027626 2231425 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0414 14:02:16.048186 2231425 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0414 14:02:16.068640 2231425 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0414 14:02:16.086038 2231425 ssh_runner.go:195] Run: grep 192.168.39.90 control-plane.minikube.internal$ /etc/hosts
I0414 14:02:16.090037 2231425 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.90 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0414 14:02:16.102492 2231425 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0414 14:02:16.236159 2231425 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0414 14:02:16.254893 2231425 certs.go:68] Setting up /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411 for IP: 192.168.39.90
I0414 14:02:16.254923 2231425 certs.go:194] generating shared ca certs ...
I0414 14:02:16.254952 2231425 certs.go:226] acquiring lock for ca certs: {Name:mkd994da28098ae08a84efba20f096b52fe71222 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 14:02:16.255131 2231425 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20623-2183077/.minikube/ca.key
I0414 14:02:16.255183 2231425 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20623-2183077/.minikube/proxy-client-ca.key
I0414 14:02:16.255193 2231425 certs.go:256] generating profile certs ...
I0414 14:02:16.255263 2231425 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/client.key
I0414 14:02:16.255294 2231425 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/client.crt with IP's: []
I0414 14:02:16.523333 2231425 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/client.crt ...
I0414 14:02:16.523372 2231425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/client.crt: {Name:mke05337cb5defe1d267510b184d8dbaeb2d14c6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 14:02:16.523595 2231425 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/client.key ...
I0414 14:02:16.523621 2231425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/client.key: {Name:mk998705f35b2c4f125c6e5ac873c777cbc71e97 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 14:02:16.523728 2231425 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/apiserver.key.798e3633
I0414 14:02:16.523745 2231425 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/apiserver.crt.798e3633 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.90]
I0414 14:02:16.652576 2231425 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/apiserver.crt.798e3633 ...
I0414 14:02:16.652626 2231425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/apiserver.crt.798e3633: {Name:mk7178d1a073b554cc9d69147a63b0fe7a2e9681 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 14:02:16.652875 2231425 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/apiserver.key.798e3633 ...
I0414 14:02:16.652902 2231425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/apiserver.key.798e3633: {Name:mk6cb6bb20bed971a3c219e5265c60c0db095156 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 14:02:16.653031 2231425 certs.go:381] copying /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/apiserver.crt.798e3633 -> /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/apiserver.crt
I0414 14:02:16.653138 2231425 certs.go:385] copying /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/apiserver.key.798e3633 -> /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/apiserver.key
I0414 14:02:16.653238 2231425 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/proxy-client.key
I0414 14:02:16.653263 2231425 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/proxy-client.crt with IP's: []
I0414 14:02:16.805416 2231425 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/proxy-client.crt ...
I0414 14:02:16.805448 2231425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/proxy-client.crt: {Name:mk8720e05c4bd25339fa6d45e4047afa245318bd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 14:02:16.805621 2231425 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/proxy-client.key ...
I0414 14:02:16.805639 2231425 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/proxy-client.key: {Name:mkf5b296e3e27886356c877eef73fac5d7e589c1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 14:02:16.805806 2231425 certs.go:484] found cert: /home/jenkins/minikube-integration/20623-2183077/.minikube/certs/2190400.pem (1338 bytes)
W0414 14:02:16.805842 2231425 certs.go:480] ignoring /home/jenkins/minikube-integration/20623-2183077/.minikube/certs/2190400_empty.pem, impossibly tiny 0 bytes
I0414 14:02:16.805853 2231425 certs.go:484] found cert: /home/jenkins/minikube-integration/20623-2183077/.minikube/certs/ca-key.pem (1675 bytes)
I0414 14:02:16.805873 2231425 certs.go:484] found cert: /home/jenkins/minikube-integration/20623-2183077/.minikube/certs/ca.pem (1078 bytes)
I0414 14:02:16.805894 2231425 certs.go:484] found cert: /home/jenkins/minikube-integration/20623-2183077/.minikube/certs/cert.pem (1123 bytes)
I0414 14:02:16.805916 2231425 certs.go:484] found cert: /home/jenkins/minikube-integration/20623-2183077/.minikube/certs/key.pem (1675 bytes)
I0414 14:02:16.805952 2231425 certs.go:484] found cert: /home/jenkins/minikube-integration/20623-2183077/.minikube/files/etc/ssl/certs/21904002.pem (1708 bytes)
I0414 14:02:16.806528 2231425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20623-2183077/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0414 14:02:16.833208 2231425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20623-2183077/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0414 14:02:16.857246 2231425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20623-2183077/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0414 14:02:16.885790 2231425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20623-2183077/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0414 14:02:16.914739 2231425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0414 14:02:16.944834 2231425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0414 14:02:16.971788 2231425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0414 14:02:17.000687 2231425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20623-2183077/.minikube/profiles/old-k8s-version-954411/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0414 14:02:17.025229 2231425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20623-2183077/.minikube/files/etc/ssl/certs/21904002.pem --> /usr/share/ca-certificates/21904002.pem (1708 bytes)
I0414 14:02:17.049962 2231425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20623-2183077/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0414 14:02:17.082303 2231425 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20623-2183077/.minikube/certs/2190400.pem --> /usr/share/ca-certificates/2190400.pem (1338 bytes)
I0414 14:02:17.119486 2231425 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0414 14:02:17.137826 2231425 ssh_runner.go:195] Run: openssl version
I0414 14:02:17.146664 2231425 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0414 14:02:17.162054 2231425 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0414 14:02:17.166832 2231425 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 14 12:54 /usr/share/ca-certificates/minikubeCA.pem
I0414 14:02:17.166917 2231425 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0414 14:02:17.173395 2231425 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0414 14:02:17.193067 2231425 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2190400.pem && ln -fs /usr/share/ca-certificates/2190400.pem /etc/ssl/certs/2190400.pem"
I0414 14:02:17.205436 2231425 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2190400.pem
I0414 14:02:17.210255 2231425 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 14 13:02 /usr/share/ca-certificates/2190400.pem
I0414 14:02:17.210343 2231425 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2190400.pem
I0414 14:02:17.216410 2231425 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/2190400.pem /etc/ssl/certs/51391683.0"
I0414 14:02:17.227772 2231425 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/21904002.pem && ln -fs /usr/share/ca-certificates/21904002.pem /etc/ssl/certs/21904002.pem"
I0414 14:02:17.239128 2231425 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/21904002.pem
I0414 14:02:17.244015 2231425 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 14 13:02 /usr/share/ca-certificates/21904002.pem
I0414 14:02:17.244114 2231425 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/21904002.pem
I0414 14:02:17.250024 2231425 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/21904002.pem /etc/ssl/certs/3ec20f2e.0"
I0414 14:02:17.260827 2231425 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0414 14:02:17.265133 2231425 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0414 14:02:17.265204 2231425 kubeadm.go:392] StartCluster: {Name:old-k8s-version-954411 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-ver
sion-954411 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.90 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:d
ocker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0414 14:02:17.265336 2231425 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0414 14:02:17.265421 2231425 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0414 14:02:17.314385 2231425 cri.go:89] found id: ""
I0414 14:02:17.314476 2231425 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0414 14:02:17.325551 2231425 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0414 14:02:17.336373 2231425 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0414 14:02:17.346695 2231425 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0414 14:02:17.346733 2231425 kubeadm.go:157] found existing configuration files:
I0414 14:02:17.346782 2231425 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0414 14:02:17.356406 2231425 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0414 14:02:17.356497 2231425 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0414 14:02:17.366580 2231425 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0414 14:02:17.379831 2231425 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0414 14:02:17.379909 2231425 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0414 14:02:17.393525 2231425 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0414 14:02:17.405892 2231425 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0414 14:02:17.405965 2231425 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0414 14:02:17.418473 2231425 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0414 14:02:17.428225 2231425 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0414 14:02:17.428299 2231425 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0414 14:02:17.438056 2231425 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0414 14:02:17.568005 2231425 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0414 14:02:17.568155 2231425 kubeadm.go:310] [preflight] Running pre-flight checks
I0414 14:02:17.732274 2231425 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0414 14:02:17.732474 2231425 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0414 14:02:17.732633 2231425 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0414 14:02:17.928163 2231425 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0414 14:02:17.929957 2231425 out.go:235] - Generating certificates and keys ...
I0414 14:02:17.930090 2231425 kubeadm.go:310] [certs] Using existing ca certificate authority
I0414 14:02:17.930223 2231425 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0414 14:02:18.165073 2231425 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0414 14:02:18.550030 2231425 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0414 14:02:18.819652 2231425 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0414 14:02:19.419932 2231425 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0414 14:02:19.494572 2231425 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0414 14:02:19.494786 2231425 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-954411] and IPs [192.168.39.90 127.0.0.1 ::1]
I0414 14:02:19.569868 2231425 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0414 14:02:19.570107 2231425 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-954411] and IPs [192.168.39.90 127.0.0.1 ::1]
I0414 14:02:19.718840 2231425 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0414 14:02:19.849363 2231425 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0414 14:02:20.116069 2231425 kubeadm.go:310] [certs] Generating "sa" key and public key
I0414 14:02:20.116359 2231425 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0414 14:02:20.319491 2231425 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0414 14:02:20.521436 2231425 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0414 14:02:20.651559 2231425 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0414 14:02:20.783494 2231425 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0414 14:02:20.802277 2231425 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0414 14:02:20.803259 2231425 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0414 14:02:20.803313 2231425 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0414 14:02:20.934146 2231425 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0414 14:02:20.936033 2231425 out.go:235] - Booting up control plane ...
I0414 14:02:20.936150 2231425 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0414 14:02:20.943781 2231425 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0414 14:02:20.946201 2231425 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0414 14:02:20.947125 2231425 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0414 14:02:20.952024 2231425 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0414 14:03:00.950657 2231425 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0414 14:03:00.950813 2231425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 14:03:00.951057 2231425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 14:03:05.951793 2231425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 14:03:05.952023 2231425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 14:03:15.952626 2231425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 14:03:15.952944 2231425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 14:03:35.953842 2231425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 14:03:35.954069 2231425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 14:04:15.954576 2231425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 14:04:15.954840 2231425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 14:04:15.954853 2231425 kubeadm.go:310]
I0414 14:04:15.954899 2231425 kubeadm.go:310] Unfortunately, an error has occurred:
I0414 14:04:15.954953 2231425 kubeadm.go:310] timed out waiting for the condition
I0414 14:04:15.954961 2231425 kubeadm.go:310]
I0414 14:04:15.955016 2231425 kubeadm.go:310] This error is likely caused by:
I0414 14:04:15.955075 2231425 kubeadm.go:310] - The kubelet is not running
I0414 14:04:15.955240 2231425 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0414 14:04:15.955250 2231425 kubeadm.go:310]
I0414 14:04:15.955403 2231425 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0414 14:04:15.955446 2231425 kubeadm.go:310] - 'systemctl status kubelet'
I0414 14:04:15.955524 2231425 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0414 14:04:15.955552 2231425 kubeadm.go:310]
I0414 14:04:15.955717 2231425 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0414 14:04:15.955814 2231425 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0414 14:04:15.955826 2231425 kubeadm.go:310]
I0414 14:04:15.955950 2231425 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0414 14:04:15.956100 2231425 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0414 14:04:15.956221 2231425 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0414 14:04:15.956323 2231425 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0414 14:04:15.956337 2231425 kubeadm.go:310]
I0414 14:04:15.956932 2231425 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0414 14:04:15.957062 2231425 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0414 14:04:15.957170 2231425 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0414 14:04:15.957385 2231425 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-954411] and IPs [192.168.39.90 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-954411] and IPs [192.168.39.90 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-954411] and IPs [192.168.39.90 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-954411] and IPs [192.168.39.90 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0414 14:04:15.957439 2231425 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0414 14:04:16.841525 2231425 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0414 14:04:16.856665 2231425 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0414 14:04:16.867156 2231425 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0414 14:04:16.867187 2231425 kubeadm.go:157] found existing configuration files:
I0414 14:04:16.867236 2231425 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0414 14:04:16.877168 2231425 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0414 14:04:16.877230 2231425 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0414 14:04:16.888208 2231425 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0414 14:04:16.897304 2231425 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0414 14:04:16.897366 2231425 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0414 14:04:16.906689 2231425 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0414 14:04:16.915643 2231425 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0414 14:04:16.915746 2231425 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0414 14:04:16.925635 2231425 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0414 14:04:16.934817 2231425 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0414 14:04:16.934881 2231425 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0414 14:04:16.944174 2231425 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0414 14:04:17.175618 2231425 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0414 14:06:13.248116 2231425 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0414 14:06:13.248368 2231425 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0414 14:06:13.249847 2231425 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0414 14:06:13.249931 2231425 kubeadm.go:310] [preflight] Running pre-flight checks
I0414 14:06:13.250073 2231425 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0414 14:06:13.250217 2231425 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0414 14:06:13.250335 2231425 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0414 14:06:13.250415 2231425 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0414 14:06:13.252088 2231425 out.go:235] - Generating certificates and keys ...
I0414 14:06:13.252193 2231425 kubeadm.go:310] [certs] Using existing ca certificate authority
I0414 14:06:13.252248 2231425 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0414 14:06:13.252374 2231425 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0414 14:06:13.252466 2231425 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0414 14:06:13.252609 2231425 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0414 14:06:13.252718 2231425 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0414 14:06:13.252866 2231425 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0414 14:06:13.252961 2231425 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0414 14:06:13.253068 2231425 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0414 14:06:13.253167 2231425 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0414 14:06:13.253237 2231425 kubeadm.go:310] [certs] Using the existing "sa" key
I0414 14:06:13.253315 2231425 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0414 14:06:13.253390 2231425 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0414 14:06:13.253473 2231425 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0414 14:06:13.253561 2231425 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0414 14:06:13.253644 2231425 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0414 14:06:13.253775 2231425 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0414 14:06:13.253924 2231425 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0414 14:06:13.253995 2231425 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0414 14:06:13.254098 2231425 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0414 14:06:13.255487 2231425 out.go:235] - Booting up control plane ...
I0414 14:06:13.255617 2231425 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0414 14:06:13.255720 2231425 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0414 14:06:13.255804 2231425 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0414 14:06:13.255917 2231425 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0414 14:06:13.256104 2231425 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0414 14:06:13.256175 2231425 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0414 14:06:13.256267 2231425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 14:06:13.256462 2231425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 14:06:13.256588 2231425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 14:06:13.256803 2231425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 14:06:13.256893 2231425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 14:06:13.257063 2231425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 14:06:13.257133 2231425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 14:06:13.257300 2231425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 14:06:13.257358 2231425 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 14:06:13.257520 2231425 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 14:06:13.257527 2231425 kubeadm.go:310]
I0414 14:06:13.257561 2231425 kubeadm.go:310] Unfortunately, an error has occurred:
I0414 14:06:13.257596 2231425 kubeadm.go:310] timed out waiting for the condition
I0414 14:06:13.257602 2231425 kubeadm.go:310]
I0414 14:06:13.257633 2231425 kubeadm.go:310] This error is likely caused by:
I0414 14:06:13.257666 2231425 kubeadm.go:310] - The kubelet is not running
I0414 14:06:13.257756 2231425 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0414 14:06:13.257763 2231425 kubeadm.go:310]
I0414 14:06:13.257905 2231425 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0414 14:06:13.257941 2231425 kubeadm.go:310] - 'systemctl status kubelet'
I0414 14:06:13.257973 2231425 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0414 14:06:13.257979 2231425 kubeadm.go:310]
I0414 14:06:13.258067 2231425 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0414 14:06:13.258141 2231425 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0414 14:06:13.258147 2231425 kubeadm.go:310]
I0414 14:06:13.258242 2231425 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0414 14:06:13.258337 2231425 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0414 14:06:13.258417 2231425 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0414 14:06:13.258496 2231425 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0414 14:06:13.258579 2231425 kubeadm.go:310]
I0414 14:06:13.258589 2231425 kubeadm.go:394] duration metric: took 3m55.993390668s to StartCluster
I0414 14:06:13.258657 2231425 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0414 14:06:13.258719 2231425 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0414 14:06:13.308141 2231425 cri.go:89] found id: ""
I0414 14:06:13.308178 2231425 logs.go:282] 0 containers: []
W0414 14:06:13.308190 2231425 logs.go:284] No container was found matching "kube-apiserver"
I0414 14:06:13.308198 2231425 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0414 14:06:13.308264 2231425 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0414 14:06:13.344971 2231425 cri.go:89] found id: ""
I0414 14:06:13.345000 2231425 logs.go:282] 0 containers: []
W0414 14:06:13.345008 2231425 logs.go:284] No container was found matching "etcd"
I0414 14:06:13.345013 2231425 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0414 14:06:13.345064 2231425 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0414 14:06:13.391927 2231425 cri.go:89] found id: ""
I0414 14:06:13.391968 2231425 logs.go:282] 0 containers: []
W0414 14:06:13.391980 2231425 logs.go:284] No container was found matching "coredns"
I0414 14:06:13.391989 2231425 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0414 14:06:13.392066 2231425 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0414 14:06:13.436277 2231425 cri.go:89] found id: ""
I0414 14:06:13.436315 2231425 logs.go:282] 0 containers: []
W0414 14:06:13.436327 2231425 logs.go:284] No container was found matching "kube-scheduler"
I0414 14:06:13.436336 2231425 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0414 14:06:13.436407 2231425 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0414 14:06:13.471649 2231425 cri.go:89] found id: ""
I0414 14:06:13.471688 2231425 logs.go:282] 0 containers: []
W0414 14:06:13.471701 2231425 logs.go:284] No container was found matching "kube-proxy"
I0414 14:06:13.471709 2231425 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0414 14:06:13.471776 2231425 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0414 14:06:13.516915 2231425 cri.go:89] found id: ""
I0414 14:06:13.516945 2231425 logs.go:282] 0 containers: []
W0414 14:06:13.516957 2231425 logs.go:284] No container was found matching "kube-controller-manager"
I0414 14:06:13.516966 2231425 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0414 14:06:13.517036 2231425 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0414 14:06:13.559136 2231425 cri.go:89] found id: ""
I0414 14:06:13.559172 2231425 logs.go:282] 0 containers: []
W0414 14:06:13.559183 2231425 logs.go:284] No container was found matching "kindnet"
I0414 14:06:13.559197 2231425 logs.go:123] Gathering logs for container status ...
I0414 14:06:13.559216 2231425 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0414 14:06:13.599676 2231425 logs.go:123] Gathering logs for kubelet ...
I0414 14:06:13.599707 2231425 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0414 14:06:13.648298 2231425 logs.go:123] Gathering logs for dmesg ...
I0414 14:06:13.648338 2231425 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0414 14:06:13.662883 2231425 logs.go:123] Gathering logs for describe nodes ...
I0414 14:06:13.662915 2231425 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0414 14:06:13.800402 2231425 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0414 14:06:13.800430 2231425 logs.go:123] Gathering logs for CRI-O ...
I0414 14:06:13.800445 2231425 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
W0414 14:06:13.908074 2231425 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0414 14:06:13.908158 2231425 out.go:270] *
*
W0414 14:06:13.908223 2231425 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0414 14:06:13.908237 2231425 out.go:270] *
*
W0414 14:06:13.909098 2231425 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0414 14:06:13.911951 2231425 out.go:201]
W0414 14:06:13.913031 2231425 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0414 14:06:13.913075 2231425 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0414 14:06:13.913092 2231425 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0414 14:06:13.914442 2231425 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-954411 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-954411 -n old-k8s-version-954411
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-954411 -n old-k8s-version-954411: exit status 6 (247.290715ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0414 14:06:14.214798 2235051 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-954411" does not appear in /home/jenkins/minikube-integration/20623-2183077/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-954411" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (307.36s)