=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-343162 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-343162 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m34.367422529s)
-- stdout --
* [old-k8s-version-343162] minikube v1.33.0-beta.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=16143
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/16143-5297/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/16143-5297/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-343162" primary control-plane node in "old-k8s-version-343162" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0404 22:44:26.162434 58287 out.go:291] Setting OutFile to fd 1 ...
I0404 22:44:26.162604 58287 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0404 22:44:26.162618 58287 out.go:304] Setting ErrFile to fd 2...
I0404 22:44:26.162624 58287 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0404 22:44:26.162932 58287 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16143-5297/.minikube/bin
I0404 22:44:26.163701 58287 out.go:298] Setting JSON to false
I0404 22:44:26.165114 58287 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":5212,"bootTime":1712265455,"procs":296,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1054-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0404 22:44:26.165198 58287 start.go:139] virtualization: kvm guest
I0404 22:44:26.168336 58287 out.go:177] * [old-k8s-version-343162] minikube v1.33.0-beta.0 on Ubuntu 20.04 (kvm/amd64)
I0404 22:44:26.170060 58287 out.go:177] - MINIKUBE_LOCATION=16143
I0404 22:44:26.170115 58287 notify.go:220] Checking for updates...
I0404 22:44:26.173542 58287 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0404 22:44:26.175049 58287 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/16143-5297/kubeconfig
I0404 22:44:26.176657 58287 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/16143-5297/.minikube
I0404 22:44:26.178244 58287 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0404 22:44:26.179894 58287 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0404 22:44:26.181808 58287 config.go:182] Loaded profile config "bridge-063570": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.3
I0404 22:44:26.181955 58287 config.go:182] Loaded profile config "custom-flannel-063570": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.3
I0404 22:44:26.182093 58287 config.go:182] Loaded profile config "flannel-063570": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.3
I0404 22:44:26.182218 58287 driver.go:392] Setting default libvirt URI to qemu:///system
I0404 22:44:26.224216 58287 out.go:177] * Using the kvm2 driver based on user configuration
I0404 22:44:26.225780 58287 start.go:297] selected driver: kvm2
I0404 22:44:26.225797 58287 start.go:901] validating driver "kvm2" against <nil>
I0404 22:44:26.225812 58287 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0404 22:44:26.226611 58287 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0404 22:44:26.226692 58287 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/16143-5297/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0404 22:44:26.244576 58287 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0-beta.0
I0404 22:44:26.244643 58287 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0404 22:44:26.244931 58287 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0404 22:44:26.245024 58287 cni.go:84] Creating CNI manager for ""
I0404 22:44:26.245043 58287 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0404 22:44:26.245054 58287 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0404 22:44:26.245133 58287 start.go:340] cluster config:
{Name:old-k8s-version-343162 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1712138838-18566@sha256:a1b6bbc384c0914baa698cc91ccedcb662b3c0986082ff16cc623c5d83216034 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-343162 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0404 22:44:26.245267 58287 iso.go:125] acquiring lock: {Name:mk16d4e4437dbcbe5e0299079ee219866e46c5aa Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0404 22:44:26.247193 58287 out.go:177] * Starting "old-k8s-version-343162" primary control-plane node in "old-k8s-version-343162" cluster
I0404 22:44:26.248596 58287 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0404 22:44:26.248642 58287 preload.go:147] Found local preload: /home/jenkins/minikube-integration/16143-5297/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0404 22:44:26.248666 58287 cache.go:56] Caching tarball of preloaded images
I0404 22:44:26.248777 58287 preload.go:173] Found /home/jenkins/minikube-integration/16143-5297/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0404 22:44:26.248800 58287 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0404 22:44:26.248909 58287 profile.go:143] Saving config to /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/config.json ...
I0404 22:44:26.248932 58287 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/config.json: {Name:mke1c953d3439c56bfe51c5322d98b54f0a71606 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0404 22:44:26.249094 58287 start.go:360] acquireMachinesLock for old-k8s-version-343162: {Name:mk040ceb559ac497d91e9eaa910f4092c32a416a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0404 22:44:26.249135 58287 start.go:364] duration metric: took 20.098µs to acquireMachinesLock for "old-k8s-version-343162"
I0404 22:44:26.249159 58287 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-343162 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18566/minikube-v1.33.0-1712138767-18566-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1712138838-18566@sha256:a1b6bbc384c0914baa698cc91ccedcb662b3c0986082ff16cc623c5d83216034 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-343162 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0404 22:44:26.249249 58287 start.go:125] createHost starting for "" (driver="kvm2")
I0404 22:44:26.250993 58287 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0404 22:44:26.251194 58287 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0404 22:44:26.251232 58287 main.go:141] libmachine: Launching plugin server for driver kvm2
I0404 22:44:26.268995 58287 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42577
I0404 22:44:26.269472 58287 main.go:141] libmachine: () Calling .GetVersion
I0404 22:44:26.270090 58287 main.go:141] libmachine: Using API Version 1
I0404 22:44:26.270111 58287 main.go:141] libmachine: () Calling .SetConfigRaw
I0404 22:44:26.270495 58287 main.go:141] libmachine: () Calling .GetMachineName
I0404 22:44:26.270698 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetMachineName
I0404 22:44:26.270883 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .DriverName
I0404 22:44:26.271055 58287 start.go:159] libmachine.API.Create for "old-k8s-version-343162" (driver="kvm2")
I0404 22:44:26.271080 58287 client.go:168] LocalClient.Create starting
I0404 22:44:26.271114 58287 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/16143-5297/.minikube/certs/ca.pem
I0404 22:44:26.271149 58287 main.go:141] libmachine: Decoding PEM data...
I0404 22:44:26.271166 58287 main.go:141] libmachine: Parsing certificate...
I0404 22:44:26.271219 58287 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/16143-5297/.minikube/certs/cert.pem
I0404 22:44:26.271236 58287 main.go:141] libmachine: Decoding PEM data...
I0404 22:44:26.271251 58287 main.go:141] libmachine: Parsing certificate...
I0404 22:44:26.271265 58287 main.go:141] libmachine: Running pre-create checks...
I0404 22:44:26.271279 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .PreCreateCheck
I0404 22:44:26.271672 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetConfigRaw
I0404 22:44:26.272091 58287 main.go:141] libmachine: Creating machine...
I0404 22:44:26.272103 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .Create
I0404 22:44:26.272236 58287 main.go:141] libmachine: (old-k8s-version-343162) Creating KVM machine...
I0404 22:44:26.273589 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found existing default KVM network
I0404 22:44:26.275441 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:26.275302 58310 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00026e0d0}
I0404 22:44:26.275484 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | created network xml:
I0404 22:44:26.275503 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | <network>
I0404 22:44:26.275531 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | <name>mk-old-k8s-version-343162</name>
I0404 22:44:26.275554 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | <dns enable='no'/>
I0404 22:44:26.275567 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG |
I0404 22:44:26.275576 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0404 22:44:26.275582 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | <dhcp>
I0404 22:44:26.275599 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0404 22:44:26.275611 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | </dhcp>
I0404 22:44:26.275649 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | </ip>
I0404 22:44:26.275655 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG |
I0404 22:44:26.275660 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | </network>
I0404 22:44:26.275673 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG |
I0404 22:44:26.282375 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | trying to create private KVM network mk-old-k8s-version-343162 192.168.39.0/24...
I0404 22:44:26.361415 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | private KVM network mk-old-k8s-version-343162 192.168.39.0/24 created
I0404 22:44:26.361503 58287 main.go:141] libmachine: (old-k8s-version-343162) Setting up store path in /home/jenkins/minikube-integration/16143-5297/.minikube/machines/old-k8s-version-343162 ...
I0404 22:44:26.361523 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:26.361375 58310 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/16143-5297/.minikube
I0404 22:44:26.361578 58287 main.go:141] libmachine: (old-k8s-version-343162) Building disk image from file:///home/jenkins/minikube-integration/16143-5297/.minikube/cache/iso/amd64/minikube-v1.33.0-1712138767-18566-amd64.iso
I0404 22:44:26.361620 58287 main.go:141] libmachine: (old-k8s-version-343162) Downloading /home/jenkins/minikube-integration/16143-5297/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/16143-5297/.minikube/cache/iso/amd64/minikube-v1.33.0-1712138767-18566-amd64.iso...
I0404 22:44:26.612708 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:26.612568 58310 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/16143-5297/.minikube/machines/old-k8s-version-343162/id_rsa...
I0404 22:44:26.955496 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:26.955340 58310 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/16143-5297/.minikube/machines/old-k8s-version-343162/old-k8s-version-343162.rawdisk...
I0404 22:44:26.955533 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | Writing magic tar header
I0404 22:44:26.955552 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | Writing SSH key tar header
I0404 22:44:26.955565 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:26.955506 58310 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/16143-5297/.minikube/machines/old-k8s-version-343162 ...
I0404 22:44:26.955678 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/16143-5297/.minikube/machines/old-k8s-version-343162
I0404 22:44:26.955712 58287 main.go:141] libmachine: (old-k8s-version-343162) Setting executable bit set on /home/jenkins/minikube-integration/16143-5297/.minikube/machines/old-k8s-version-343162 (perms=drwx------)
I0404 22:44:26.955721 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/16143-5297/.minikube/machines
I0404 22:44:26.955741 58287 main.go:141] libmachine: (old-k8s-version-343162) Setting executable bit set on /home/jenkins/minikube-integration/16143-5297/.minikube/machines (perms=drwxr-xr-x)
I0404 22:44:26.955761 58287 main.go:141] libmachine: (old-k8s-version-343162) Setting executable bit set on /home/jenkins/minikube-integration/16143-5297/.minikube (perms=drwxr-xr-x)
I0404 22:44:26.955785 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/16143-5297/.minikube
I0404 22:44:26.955819 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/16143-5297
I0404 22:44:26.955835 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0404 22:44:26.955853 58287 main.go:141] libmachine: (old-k8s-version-343162) Setting executable bit set on /home/jenkins/minikube-integration/16143-5297 (perms=drwxrwxr-x)
I0404 22:44:26.955866 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | Checking permissions on dir: /home/jenkins
I0404 22:44:26.955891 58287 main.go:141] libmachine: (old-k8s-version-343162) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0404 22:44:26.955905 58287 main.go:141] libmachine: (old-k8s-version-343162) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0404 22:44:26.955921 58287 main.go:141] libmachine: (old-k8s-version-343162) Creating domain...
I0404 22:44:26.955932 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | Checking permissions on dir: /home
I0404 22:44:26.955939 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | Skipping /home - not owner
I0404 22:44:26.957029 58287 main.go:141] libmachine: (old-k8s-version-343162) define libvirt domain using xml:
I0404 22:44:26.957047 58287 main.go:141] libmachine: (old-k8s-version-343162) <domain type='kvm'>
I0404 22:44:26.957065 58287 main.go:141] libmachine: (old-k8s-version-343162) <name>old-k8s-version-343162</name>
I0404 22:44:26.957071 58287 main.go:141] libmachine: (old-k8s-version-343162) <memory unit='MiB'>2200</memory>
I0404 22:44:26.957077 58287 main.go:141] libmachine: (old-k8s-version-343162) <vcpu>2</vcpu>
I0404 22:44:26.957082 58287 main.go:141] libmachine: (old-k8s-version-343162) <features>
I0404 22:44:26.957087 58287 main.go:141] libmachine: (old-k8s-version-343162) <acpi/>
I0404 22:44:26.957092 58287 main.go:141] libmachine: (old-k8s-version-343162) <apic/>
I0404 22:44:26.957097 58287 main.go:141] libmachine: (old-k8s-version-343162) <pae/>
I0404 22:44:26.957104 58287 main.go:141] libmachine: (old-k8s-version-343162)
I0404 22:44:26.957112 58287 main.go:141] libmachine: (old-k8s-version-343162) </features>
I0404 22:44:26.957117 58287 main.go:141] libmachine: (old-k8s-version-343162) <cpu mode='host-passthrough'>
I0404 22:44:26.957125 58287 main.go:141] libmachine: (old-k8s-version-343162)
I0404 22:44:26.957129 58287 main.go:141] libmachine: (old-k8s-version-343162) </cpu>
I0404 22:44:26.957135 58287 main.go:141] libmachine: (old-k8s-version-343162) <os>
I0404 22:44:26.957143 58287 main.go:141] libmachine: (old-k8s-version-343162) <type>hvm</type>
I0404 22:44:26.957152 58287 main.go:141] libmachine: (old-k8s-version-343162) <boot dev='cdrom'/>
I0404 22:44:26.957159 58287 main.go:141] libmachine: (old-k8s-version-343162) <boot dev='hd'/>
I0404 22:44:26.957165 58287 main.go:141] libmachine: (old-k8s-version-343162) <bootmenu enable='no'/>
I0404 22:44:26.957171 58287 main.go:141] libmachine: (old-k8s-version-343162) </os>
I0404 22:44:26.957176 58287 main.go:141] libmachine: (old-k8s-version-343162) <devices>
I0404 22:44:26.957182 58287 main.go:141] libmachine: (old-k8s-version-343162) <disk type='file' device='cdrom'>
I0404 22:44:26.957191 58287 main.go:141] libmachine: (old-k8s-version-343162) <source file='/home/jenkins/minikube-integration/16143-5297/.minikube/machines/old-k8s-version-343162/boot2docker.iso'/>
I0404 22:44:26.957199 58287 main.go:141] libmachine: (old-k8s-version-343162) <target dev='hdc' bus='scsi'/>
I0404 22:44:26.957204 58287 main.go:141] libmachine: (old-k8s-version-343162) <readonly/>
I0404 22:44:26.957208 58287 main.go:141] libmachine: (old-k8s-version-343162) </disk>
I0404 22:44:26.957214 58287 main.go:141] libmachine: (old-k8s-version-343162) <disk type='file' device='disk'>
I0404 22:44:26.957221 58287 main.go:141] libmachine: (old-k8s-version-343162) <driver name='qemu' type='raw' cache='default' io='threads' />
I0404 22:44:26.957240 58287 main.go:141] libmachine: (old-k8s-version-343162) <source file='/home/jenkins/minikube-integration/16143-5297/.minikube/machines/old-k8s-version-343162/old-k8s-version-343162.rawdisk'/>
I0404 22:44:26.957248 58287 main.go:141] libmachine: (old-k8s-version-343162) <target dev='hda' bus='virtio'/>
I0404 22:44:26.957253 58287 main.go:141] libmachine: (old-k8s-version-343162) </disk>
I0404 22:44:26.957267 58287 main.go:141] libmachine: (old-k8s-version-343162) <interface type='network'>
I0404 22:44:26.957273 58287 main.go:141] libmachine: (old-k8s-version-343162) <source network='mk-old-k8s-version-343162'/>
I0404 22:44:26.957278 58287 main.go:141] libmachine: (old-k8s-version-343162) <model type='virtio'/>
I0404 22:44:26.957283 58287 main.go:141] libmachine: (old-k8s-version-343162) </interface>
I0404 22:44:26.957289 58287 main.go:141] libmachine: (old-k8s-version-343162) <interface type='network'>
I0404 22:44:26.957295 58287 main.go:141] libmachine: (old-k8s-version-343162) <source network='default'/>
I0404 22:44:26.957300 58287 main.go:141] libmachine: (old-k8s-version-343162) <model type='virtio'/>
I0404 22:44:26.957310 58287 main.go:141] libmachine: (old-k8s-version-343162) </interface>
I0404 22:44:26.957321 58287 main.go:141] libmachine: (old-k8s-version-343162) <serial type='pty'>
I0404 22:44:26.957330 58287 main.go:141] libmachine: (old-k8s-version-343162) <target port='0'/>
I0404 22:44:26.957336 58287 main.go:141] libmachine: (old-k8s-version-343162) </serial>
I0404 22:44:26.957345 58287 main.go:141] libmachine: (old-k8s-version-343162) <console type='pty'>
I0404 22:44:26.957352 58287 main.go:141] libmachine: (old-k8s-version-343162) <target type='serial' port='0'/>
I0404 22:44:26.957359 58287 main.go:141] libmachine: (old-k8s-version-343162) </console>
I0404 22:44:26.957368 58287 main.go:141] libmachine: (old-k8s-version-343162) <rng model='virtio'>
I0404 22:44:26.957387 58287 main.go:141] libmachine: (old-k8s-version-343162) <backend model='random'>/dev/random</backend>
I0404 22:44:26.957399 58287 main.go:141] libmachine: (old-k8s-version-343162) </rng>
I0404 22:44:26.957412 58287 main.go:141] libmachine: (old-k8s-version-343162)
I0404 22:44:26.957423 58287 main.go:141] libmachine: (old-k8s-version-343162)
I0404 22:44:26.957433 58287 main.go:141] libmachine: (old-k8s-version-343162) </devices>
I0404 22:44:26.957442 58287 main.go:141] libmachine: (old-k8s-version-343162) </domain>
I0404 22:44:26.957453 58287 main.go:141] libmachine: (old-k8s-version-343162)
I0404 22:44:26.961868 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:f2:c1:d9 in network default
I0404 22:44:26.962525 58287 main.go:141] libmachine: (old-k8s-version-343162) Ensuring networks are active...
I0404 22:44:26.962549 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:26.963360 58287 main.go:141] libmachine: (old-k8s-version-343162) Ensuring network default is active
I0404 22:44:26.963793 58287 main.go:141] libmachine: (old-k8s-version-343162) Ensuring network mk-old-k8s-version-343162 is active
I0404 22:44:26.964367 58287 main.go:141] libmachine: (old-k8s-version-343162) Getting domain xml...
I0404 22:44:26.965143 58287 main.go:141] libmachine: (old-k8s-version-343162) Creating domain...
I0404 22:44:28.292324 58287 main.go:141] libmachine: (old-k8s-version-343162) Waiting to get IP...
I0404 22:44:28.293222 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:28.293794 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | unable to find current IP address of domain old-k8s-version-343162 in network mk-old-k8s-version-343162
I0404 22:44:28.293822 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:28.293753 58310 retry.go:31] will retry after 197.288115ms: waiting for machine to come up
I0404 22:44:28.492976 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:28.493723 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | unable to find current IP address of domain old-k8s-version-343162 in network mk-old-k8s-version-343162
I0404 22:44:28.493753 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:28.493651 58310 retry.go:31] will retry after 389.88842ms: waiting for machine to come up
I0404 22:44:28.885533 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:28.886100 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | unable to find current IP address of domain old-k8s-version-343162 in network mk-old-k8s-version-343162
I0404 22:44:28.886132 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:28.886041 58310 retry.go:31] will retry after 389.072072ms: waiting for machine to come up
I0404 22:44:29.276452 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:29.276938 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | unable to find current IP address of domain old-k8s-version-343162 in network mk-old-k8s-version-343162
I0404 22:44:29.276969 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:29.276893 58310 retry.go:31] will retry after 569.231142ms: waiting for machine to come up
I0404 22:44:29.847899 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:29.848532 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | unable to find current IP address of domain old-k8s-version-343162 in network mk-old-k8s-version-343162
I0404 22:44:29.848564 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:29.848482 58310 retry.go:31] will retry after 762.209539ms: waiting for machine to come up
I0404 22:44:30.612667 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:30.613343 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | unable to find current IP address of domain old-k8s-version-343162 in network mk-old-k8s-version-343162
I0404 22:44:30.613365 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:30.613307 58310 retry.go:31] will retry after 852.84329ms: waiting for machine to come up
I0404 22:44:31.467371 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:31.467952 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | unable to find current IP address of domain old-k8s-version-343162 in network mk-old-k8s-version-343162
I0404 22:44:31.467991 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:31.467899 58310 retry.go:31] will retry after 987.358603ms: waiting for machine to come up
I0404 22:44:32.456717 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:32.457333 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | unable to find current IP address of domain old-k8s-version-343162 in network mk-old-k8s-version-343162
I0404 22:44:32.457361 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:32.457286 58310 retry.go:31] will retry after 1.27245072s: waiting for machine to come up
I0404 22:44:33.732038 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:33.732580 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | unable to find current IP address of domain old-k8s-version-343162 in network mk-old-k8s-version-343162
I0404 22:44:33.732608 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:33.732532 58310 retry.go:31] will retry after 1.465115367s: waiting for machine to come up
I0404 22:44:35.199102 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:35.199719 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | unable to find current IP address of domain old-k8s-version-343162 in network mk-old-k8s-version-343162
I0404 22:44:35.199745 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:35.199668 58310 retry.go:31] will retry after 1.464632196s: waiting for machine to come up
I0404 22:44:36.665693 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:36.666236 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | unable to find current IP address of domain old-k8s-version-343162 in network mk-old-k8s-version-343162
I0404 22:44:36.666265 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:36.666171 58310 retry.go:31] will retry after 1.882272946s: waiting for machine to come up
I0404 22:44:38.550414 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:38.551119 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | unable to find current IP address of domain old-k8s-version-343162 in network mk-old-k8s-version-343162
I0404 22:44:38.551155 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:38.551070 58310 retry.go:31] will retry after 3.231003855s: waiting for machine to come up
I0404 22:44:41.784505 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:41.785174 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | unable to find current IP address of domain old-k8s-version-343162 in network mk-old-k8s-version-343162
I0404 22:44:41.785202 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:41.785144 58310 retry.go:31] will retry after 4.286636086s: waiting for machine to come up
I0404 22:44:46.076469 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:46.076904 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | unable to find current IP address of domain old-k8s-version-343162 in network mk-old-k8s-version-343162
I0404 22:44:46.076932 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | I0404 22:44:46.076863 58310 retry.go:31] will retry after 3.579438214s: waiting for machine to come up
I0404 22:44:50.193856 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:50.194507 58287 main.go:141] libmachine: (old-k8s-version-343162) Found IP for machine: 192.168.39.247
I0404 22:44:50.194552 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has current primary IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:50.194568 58287 main.go:141] libmachine: (old-k8s-version-343162) Reserving static IP address...
I0404 22:44:50.194960 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-343162", mac: "52:54:00:74:db:c6", ip: "192.168.39.247"} in network mk-old-k8s-version-343162
I0404 22:44:50.276597 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | Getting to WaitForSSH function...
I0404 22:44:50.276622 58287 main.go:141] libmachine: (old-k8s-version-343162) Reserved static IP address: 192.168.39.247
I0404 22:44:50.276635 58287 main.go:141] libmachine: (old-k8s-version-343162) Waiting for SSH to be available...
I0404 22:44:50.279869 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:50.280416 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:minikube Clientid:01:52:54:00:74:db:c6}
I0404 22:44:50.280445 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:50.280607 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | Using SSH client type: external
I0404 22:44:50.280647 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | Using SSH private key: /home/jenkins/minikube-integration/16143-5297/.minikube/machines/old-k8s-version-343162/id_rsa (-rw-------)
I0404 22:44:50.280687 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.247 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/16143-5297/.minikube/machines/old-k8s-version-343162/id_rsa -p 22] /usr/bin/ssh <nil>}
I0404 22:44:50.280710 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | About to run SSH command:
I0404 22:44:50.280729 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | exit 0
I0404 22:44:50.409383 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | SSH cmd err, output: <nil>:
I0404 22:44:50.409948 58287 main.go:141] libmachine: (old-k8s-version-343162) KVM machine creation complete!
I0404 22:44:50.410416 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetConfigRaw
I0404 22:44:50.411089 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .DriverName
I0404 22:44:50.411345 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .DriverName
I0404 22:44:50.411520 58287 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0404 22:44:50.411543 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetState
I0404 22:44:50.413044 58287 main.go:141] libmachine: Detecting operating system of created instance...
I0404 22:44:50.413062 58287 main.go:141] libmachine: Waiting for SSH to be available...
I0404 22:44:50.413071 58287 main.go:141] libmachine: Getting to WaitForSSH function...
I0404 22:44:50.413081 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHHostname
I0404 22:44:50.415745 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:50.416163 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:old-k8s-version-343162 Clientid:01:52:54:00:74:db:c6}
I0404 22:44:50.416183 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:50.416433 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHPort
I0404 22:44:50.416600 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHKeyPath
I0404 22:44:50.416778 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHKeyPath
I0404 22:44:50.416985 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHUsername
I0404 22:44:50.417176 58287 main.go:141] libmachine: Using SSH client type: native
I0404 22:44:50.417383 58287 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.39.247 22 <nil> <nil>}
I0404 22:44:50.417400 58287 main.go:141] libmachine: About to run SSH command:
exit 0
I0404 22:44:50.531667 58287 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0404 22:44:50.531694 58287 main.go:141] libmachine: Detecting the provisioner...
I0404 22:44:50.531704 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHHostname
I0404 22:44:50.534817 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:50.535301 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:old-k8s-version-343162 Clientid:01:52:54:00:74:db:c6}
I0404 22:44:50.535332 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:50.535533 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHPort
I0404 22:44:50.535745 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHKeyPath
I0404 22:44:50.535966 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHKeyPath
I0404 22:44:50.536136 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHUsername
I0404 22:44:50.536393 58287 main.go:141] libmachine: Using SSH client type: native
I0404 22:44:50.536589 58287 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.39.247 22 <nil> <nil>}
I0404 22:44:50.536605 58287 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0404 22:44:50.645571 58287 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0404 22:44:50.645647 58287 main.go:141] libmachine: found compatible host: buildroot
I0404 22:44:50.645663 58287 main.go:141] libmachine: Provisioning with buildroot...
I0404 22:44:50.645679 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetMachineName
I0404 22:44:50.645906 58287 buildroot.go:166] provisioning hostname "old-k8s-version-343162"
I0404 22:44:50.645927 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetMachineName
I0404 22:44:50.646111 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHHostname
I0404 22:44:50.648920 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:50.649259 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:old-k8s-version-343162 Clientid:01:52:54:00:74:db:c6}
I0404 22:44:50.649286 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:50.649457 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHPort
I0404 22:44:50.649654 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHKeyPath
I0404 22:44:50.649829 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHKeyPath
I0404 22:44:50.649994 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHUsername
I0404 22:44:50.650190 58287 main.go:141] libmachine: Using SSH client type: native
I0404 22:44:50.650447 58287 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.39.247 22 <nil> <nil>}
I0404 22:44:50.650465 58287 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-343162 && echo "old-k8s-version-343162" | sudo tee /etc/hostname
I0404 22:44:50.772679 58287 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-343162
I0404 22:44:50.772712 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHHostname
I0404 22:44:50.775821 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:50.776300 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:old-k8s-version-343162 Clientid:01:52:54:00:74:db:c6}
I0404 22:44:50.776330 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:50.776564 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHPort
I0404 22:44:50.776778 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHKeyPath
I0404 22:44:50.776994 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHKeyPath
I0404 22:44:50.777180 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHUsername
I0404 22:44:50.777358 58287 main.go:141] libmachine: Using SSH client type: native
I0404 22:44:50.777526 58287 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.39.247 22 <nil> <nil>}
I0404 22:44:50.777542 58287 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-343162' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-343162/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-343162' | sudo tee -a /etc/hosts;
fi
fi
I0404 22:44:50.890164 58287 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0404 22:44:50.890193 58287 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/16143-5297/.minikube CaCertPath:/home/jenkins/minikube-integration/16143-5297/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/16143-5297/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/16143-5297/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/16143-5297/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/16143-5297/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/16143-5297/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/16143-5297/.minikube}
I0404 22:44:50.890211 58287 buildroot.go:174] setting up certificates
I0404 22:44:50.890242 58287 provision.go:84] configureAuth start
I0404 22:44:50.890250 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetMachineName
I0404 22:44:50.890541 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetIP
I0404 22:44:50.893634 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:50.894023 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:old-k8s-version-343162 Clientid:01:52:54:00:74:db:c6}
I0404 22:44:50.894043 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:50.894172 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHHostname
I0404 22:44:50.896832 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:50.897185 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:old-k8s-version-343162 Clientid:01:52:54:00:74:db:c6}
I0404 22:44:50.897213 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:50.897391 58287 provision.go:143] copyHostCerts
I0404 22:44:50.897469 58287 exec_runner.go:144] found /home/jenkins/minikube-integration/16143-5297/.minikube/ca.pem, removing ...
I0404 22:44:50.897483 58287 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16143-5297/.minikube/ca.pem
I0404 22:44:50.897569 58287 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16143-5297/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/16143-5297/.minikube/ca.pem (1078 bytes)
I0404 22:44:50.897727 58287 exec_runner.go:144] found /home/jenkins/minikube-integration/16143-5297/.minikube/cert.pem, removing ...
I0404 22:44:50.897747 58287 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16143-5297/.minikube/cert.pem
I0404 22:44:50.897795 58287 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16143-5297/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/16143-5297/.minikube/cert.pem (1123 bytes)
I0404 22:44:50.897857 58287 exec_runner.go:144] found /home/jenkins/minikube-integration/16143-5297/.minikube/key.pem, removing ...
I0404 22:44:50.897865 58287 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16143-5297/.minikube/key.pem
I0404 22:44:50.897888 58287 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16143-5297/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/16143-5297/.minikube/key.pem (1675 bytes)
I0404 22:44:50.897932 58287 provision.go:117] generating server cert: /home/jenkins/minikube-integration/16143-5297/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/16143-5297/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/16143-5297/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-343162 san=[127.0.0.1 192.168.39.247 localhost minikube old-k8s-version-343162]
I0404 22:44:51.070090 58287 provision.go:177] copyRemoteCerts
I0404 22:44:51.070144 58287 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0404 22:44:51.070172 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHHostname
I0404 22:44:51.072821 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.073276 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:old-k8s-version-343162 Clientid:01:52:54:00:74:db:c6}
I0404 22:44:51.073304 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.073535 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHPort
I0404 22:44:51.073709 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHKeyPath
I0404 22:44:51.073868 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHUsername
I0404 22:44:51.073991 58287 sshutil.go:53] new ssh client: &{IP:192.168.39.247 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/16143-5297/.minikube/machines/old-k8s-version-343162/id_rsa Username:docker}
I0404 22:44:51.156211 58287 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16143-5297/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0404 22:44:51.185329 58287 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16143-5297/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0404 22:44:51.214358 58287 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16143-5297/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0404 22:44:51.242098 58287 provision.go:87] duration metric: took 351.844043ms to configureAuth
I0404 22:44:51.242123 58287 buildroot.go:189] setting minikube options for container-runtime
I0404 22:44:51.242325 58287 config.go:182] Loaded profile config "old-k8s-version-343162": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0404 22:44:51.242414 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHHostname
I0404 22:44:51.244937 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.245312 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:old-k8s-version-343162 Clientid:01:52:54:00:74:db:c6}
I0404 22:44:51.245345 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.245531 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHPort
I0404 22:44:51.245712 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHKeyPath
I0404 22:44:51.245885 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHKeyPath
I0404 22:44:51.246024 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHUsername
I0404 22:44:51.246149 58287 main.go:141] libmachine: Using SSH client type: native
I0404 22:44:51.246359 58287 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.39.247 22 <nil> <nil>}
I0404 22:44:51.246381 58287 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0404 22:44:51.538334 58287 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0404 22:44:51.538381 58287 main.go:141] libmachine: Checking connection to Docker...
I0404 22:44:51.538392 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetURL
I0404 22:44:51.540039 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | Using libvirt version 6000000
I0404 22:44:51.542780 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.543207 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:old-k8s-version-343162 Clientid:01:52:54:00:74:db:c6}
I0404 22:44:51.543240 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.543383 58287 main.go:141] libmachine: Docker is up and running!
I0404 22:44:51.543401 58287 main.go:141] libmachine: Reticulating splines...
I0404 22:44:51.543408 58287 client.go:171] duration metric: took 25.272319482s to LocalClient.Create
I0404 22:44:51.543445 58287 start.go:167] duration metric: took 25.272378054s to libmachine.API.Create "old-k8s-version-343162"
I0404 22:44:51.543454 58287 start.go:293] postStartSetup for "old-k8s-version-343162" (driver="kvm2")
I0404 22:44:51.543463 58287 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0404 22:44:51.543480 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .DriverName
I0404 22:44:51.543707 58287 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0404 22:44:51.543729 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHHostname
I0404 22:44:51.546369 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.546743 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:old-k8s-version-343162 Clientid:01:52:54:00:74:db:c6}
I0404 22:44:51.546774 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.546967 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHPort
I0404 22:44:51.547141 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHKeyPath
I0404 22:44:51.547319 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHUsername
I0404 22:44:51.547489 58287 sshutil.go:53] new ssh client: &{IP:192.168.39.247 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/16143-5297/.minikube/machines/old-k8s-version-343162/id_rsa Username:docker}
I0404 22:44:51.631645 58287 ssh_runner.go:195] Run: cat /etc/os-release
I0404 22:44:51.636550 58287 info.go:137] Remote host: Buildroot 2023.02.9
I0404 22:44:51.636574 58287 filesync.go:126] Scanning /home/jenkins/minikube-integration/16143-5297/.minikube/addons for local assets ...
I0404 22:44:51.636650 58287 filesync.go:126] Scanning /home/jenkins/minikube-integration/16143-5297/.minikube/files for local assets ...
I0404 22:44:51.636740 58287 filesync.go:149] local asset: /home/jenkins/minikube-integration/16143-5297/.minikube/files/etc/ssl/certs/125542.pem -> 125542.pem in /etc/ssl/certs
I0404 22:44:51.636850 58287 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0404 22:44:51.647161 58287 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16143-5297/.minikube/files/etc/ssl/certs/125542.pem --> /etc/ssl/certs/125542.pem (1708 bytes)
I0404 22:44:51.673222 58287 start.go:296] duration metric: took 129.754595ms for postStartSetup
I0404 22:44:51.673297 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetConfigRaw
I0404 22:44:51.673910 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetIP
I0404 22:44:51.676751 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.677149 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:old-k8s-version-343162 Clientid:01:52:54:00:74:db:c6}
I0404 22:44:51.677177 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.677414 58287 profile.go:143] Saving config to /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/config.json ...
I0404 22:44:51.677612 58287 start.go:128] duration metric: took 25.428353737s to createHost
I0404 22:44:51.677636 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHHostname
I0404 22:44:51.680271 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.680687 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:old-k8s-version-343162 Clientid:01:52:54:00:74:db:c6}
I0404 22:44:51.680720 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.680843 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHPort
I0404 22:44:51.681044 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHKeyPath
I0404 22:44:51.681241 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHKeyPath
I0404 22:44:51.681390 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHUsername
I0404 22:44:51.681561 58287 main.go:141] libmachine: Using SSH client type: native
I0404 22:44:51.681776 58287 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4a0] 0x830200 <nil> [] 0s} 192.168.39.247 22 <nil> <nil>}
I0404 22:44:51.681812 58287 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0404 22:44:51.790847 58287 main.go:141] libmachine: SSH cmd err, output: <nil>: 1712270691.758618761
I0404 22:44:51.790871 58287 fix.go:216] guest clock: 1712270691.758618761
I0404 22:44:51.790880 58287 fix.go:229] Guest: 2024-04-04 22:44:51.758618761 +0000 UTC Remote: 2024-04-04 22:44:51.677624378 +0000 UTC m=+25.572073026 (delta=80.994383ms)
I0404 22:44:51.790905 58287 fix.go:200] guest clock delta is within tolerance: 80.994383ms
I0404 22:44:51.790912 58287 start.go:83] releasing machines lock for "old-k8s-version-343162", held for 25.541769997s
I0404 22:44:51.790939 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .DriverName
I0404 22:44:51.791242 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetIP
I0404 22:44:51.794607 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.795057 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:old-k8s-version-343162 Clientid:01:52:54:00:74:db:c6}
I0404 22:44:51.795087 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.795268 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .DriverName
I0404 22:44:51.795894 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .DriverName
I0404 22:44:51.796076 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .DriverName
I0404 22:44:51.796196 58287 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0404 22:44:51.796236 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHHostname
I0404 22:44:51.796330 58287 ssh_runner.go:195] Run: cat /version.json
I0404 22:44:51.796360 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHHostname
I0404 22:44:51.799260 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.799409 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.799764 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:old-k8s-version-343162 Clientid:01:52:54:00:74:db:c6}
I0404 22:44:51.799796 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:old-k8s-version-343162 Clientid:01:52:54:00:74:db:c6}
I0404 22:44:51.799816 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.799900 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:51.799999 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHPort
I0404 22:44:51.800222 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHPort
I0404 22:44:51.800218 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHKeyPath
I0404 22:44:51.800394 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHKeyPath
I0404 22:44:51.800437 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHUsername
I0404 22:44:51.800569 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetSSHUsername
I0404 22:44:51.800650 58287 sshutil.go:53] new ssh client: &{IP:192.168.39.247 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/16143-5297/.minikube/machines/old-k8s-version-343162/id_rsa Username:docker}
I0404 22:44:51.800743 58287 sshutil.go:53] new ssh client: &{IP:192.168.39.247 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/16143-5297/.minikube/machines/old-k8s-version-343162/id_rsa Username:docker}
I0404 22:44:51.922205 58287 ssh_runner.go:195] Run: systemctl --version
I0404 22:44:51.931730 58287 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0404 22:44:52.110027 58287 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0404 22:44:52.116906 58287 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0404 22:44:52.116984 58287 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0404 22:44:52.136040 58287 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0404 22:44:52.136067 58287 start.go:494] detecting cgroup driver to use...
I0404 22:44:52.136159 58287 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0404 22:44:52.156087 58287 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0404 22:44:52.174271 58287 docker.go:217] disabling cri-docker service (if available) ...
I0404 22:44:52.174335 58287 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0404 22:44:52.194532 58287 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0404 22:44:52.211732 58287 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0404 22:44:52.399861 58287 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0404 22:44:52.623231 58287 docker.go:233] disabling docker service ...
I0404 22:44:52.623294 58287 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0404 22:44:52.645765 58287 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0404 22:44:52.659725 58287 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0404 22:44:52.851038 58287 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0404 22:44:53.001607 58287 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0404 22:44:53.020529 58287 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0404 22:44:53.043936 58287 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0404 22:44:53.044010 58287 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0404 22:44:53.057385 58287 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0404 22:44:53.057447 58287 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0404 22:44:53.069948 58287 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0404 22:44:53.084587 58287 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0404 22:44:53.097985 58287 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0404 22:44:53.112049 58287 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0404 22:44:53.124320 58287 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0404 22:44:53.124394 58287 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0404 22:44:53.141451 58287 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0404 22:44:53.155764 58287 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0404 22:44:53.318539 58287 ssh_runner.go:195] Run: sudo systemctl restart crio
I0404 22:44:53.493590 58287 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0404 22:44:53.493678 58287 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0404 22:44:53.499310 58287 start.go:562] Will wait 60s for crictl version
I0404 22:44:53.499370 58287 ssh_runner.go:195] Run: which crictl
I0404 22:44:53.503651 58287 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0404 22:44:53.544514 58287 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0404 22:44:53.544608 58287 ssh_runner.go:195] Run: crio --version
I0404 22:44:53.579226 58287 ssh_runner.go:195] Run: crio --version
I0404 22:44:53.613681 58287 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0404 22:44:53.615083 58287 main.go:141] libmachine: (old-k8s-version-343162) Calling .GetIP
I0404 22:44:53.618330 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:53.618717 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:74:db:c6", ip: ""} in network mk-old-k8s-version-343162: {Iface:virbr1 ExpiryTime:2024-04-04 23:44:43 +0000 UTC Type:0 Mac:52:54:00:74:db:c6 Iaid: IPaddr:192.168.39.247 Prefix:24 Hostname:old-k8s-version-343162 Clientid:01:52:54:00:74:db:c6}
I0404 22:44:53.618746 58287 main.go:141] libmachine: (old-k8s-version-343162) DBG | domain old-k8s-version-343162 has defined IP address 192.168.39.247 and MAC address 52:54:00:74:db:c6 in network mk-old-k8s-version-343162
I0404 22:44:53.618983 58287 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0404 22:44:53.624537 58287 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0404 22:44:53.640644 58287 kubeadm.go:877] updating cluster {Name:old-k8s-version-343162 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18566/minikube-v1.33.0-1712138767-18566-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1712138838-18566@sha256:a1b6bbc384c0914baa698cc91ccedcb662b3c0986082ff16cc623c5d83216034 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-343162 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.247 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0404 22:44:53.640753 58287 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0404 22:44:53.640820 58287 ssh_runner.go:195] Run: sudo crictl images --output json
I0404 22:44:53.683261 58287 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0404 22:44:53.683340 58287 ssh_runner.go:195] Run: which lz4
I0404 22:44:53.688308 58287 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0404 22:44:53.693294 58287 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0404 22:44:53.693343 58287 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16143-5297/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0404 22:44:55.745286 58287 crio.go:462] duration metric: took 2.057007723s to copy over tarball
I0404 22:44:55.745365 58287 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0404 22:44:58.988075 58287 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.242682056s)
I0404 22:44:58.988103 58287 crio.go:469] duration metric: took 3.242785784s to extract the tarball
I0404 22:44:58.988111 58287 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0404 22:44:59.035097 58287 ssh_runner.go:195] Run: sudo crictl images --output json
I0404 22:44:59.099761 58287 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0404 22:44:59.099783 58287 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0404 22:44:59.099877 58287 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0404 22:44:59.099894 58287 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0404 22:44:59.099908 58287 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0404 22:44:59.099932 58287 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0404 22:44:59.099950 58287 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0404 22:44:59.099975 58287 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0404 22:44:59.100139 58287 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0404 22:44:59.099875 58287 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0404 22:44:59.101688 58287 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0404 22:44:59.101873 58287 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0404 22:44:59.101949 58287 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0404 22:44:59.102043 58287 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0404 22:44:59.102141 58287 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0404 22:44:59.102169 58287 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0404 22:44:59.102304 58287 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0404 22:44:59.102386 58287 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0404 22:44:59.294171 58287 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0404 22:44:59.302608 58287 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0404 22:44:59.325906 58287 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0404 22:44:59.329741 58287 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0404 22:44:59.332951 58287 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0404 22:44:59.381348 58287 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0404 22:44:59.381385 58287 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0404 22:44:59.381429 58287 ssh_runner.go:195] Run: which crictl
I0404 22:44:59.397462 58287 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0404 22:44:59.413188 58287 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0404 22:44:59.413235 58287 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0404 22:44:59.413293 58287 ssh_runner.go:195] Run: which crictl
I0404 22:44:59.468170 58287 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0404 22:44:59.468215 58287 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0404 22:44:59.468231 58287 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0404 22:44:59.468257 58287 ssh_runner.go:195] Run: which crictl
I0404 22:44:59.468268 58287 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0404 22:44:59.468304 58287 ssh_runner.go:195] Run: which crictl
I0404 22:44:59.477017 58287 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0404 22:44:59.481135 58287 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0404 22:44:59.481228 58287 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0404 22:44:59.481265 58287 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0404 22:44:59.481291 58287 ssh_runner.go:195] Run: which crictl
I0404 22:44:59.516921 58287 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0404 22:44:59.516954 58287 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0404 22:44:59.516999 58287 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0404 22:44:59.517036 58287 ssh_runner.go:195] Run: which crictl
I0404 22:44:59.517045 58287 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0404 22:44:59.517101 58287 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0404 22:44:59.590140 58287 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16143-5297/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0404 22:44:59.590166 58287 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0404 22:44:59.590237 58287 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0404 22:44:59.590324 58287 ssh_runner.go:195] Run: which crictl
I0404 22:44:59.590246 58287 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0404 22:44:59.665717 58287 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16143-5297/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0404 22:44:59.674034 58287 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0404 22:44:59.674139 58287 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16143-5297/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0404 22:44:59.674214 58287 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16143-5297/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0404 22:44:59.674220 58287 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0404 22:44:59.674429 58287 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16143-5297/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0404 22:44:59.733490 58287 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16143-5297/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0404 22:44:59.733546 58287 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16143-5297/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0404 22:44:59.985163 58287 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0404 22:45:00.141855 58287 cache_images.go:92] duration metric: took 1.042048359s to LoadCachedImages
W0404 22:45:00.141961 58287 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/16143-5297/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/16143-5297/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
I0404 22:45:00.141982 58287 kubeadm.go:928] updating node { 192.168.39.247 8443 v1.20.0 crio true true} ...
I0404 22:45:00.142110 58287 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-343162 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.247
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-343162 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0404 22:45:00.142212 58287 ssh_runner.go:195] Run: crio config
I0404 22:45:00.212094 58287 cni.go:84] Creating CNI manager for ""
I0404 22:45:00.212138 58287 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0404 22:45:00.212150 58287 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0404 22:45:00.212175 58287 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.247 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-343162 NodeName:old-k8s-version-343162 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.247"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.247 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0404 22:45:00.212384 58287 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.247
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-343162"
kubeletExtraArgs:
node-ip: 192.168.39.247
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.247"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0404 22:45:00.212449 58287 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0404 22:45:00.226233 58287 binaries.go:44] Found k8s binaries, skipping transfer
I0404 22:45:00.226287 58287 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0404 22:45:00.238043 58287 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0404 22:45:00.260367 58287 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0404 22:45:00.281077 58287 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0404 22:45:00.301184 58287 ssh_runner.go:195] Run: grep 192.168.39.247 control-plane.minikube.internal$ /etc/hosts
I0404 22:45:00.305583 58287 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.247 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0404 22:45:00.320452 58287 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0404 22:45:00.469165 58287 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0404 22:45:00.489549 58287 certs.go:68] Setting up /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162 for IP: 192.168.39.247
I0404 22:45:00.489581 58287 certs.go:194] generating shared ca certs ...
I0404 22:45:00.489602 58287 certs.go:226] acquiring lock for ca certs: {Name:mk4fe47cf6261777bba3fe41345d36a5795d4a76 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0404 22:45:00.489791 58287 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/16143-5297/.minikube/ca.key
I0404 22:45:00.489847 58287 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/16143-5297/.minikube/proxy-client-ca.key
I0404 22:45:00.489857 58287 certs.go:256] generating profile certs ...
I0404 22:45:00.489925 58287 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/client.key
I0404 22:45:00.489938 58287 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/client.crt with IP's: []
I0404 22:45:00.600905 58287 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/client.crt ...
I0404 22:45:00.600935 58287 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/client.crt: {Name:mk54f9f1612caced32be219199f158fb042fe7ee Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0404 22:45:00.601123 58287 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/client.key ...
I0404 22:45:00.601150 58287 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/client.key: {Name:mk13969b3bb0828a24bdc3988d9a6dd0026d2a4d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0404 22:45:00.601255 58287 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/apiserver.key.184368d7
I0404 22:45:00.601279 58287 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/apiserver.crt.184368d7 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.247]
I0404 22:45:00.844136 58287 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/apiserver.crt.184368d7 ...
I0404 22:45:00.844171 58287 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/apiserver.crt.184368d7: {Name:mkf056b03c2f25f1a7abc2335073f4ee43d60a63 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0404 22:45:00.844372 58287 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/apiserver.key.184368d7 ...
I0404 22:45:00.844400 58287 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/apiserver.key.184368d7: {Name:mk5b871efb52751dcaf6b3518d18d8d5cbbbbec5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0404 22:45:00.844495 58287 certs.go:381] copying /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/apiserver.crt.184368d7 -> /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/apiserver.crt
I0404 22:45:00.844590 58287 certs.go:385] copying /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/apiserver.key.184368d7 -> /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/apiserver.key
I0404 22:45:00.844649 58287 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/proxy-client.key
I0404 22:45:00.844664 58287 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/proxy-client.crt with IP's: []
I0404 22:45:01.094794 58287 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/proxy-client.crt ...
I0404 22:45:01.094829 58287 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/proxy-client.crt: {Name:mk2776131d0a6646fa3ff672c6fc4807fe19190f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0404 22:45:01.095019 58287 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/proxy-client.key ...
I0404 22:45:01.095036 58287 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/proxy-client.key: {Name:mkcedd13c3344ca6ec1bbbf49acc8f616caab82d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0404 22:45:01.095261 58287 certs.go:484] found cert: /home/jenkins/minikube-integration/16143-5297/.minikube/certs/12554.pem (1338 bytes)
W0404 22:45:01.095306 58287 certs.go:480] ignoring /home/jenkins/minikube-integration/16143-5297/.minikube/certs/12554_empty.pem, impossibly tiny 0 bytes
I0404 22:45:01.095323 58287 certs.go:484] found cert: /home/jenkins/minikube-integration/16143-5297/.minikube/certs/ca-key.pem (1679 bytes)
I0404 22:45:01.095358 58287 certs.go:484] found cert: /home/jenkins/minikube-integration/16143-5297/.minikube/certs/ca.pem (1078 bytes)
I0404 22:45:01.095394 58287 certs.go:484] found cert: /home/jenkins/minikube-integration/16143-5297/.minikube/certs/cert.pem (1123 bytes)
I0404 22:45:01.095434 58287 certs.go:484] found cert: /home/jenkins/minikube-integration/16143-5297/.minikube/certs/key.pem (1675 bytes)
I0404 22:45:01.095495 58287 certs.go:484] found cert: /home/jenkins/minikube-integration/16143-5297/.minikube/files/etc/ssl/certs/125542.pem (1708 bytes)
I0404 22:45:01.096300 58287 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16143-5297/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0404 22:45:01.133260 58287 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16143-5297/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0404 22:45:01.168522 58287 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16143-5297/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0404 22:45:01.281676 58287 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16143-5297/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0404 22:45:01.313219 58287 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0404 22:45:01.351426 58287 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0404 22:45:01.386855 58287 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0404 22:45:01.424264 58287 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16143-5297/.minikube/profiles/old-k8s-version-343162/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0404 22:45:01.474394 58287 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16143-5297/.minikube/certs/12554.pem --> /usr/share/ca-certificates/12554.pem (1338 bytes)
I0404 22:45:01.527491 58287 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16143-5297/.minikube/files/etc/ssl/certs/125542.pem --> /usr/share/ca-certificates/125542.pem (1708 bytes)
I0404 22:45:01.566831 58287 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16143-5297/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0404 22:45:01.597057 58287 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (752 bytes)
I0404 22:45:01.622517 58287 ssh_runner.go:195] Run: openssl version
I0404 22:45:01.629130 58287 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/12554.pem && ln -fs /usr/share/ca-certificates/12554.pem /etc/ssl/certs/12554.pem"
I0404 22:45:01.644901 58287 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/12554.pem
I0404 22:45:01.650437 58287 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 4 21:40 /usr/share/ca-certificates/12554.pem
I0404 22:45:01.650496 58287 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/12554.pem
I0404 22:45:01.657919 58287 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/12554.pem /etc/ssl/certs/51391683.0"
I0404 22:45:01.670228 58287 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/125542.pem && ln -fs /usr/share/ca-certificates/125542.pem /etc/ssl/certs/125542.pem"
I0404 22:45:01.686584 58287 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/125542.pem
I0404 22:45:01.692421 58287 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 4 21:40 /usr/share/ca-certificates/125542.pem
I0404 22:45:01.692471 58287 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/125542.pem
I0404 22:45:01.700038 58287 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/125542.pem /etc/ssl/certs/3ec20f2e.0"
I0404 22:45:01.718284 58287 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0404 22:45:01.733468 58287 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0404 22:45:01.739769 58287 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 4 21:30 /usr/share/ca-certificates/minikubeCA.pem
I0404 22:45:01.739833 58287 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0404 22:45:01.747145 58287 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0404 22:45:01.763551 58287 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0404 22:45:01.769124 58287 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0404 22:45:01.769205 58287 kubeadm.go:391] StartCluster: {Name:old-k8s-version-343162 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18566/minikube-v1.33.0-1712138767-18566-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1712138838-18566@sha256:a1b6bbc384c0914baa698cc91ccedcb662b3c0986082ff16cc623c5d83216034 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-343162 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.247 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0404 22:45:01.769313 58287 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0404 22:45:01.769444 58287 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0404 22:45:01.822004 58287 cri.go:89] found id: ""
I0404 22:45:01.822086 58287 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0404 22:45:01.836364 58287 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0404 22:45:01.849483 58287 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0404 22:45:01.862660 58287 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0404 22:45:01.862689 58287 kubeadm.go:156] found existing configuration files:
I0404 22:45:01.862741 58287 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0404 22:45:01.875715 58287 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0404 22:45:01.875775 58287 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0404 22:45:01.891862 58287 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0404 22:45:01.907173 58287 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0404 22:45:01.907252 58287 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0404 22:45:01.919292 58287 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0404 22:45:01.930530 58287 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0404 22:45:01.930594 58287 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0404 22:45:01.943317 58287 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0404 22:45:01.954238 58287 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0404 22:45:01.954319 58287 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0404 22:45:01.965565 58287 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0404 22:45:02.097992 58287 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0404 22:45:02.098282 58287 kubeadm.go:309] [preflight] Running pre-flight checks
I0404 22:45:02.281112 58287 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0404 22:45:02.281273 58287 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0404 22:45:02.281410 58287 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0404 22:45:02.588058 58287 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0404 22:45:02.590307 58287 out.go:204] - Generating certificates and keys ...
I0404 22:45:02.590422 58287 kubeadm.go:309] [certs] Using existing ca certificate authority
I0404 22:45:02.590513 58287 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0404 22:45:02.926533 58287 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0404 22:45:03.086364 58287 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0404 22:45:03.239110 58287 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0404 22:45:03.465177 58287 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0404 22:45:03.571900 58287 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0404 22:45:03.572082 58287 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-343162] and IPs [192.168.39.247 127.0.0.1 ::1]
I0404 22:45:03.954073 58287 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0404 22:45:03.954515 58287 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-343162] and IPs [192.168.39.247 127.0.0.1 ::1]
I0404 22:45:04.123577 58287 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0404 22:45:04.265955 58287 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0404 22:45:04.985558 58287 kubeadm.go:309] [certs] Generating "sa" key and public key
I0404 22:45:04.985868 58287 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0404 22:45:05.215355 58287 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0404 22:45:05.487322 58287 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0404 22:45:05.740958 58287 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0404 22:45:05.921102 58287 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0404 22:45:05.948354 58287 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0404 22:45:05.948580 58287 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0404 22:45:05.948646 58287 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0404 22:45:06.133007 58287 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0404 22:45:06.135034 58287 out.go:204] - Booting up control plane ...
I0404 22:45:06.135172 58287 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0404 22:45:06.139078 58287 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0404 22:45:06.140586 58287 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0404 22:45:06.142909 58287 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0404 22:45:06.150787 58287 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0404 22:45:46.143758 58287 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0404 22:45:46.144823 58287 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0404 22:45:46.145210 58287 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0404 22:45:51.145076 58287 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0404 22:45:51.145401 58287 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0404 22:46:01.144935 58287 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0404 22:46:01.145246 58287 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0404 22:46:21.144384 58287 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0404 22:46:21.144703 58287 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0404 22:47:01.145803 58287 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0404 22:47:01.146342 58287 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0404 22:47:01.146368 58287 kubeadm.go:309]
I0404 22:47:01.146454 58287 kubeadm.go:309] Unfortunately, an error has occurred:
I0404 22:47:01.146559 58287 kubeadm.go:309] timed out waiting for the condition
I0404 22:47:01.146584 58287 kubeadm.go:309]
I0404 22:47:01.146662 58287 kubeadm.go:309] This error is likely caused by:
I0404 22:47:01.146746 58287 kubeadm.go:309] - The kubelet is not running
I0404 22:47:01.146976 58287 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0404 22:47:01.146991 58287 kubeadm.go:309]
I0404 22:47:01.147216 58287 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0404 22:47:01.147263 58287 kubeadm.go:309] - 'systemctl status kubelet'
I0404 22:47:01.147330 58287 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0404 22:47:01.147345 58287 kubeadm.go:309]
I0404 22:47:01.147620 58287 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0404 22:47:01.147842 58287 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0404 22:47:01.147863 58287 kubeadm.go:309]
I0404 22:47:01.148114 58287 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0404 22:47:01.148350 58287 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0404 22:47:01.148574 58287 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0404 22:47:01.148840 58287 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0404 22:47:01.148877 58287 kubeadm.go:309]
I0404 22:47:01.149337 58287 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0404 22:47:01.149645 58287 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0404 22:47:01.149738 58287 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0404 22:47:01.149929 58287 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-343162] and IPs [192.168.39.247 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-343162] and IPs [192.168.39.247 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-343162] and IPs [192.168.39.247 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-343162] and IPs [192.168.39.247 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0404 22:47:01.149987 58287 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0404 22:47:03.195508 58287 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.04549059s)
I0404 22:47:03.195579 58287 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0404 22:47:03.215553 58287 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0404 22:47:03.227615 58287 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0404 22:47:03.227648 58287 kubeadm.go:156] found existing configuration files:
I0404 22:47:03.227700 58287 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0404 22:47:03.239131 58287 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0404 22:47:03.239190 58287 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0404 22:47:03.251229 58287 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0404 22:47:03.263452 58287 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0404 22:47:03.263506 58287 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0404 22:47:03.274843 58287 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0404 22:47:03.285581 58287 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0404 22:47:03.285671 58287 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0404 22:47:03.296636 58287 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0404 22:47:03.307131 58287 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0404 22:47:03.307193 58287 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0404 22:47:03.318118 58287 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0404 22:47:03.394460 58287 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0404 22:47:03.394609 58287 kubeadm.go:309] [preflight] Running pre-flight checks
I0404 22:47:03.556156 58287 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0404 22:47:03.556332 58287 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0404 22:47:03.556485 58287 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0404 22:47:03.755324 58287 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0404 22:47:03.758253 58287 out.go:204] - Generating certificates and keys ...
I0404 22:47:03.758352 58287 kubeadm.go:309] [certs] Using existing ca certificate authority
I0404 22:47:03.758438 58287 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0404 22:47:03.758551 58287 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0404 22:47:03.758629 58287 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0404 22:47:03.758742 58287 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0404 22:47:03.758826 58287 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0404 22:47:03.758911 58287 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0404 22:47:03.758985 58287 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0404 22:47:03.759215 58287 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0404 22:47:03.759895 58287 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0404 22:47:03.759956 58287 kubeadm.go:309] [certs] Using the existing "sa" key
I0404 22:47:03.760033 58287 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0404 22:47:04.010862 58287 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0404 22:47:04.287978 58287 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0404 22:47:04.425894 58287 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0404 22:47:04.552639 58287 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0404 22:47:04.578502 58287 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0404 22:47:04.580065 58287 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0404 22:47:04.580155 58287 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0404 22:47:04.788978 58287 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0404 22:47:04.790806 58287 out.go:204] - Booting up control plane ...
I0404 22:47:04.790954 58287 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0404 22:47:04.799806 58287 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0404 22:47:04.802355 58287 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0404 22:47:04.805148 58287 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0404 22:47:04.813249 58287 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0404 22:47:44.815862 58287 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0404 22:47:44.816297 58287 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0404 22:47:44.816514 58287 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0404 22:47:49.817135 58287 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0404 22:47:49.817430 58287 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0404 22:47:59.817721 58287 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0404 22:47:59.817935 58287 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0404 22:48:19.817491 58287 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0404 22:48:19.817723 58287 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0404 22:48:59.817497 58287 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0404 22:48:59.817709 58287 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0404 22:48:59.817874 58287 kubeadm.go:309]
I0404 22:48:59.817941 58287 kubeadm.go:309] Unfortunately, an error has occurred:
I0404 22:48:59.818418 58287 kubeadm.go:309] timed out waiting for the condition
I0404 22:48:59.818441 58287 kubeadm.go:309]
I0404 22:48:59.818474 58287 kubeadm.go:309] This error is likely caused by:
I0404 22:48:59.818533 58287 kubeadm.go:309] - The kubelet is not running
I0404 22:48:59.818678 58287 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0404 22:48:59.818690 58287 kubeadm.go:309]
I0404 22:48:59.818814 58287 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0404 22:48:59.818860 58287 kubeadm.go:309] - 'systemctl status kubelet'
I0404 22:48:59.818913 58287 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0404 22:48:59.818925 58287 kubeadm.go:309]
I0404 22:48:59.819050 58287 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0404 22:48:59.819186 58287 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0404 22:48:59.819202 58287 kubeadm.go:309]
I0404 22:48:59.819347 58287 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0404 22:48:59.819474 58287 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0404 22:48:59.819547 58287 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0404 22:48:59.819637 58287 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0404 22:48:59.819947 58287 kubeadm.go:309]
I0404 22:48:59.822501 58287 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0404 22:48:59.822597 58287 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0404 22:48:59.822665 58287 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0404 22:48:59.822727 58287 kubeadm.go:393] duration metric: took 3m58.05352537s to StartCluster
I0404 22:48:59.822784 58287 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0404 22:48:59.822857 58287 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0404 22:48:59.876103 58287 cri.go:89] found id: ""
I0404 22:48:59.876147 58287 logs.go:276] 0 containers: []
W0404 22:48:59.876155 58287 logs.go:278] No container was found matching "kube-apiserver"
I0404 22:48:59.876165 58287 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0404 22:48:59.876217 58287 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0404 22:48:59.914104 58287 cri.go:89] found id: ""
I0404 22:48:59.914125 58287 logs.go:276] 0 containers: []
W0404 22:48:59.914132 58287 logs.go:278] No container was found matching "etcd"
I0404 22:48:59.914138 58287 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0404 22:48:59.914181 58287 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0404 22:48:59.951976 58287 cri.go:89] found id: ""
I0404 22:48:59.952011 58287 logs.go:276] 0 containers: []
W0404 22:48:59.952024 58287 logs.go:278] No container was found matching "coredns"
I0404 22:48:59.952031 58287 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0404 22:48:59.952104 58287 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0404 22:48:59.988909 58287 cri.go:89] found id: ""
I0404 22:48:59.988936 58287 logs.go:276] 0 containers: []
W0404 22:48:59.988945 58287 logs.go:278] No container was found matching "kube-scheduler"
I0404 22:48:59.988950 58287 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0404 22:48:59.989009 58287 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0404 22:49:00.028155 58287 cri.go:89] found id: ""
I0404 22:49:00.028178 58287 logs.go:276] 0 containers: []
W0404 22:49:00.028187 58287 logs.go:278] No container was found matching "kube-proxy"
I0404 22:49:00.028193 58287 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0404 22:49:00.028274 58287 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0404 22:49:00.066791 58287 cri.go:89] found id: ""
I0404 22:49:00.066820 58287 logs.go:276] 0 containers: []
W0404 22:49:00.066831 58287 logs.go:278] No container was found matching "kube-controller-manager"
I0404 22:49:00.066841 58287 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0404 22:49:00.066900 58287 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0404 22:49:00.103209 58287 cri.go:89] found id: ""
I0404 22:49:00.103239 58287 logs.go:276] 0 containers: []
W0404 22:49:00.103248 58287 logs.go:278] No container was found matching "kindnet"
I0404 22:49:00.103258 58287 logs.go:123] Gathering logs for kubelet ...
I0404 22:49:00.103269 58287 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0404 22:49:00.168168 58287 logs.go:123] Gathering logs for dmesg ...
I0404 22:49:00.168211 58287 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0404 22:49:00.182866 58287 logs.go:123] Gathering logs for describe nodes ...
I0404 22:49:00.182898 58287 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0404 22:49:00.304463 58287 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0404 22:49:00.304483 58287 logs.go:123] Gathering logs for CRI-O ...
I0404 22:49:00.304498 58287 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0404 22:49:00.401551 58287 logs.go:123] Gathering logs for container status ...
I0404 22:49:00.401583 58287 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0404 22:49:00.455361 58287 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0404 22:49:00.455407 58287 out.go:239] *
*
W0404 22:49:00.455481 58287 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0404 22:49:00.455516 58287 out.go:239] *
*
W0404 22:49:00.456511 58287 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0404 22:49:00.460344 58287 out.go:177]
W0404 22:49:00.461674 58287 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0404 22:49:00.461748 58287 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0404 22:49:00.461766 58287 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0404 22:49:00.463533 58287 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-343162 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-343162 -n old-k8s-version-343162
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-343162 -n old-k8s-version-343162: exit status 6 (239.216545ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0404 22:49:00.741234 64379 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-343162" does not appear in /home/jenkins/minikube-integration/16143-5297/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-343162" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (274.66s)