=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-210442 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-210442 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (5m14.896560645s)
-- stdout --
* [old-k8s-version-210442] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18757
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18757-6355/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18757-6355/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-210442" primary control-plane node in "old-k8s-version-210442" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0425 19:52:17.989352 64931 out.go:291] Setting OutFile to fd 1 ...
I0425 19:52:17.989591 64931 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0425 19:52:17.989602 64931 out.go:304] Setting ErrFile to fd 2...
I0425 19:52:17.989607 64931 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0425 19:52:17.989795 64931 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18757-6355/.minikube/bin
I0425 19:52:17.990452 64931 out.go:298] Setting JSON to false
I0425 19:52:17.991530 64931 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":5684,"bootTime":1714069054,"procs":296,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0425 19:52:17.991592 64931 start.go:139] virtualization: kvm guest
I0425 19:52:17.993951 64931 out.go:177] * [old-k8s-version-210442] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)
I0425 19:52:17.995653 64931 notify.go:220] Checking for updates...
I0425 19:52:17.995669 64931 out.go:177] - MINIKUBE_LOCATION=18757
I0425 19:52:17.997258 64931 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0425 19:52:17.998850 64931 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18757-6355/kubeconfig
I0425 19:52:18.000348 64931 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18757-6355/.minikube
I0425 19:52:18.001650 64931 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0425 19:52:18.003019 64931 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0425 19:52:18.004756 64931 config.go:182] Loaded profile config "bridge-120641": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0425 19:52:18.004859 64931 config.go:182] Loaded profile config "enable-default-cni-120641": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0425 19:52:18.004953 64931 config.go:182] Loaded profile config "flannel-120641": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0425 19:52:18.005063 64931 driver.go:392] Setting default libvirt URI to qemu:///system
I0425 19:52:18.043970 64931 out.go:177] * Using the kvm2 driver based on user configuration
I0425 19:52:18.045364 64931 start.go:297] selected driver: kvm2
I0425 19:52:18.045385 64931 start.go:901] validating driver "kvm2" against <nil>
I0425 19:52:18.045401 64931 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0425 19:52:18.046154 64931 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0425 19:52:18.046272 64931 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18757-6355/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0425 19:52:18.061583 64931 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0
I0425 19:52:18.061640 64931 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0425 19:52:18.061866 64931 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0425 19:52:18.061930 64931 cni.go:84] Creating CNI manager for ""
I0425 19:52:18.061939 64931 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0425 19:52:18.061947 64931 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0425 19:52:18.062007 64931 start.go:340] cluster config:
{Name:old-k8s-version-210442 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-210442 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0425 19:52:18.062104 64931 iso.go:125] acquiring lock: {Name:mk4deb53653b7b4f452836666338f58451eabad3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0425 19:52:18.064094 64931 out.go:177] * Starting "old-k8s-version-210442" primary control-plane node in "old-k8s-version-210442" cluster
I0425 19:52:18.065486 64931 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0425 19:52:18.065525 64931 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18757-6355/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0425 19:52:18.065535 64931 cache.go:56] Caching tarball of preloaded images
I0425 19:52:18.065635 64931 preload.go:173] Found /home/jenkins/minikube-integration/18757-6355/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0425 19:52:18.065647 64931 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0425 19:52:18.065729 64931 profile.go:143] Saving config to /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/config.json ...
I0425 19:52:18.065746 64931 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/config.json: {Name:mkfc6ffebfebfda25d6b4385b21ecc7aabe449bc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0425 19:52:18.065872 64931 start.go:360] acquireMachinesLock for old-k8s-version-210442: {Name:mkc8fa3fe157ac0fd8735332d47b1b77ddc30348 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0425 19:52:48.692279 64931 start.go:364] duration metric: took 30.626346774s to acquireMachinesLock for "old-k8s-version-210442"
I0425 19:52:48.692359 64931 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-210442 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-210442 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0425 19:52:48.692525 64931 start.go:125] createHost starting for "" (driver="kvm2")
I0425 19:52:48.694550 64931 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0425 19:52:48.694754 64931 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0425 19:52:48.694803 64931 main.go:141] libmachine: Launching plugin server for driver kvm2
I0425 19:52:48.715110 64931 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40301
I0425 19:52:48.715657 64931 main.go:141] libmachine: () Calling .GetVersion
I0425 19:52:48.716293 64931 main.go:141] libmachine: Using API Version 1
I0425 19:52:48.716318 64931 main.go:141] libmachine: () Calling .SetConfigRaw
I0425 19:52:48.716665 64931 main.go:141] libmachine: () Calling .GetMachineName
I0425 19:52:48.716870 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetMachineName
I0425 19:52:48.717016 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .DriverName
I0425 19:52:48.717177 64931 start.go:159] libmachine.API.Create for "old-k8s-version-210442" (driver="kvm2")
I0425 19:52:48.717204 64931 client.go:168] LocalClient.Create starting
I0425 19:52:48.717235 64931 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18757-6355/.minikube/certs/ca.pem
I0425 19:52:48.717274 64931 main.go:141] libmachine: Decoding PEM data...
I0425 19:52:48.717300 64931 main.go:141] libmachine: Parsing certificate...
I0425 19:52:48.717374 64931 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18757-6355/.minikube/certs/cert.pem
I0425 19:52:48.717402 64931 main.go:141] libmachine: Decoding PEM data...
I0425 19:52:48.717418 64931 main.go:141] libmachine: Parsing certificate...
I0425 19:52:48.717445 64931 main.go:141] libmachine: Running pre-create checks...
I0425 19:52:48.717461 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .PreCreateCheck
I0425 19:52:48.717879 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetConfigRaw
I0425 19:52:48.718355 64931 main.go:141] libmachine: Creating machine...
I0425 19:52:48.718373 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .Create
I0425 19:52:48.718498 64931 main.go:141] libmachine: (old-k8s-version-210442) Creating KVM machine...
I0425 19:52:48.719848 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found existing default KVM network
I0425 19:52:48.721412 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:48.721240 65243 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:03:55:91} reservation:<nil>}
I0425 19:52:48.722735 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:48.722635 65243 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:67:26:a2} reservation:<nil>}
I0425 19:52:48.724109 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:48.724010 65243 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000308a60}
I0425 19:52:48.724138 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | created network xml:
I0425 19:52:48.724155 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | <network>
I0425 19:52:48.724167 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | <name>mk-old-k8s-version-210442</name>
I0425 19:52:48.724181 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | <dns enable='no'/>
I0425 19:52:48.724194 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG |
I0425 19:52:48.724207 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0425 19:52:48.724228 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | <dhcp>
I0425 19:52:48.724243 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0425 19:52:48.724254 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | </dhcp>
I0425 19:52:48.724262 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | </ip>
I0425 19:52:48.724278 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG |
I0425 19:52:48.724293 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | </network>
I0425 19:52:48.724321 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG |
I0425 19:52:48.730393 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | trying to create private KVM network mk-old-k8s-version-210442 192.168.61.0/24...
I0425 19:52:48.812181 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | private KVM network mk-old-k8s-version-210442 192.168.61.0/24 created
I0425 19:52:48.812211 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:48.812136 65243 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18757-6355/.minikube
I0425 19:52:48.812239 64931 main.go:141] libmachine: (old-k8s-version-210442) Setting up store path in /home/jenkins/minikube-integration/18757-6355/.minikube/machines/old-k8s-version-210442 ...
I0425 19:52:48.812260 64931 main.go:141] libmachine: (old-k8s-version-210442) Building disk image from file:///home/jenkins/minikube-integration/18757-6355/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso
I0425 19:52:48.812274 64931 main.go:141] libmachine: (old-k8s-version-210442) Downloading /home/jenkins/minikube-integration/18757-6355/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18757-6355/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...
I0425 19:52:49.066604 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:49.066419 65243 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18757-6355/.minikube/machines/old-k8s-version-210442/id_rsa...
I0425 19:52:49.286183 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:49.286034 65243 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18757-6355/.minikube/machines/old-k8s-version-210442/old-k8s-version-210442.rawdisk...
I0425 19:52:49.286226 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Writing magic tar header
I0425 19:52:49.286247 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Writing SSH key tar header
I0425 19:52:49.286259 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:49.286227 65243 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18757-6355/.minikube/machines/old-k8s-version-210442 ...
I0425 19:52:49.286357 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18757-6355/.minikube/machines/old-k8s-version-210442
I0425 19:52:49.286395 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18757-6355/.minikube/machines
I0425 19:52:49.286408 64931 main.go:141] libmachine: (old-k8s-version-210442) Setting executable bit set on /home/jenkins/minikube-integration/18757-6355/.minikube/machines/old-k8s-version-210442 (perms=drwx------)
I0425 19:52:49.286426 64931 main.go:141] libmachine: (old-k8s-version-210442) Setting executable bit set on /home/jenkins/minikube-integration/18757-6355/.minikube/machines (perms=drwxr-xr-x)
I0425 19:52:49.286449 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18757-6355/.minikube
I0425 19:52:49.286461 64931 main.go:141] libmachine: (old-k8s-version-210442) Setting executable bit set on /home/jenkins/minikube-integration/18757-6355/.minikube (perms=drwxr-xr-x)
I0425 19:52:49.286472 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18757-6355
I0425 19:52:49.286485 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0425 19:52:49.286497 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Checking permissions on dir: /home/jenkins
I0425 19:52:49.286508 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Checking permissions on dir: /home
I0425 19:52:49.286516 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Skipping /home - not owner
I0425 19:52:49.286530 64931 main.go:141] libmachine: (old-k8s-version-210442) Setting executable bit set on /home/jenkins/minikube-integration/18757-6355 (perms=drwxrwxr-x)
I0425 19:52:49.286540 64931 main.go:141] libmachine: (old-k8s-version-210442) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0425 19:52:49.286551 64931 main.go:141] libmachine: (old-k8s-version-210442) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0425 19:52:49.286558 64931 main.go:141] libmachine: (old-k8s-version-210442) Creating domain...
I0425 19:52:49.287734 64931 main.go:141] libmachine: (old-k8s-version-210442) define libvirt domain using xml:
I0425 19:52:49.287771 64931 main.go:141] libmachine: (old-k8s-version-210442) <domain type='kvm'>
I0425 19:52:49.287783 64931 main.go:141] libmachine: (old-k8s-version-210442) <name>old-k8s-version-210442</name>
I0425 19:52:49.287796 64931 main.go:141] libmachine: (old-k8s-version-210442) <memory unit='MiB'>2200</memory>
I0425 19:52:49.287807 64931 main.go:141] libmachine: (old-k8s-version-210442) <vcpu>2</vcpu>
I0425 19:52:49.287819 64931 main.go:141] libmachine: (old-k8s-version-210442) <features>
I0425 19:52:49.287831 64931 main.go:141] libmachine: (old-k8s-version-210442) <acpi/>
I0425 19:52:49.287850 64931 main.go:141] libmachine: (old-k8s-version-210442) <apic/>
I0425 19:52:49.287873 64931 main.go:141] libmachine: (old-k8s-version-210442) <pae/>
I0425 19:52:49.287883 64931 main.go:141] libmachine: (old-k8s-version-210442)
I0425 19:52:49.287893 64931 main.go:141] libmachine: (old-k8s-version-210442) </features>
I0425 19:52:49.287901 64931 main.go:141] libmachine: (old-k8s-version-210442) <cpu mode='host-passthrough'>
I0425 19:52:49.287914 64931 main.go:141] libmachine: (old-k8s-version-210442)
I0425 19:52:49.287921 64931 main.go:141] libmachine: (old-k8s-version-210442) </cpu>
I0425 19:52:49.287934 64931 main.go:141] libmachine: (old-k8s-version-210442) <os>
I0425 19:52:49.287946 64931 main.go:141] libmachine: (old-k8s-version-210442) <type>hvm</type>
I0425 19:52:49.287959 64931 main.go:141] libmachine: (old-k8s-version-210442) <boot dev='cdrom'/>
I0425 19:52:49.287975 64931 main.go:141] libmachine: (old-k8s-version-210442) <boot dev='hd'/>
I0425 19:52:49.287990 64931 main.go:141] libmachine: (old-k8s-version-210442) <bootmenu enable='no'/>
I0425 19:52:49.288001 64931 main.go:141] libmachine: (old-k8s-version-210442) </os>
I0425 19:52:49.288010 64931 main.go:141] libmachine: (old-k8s-version-210442) <devices>
I0425 19:52:49.288022 64931 main.go:141] libmachine: (old-k8s-version-210442) <disk type='file' device='cdrom'>
I0425 19:52:49.288037 64931 main.go:141] libmachine: (old-k8s-version-210442) <source file='/home/jenkins/minikube-integration/18757-6355/.minikube/machines/old-k8s-version-210442/boot2docker.iso'/>
I0425 19:52:49.288054 64931 main.go:141] libmachine: (old-k8s-version-210442) <target dev='hdc' bus='scsi'/>
I0425 19:52:49.288067 64931 main.go:141] libmachine: (old-k8s-version-210442) <readonly/>
I0425 19:52:49.288078 64931 main.go:141] libmachine: (old-k8s-version-210442) </disk>
I0425 19:52:49.288092 64931 main.go:141] libmachine: (old-k8s-version-210442) <disk type='file' device='disk'>
I0425 19:52:49.288105 64931 main.go:141] libmachine: (old-k8s-version-210442) <driver name='qemu' type='raw' cache='default' io='threads' />
I0425 19:52:49.288153 64931 main.go:141] libmachine: (old-k8s-version-210442) <source file='/home/jenkins/minikube-integration/18757-6355/.minikube/machines/old-k8s-version-210442/old-k8s-version-210442.rawdisk'/>
I0425 19:52:49.288188 64931 main.go:141] libmachine: (old-k8s-version-210442) <target dev='hda' bus='virtio'/>
I0425 19:52:49.288198 64931 main.go:141] libmachine: (old-k8s-version-210442) </disk>
I0425 19:52:49.288210 64931 main.go:141] libmachine: (old-k8s-version-210442) <interface type='network'>
I0425 19:52:49.288226 64931 main.go:141] libmachine: (old-k8s-version-210442) <source network='mk-old-k8s-version-210442'/>
I0425 19:52:49.288237 64931 main.go:141] libmachine: (old-k8s-version-210442) <model type='virtio'/>
I0425 19:52:49.288243 64931 main.go:141] libmachine: (old-k8s-version-210442) </interface>
I0425 19:52:49.288248 64931 main.go:141] libmachine: (old-k8s-version-210442) <interface type='network'>
I0425 19:52:49.288256 64931 main.go:141] libmachine: (old-k8s-version-210442) <source network='default'/>
I0425 19:52:49.288267 64931 main.go:141] libmachine: (old-k8s-version-210442) <model type='virtio'/>
I0425 19:52:49.288280 64931 main.go:141] libmachine: (old-k8s-version-210442) </interface>
I0425 19:52:49.288296 64931 main.go:141] libmachine: (old-k8s-version-210442) <serial type='pty'>
I0425 19:52:49.288309 64931 main.go:141] libmachine: (old-k8s-version-210442) <target port='0'/>
I0425 19:52:49.288318 64931 main.go:141] libmachine: (old-k8s-version-210442) </serial>
I0425 19:52:49.288324 64931 main.go:141] libmachine: (old-k8s-version-210442) <console type='pty'>
I0425 19:52:49.288332 64931 main.go:141] libmachine: (old-k8s-version-210442) <target type='serial' port='0'/>
I0425 19:52:49.288338 64931 main.go:141] libmachine: (old-k8s-version-210442) </console>
I0425 19:52:49.288348 64931 main.go:141] libmachine: (old-k8s-version-210442) <rng model='virtio'>
I0425 19:52:49.288358 64931 main.go:141] libmachine: (old-k8s-version-210442) <backend model='random'>/dev/random</backend>
I0425 19:52:49.288372 64931 main.go:141] libmachine: (old-k8s-version-210442) </rng>
I0425 19:52:49.288384 64931 main.go:141] libmachine: (old-k8s-version-210442)
I0425 19:52:49.288394 64931 main.go:141] libmachine: (old-k8s-version-210442)
I0425 19:52:49.288399 64931 main.go:141] libmachine: (old-k8s-version-210442) </devices>
I0425 19:52:49.288404 64931 main.go:141] libmachine: (old-k8s-version-210442) </domain>
I0425 19:52:49.288411 64931 main.go:141] libmachine: (old-k8s-version-210442)
I0425 19:52:49.296970 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:0d:e3:3b in network default
I0425 19:52:49.297779 64931 main.go:141] libmachine: (old-k8s-version-210442) Ensuring networks are active...
I0425 19:52:49.297813 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:52:49.298859 64931 main.go:141] libmachine: (old-k8s-version-210442) Ensuring network default is active
I0425 19:52:49.299315 64931 main.go:141] libmachine: (old-k8s-version-210442) Ensuring network mk-old-k8s-version-210442 is active
I0425 19:52:49.299956 64931 main.go:141] libmachine: (old-k8s-version-210442) Getting domain xml...
I0425 19:52:49.301106 64931 main.go:141] libmachine: (old-k8s-version-210442) Creating domain...
I0425 19:52:50.692581 64931 main.go:141] libmachine: (old-k8s-version-210442) Waiting to get IP...
I0425 19:52:50.693596 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:52:50.694278 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find current IP address of domain old-k8s-version-210442 in network mk-old-k8s-version-210442
I0425 19:52:50.694317 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:50.694250 65243 retry.go:31] will retry after 225.370935ms: waiting for machine to come up
I0425 19:52:50.921825 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:52:50.922438 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find current IP address of domain old-k8s-version-210442 in network mk-old-k8s-version-210442
I0425 19:52:50.922486 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:50.922400 65243 retry.go:31] will retry after 265.865279ms: waiting for machine to come up
I0425 19:52:51.190069 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:52:51.190751 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find current IP address of domain old-k8s-version-210442 in network mk-old-k8s-version-210442
I0425 19:52:51.190768 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:51.190673 65243 retry.go:31] will retry after 443.343372ms: waiting for machine to come up
I0425 19:52:51.635471 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:52:51.636083 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find current IP address of domain old-k8s-version-210442 in network mk-old-k8s-version-210442
I0425 19:52:51.636119 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:51.636070 65243 retry.go:31] will retry after 486.383692ms: waiting for machine to come up
I0425 19:52:52.123706 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:52:52.124385 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find current IP address of domain old-k8s-version-210442 in network mk-old-k8s-version-210442
I0425 19:52:52.124412 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:52.124313 65243 retry.go:31] will retry after 594.262346ms: waiting for machine to come up
I0425 19:52:52.720268 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:52:52.720837 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find current IP address of domain old-k8s-version-210442 in network mk-old-k8s-version-210442
I0425 19:52:52.720862 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:52.720781 65243 retry.go:31] will retry after 719.457512ms: waiting for machine to come up
I0425 19:52:53.441760 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:52:53.442298 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find current IP address of domain old-k8s-version-210442 in network mk-old-k8s-version-210442
I0425 19:52:53.442329 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:53.442273 65243 retry.go:31] will retry after 907.510876ms: waiting for machine to come up
I0425 19:52:54.352181 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:52:54.352720 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find current IP address of domain old-k8s-version-210442 in network mk-old-k8s-version-210442
I0425 19:52:54.352750 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:54.352675 65243 retry.go:31] will retry after 1.039417045s: waiting for machine to come up
I0425 19:52:55.394023 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:52:55.394625 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find current IP address of domain old-k8s-version-210442 in network mk-old-k8s-version-210442
I0425 19:52:55.394646 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:55.394573 65243 retry.go:31] will retry after 1.341383594s: waiting for machine to come up
I0425 19:52:56.738247 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:52:56.738871 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find current IP address of domain old-k8s-version-210442 in network mk-old-k8s-version-210442
I0425 19:52:56.738894 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:56.738788 65243 retry.go:31] will retry after 1.78654144s: waiting for machine to come up
I0425 19:52:58.527566 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:52:58.528385 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find current IP address of domain old-k8s-version-210442 in network mk-old-k8s-version-210442
I0425 19:52:58.528414 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:52:58.528309 65243 retry.go:31] will retry after 1.752071295s: waiting for machine to come up
I0425 19:53:00.281741 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:00.282293 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find current IP address of domain old-k8s-version-210442 in network mk-old-k8s-version-210442
I0425 19:53:00.282320 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:53:00.282237 65243 retry.go:31] will retry after 2.907902346s: waiting for machine to come up
I0425 19:53:03.192100 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:03.192618 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find current IP address of domain old-k8s-version-210442 in network mk-old-k8s-version-210442
I0425 19:53:03.192643 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:53:03.192567 65243 retry.go:31] will retry after 3.274998775s: waiting for machine to come up
I0425 19:53:06.468718 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:06.469253 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find current IP address of domain old-k8s-version-210442 in network mk-old-k8s-version-210442
I0425 19:53:06.469307 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:53:06.469201 65243 retry.go:31] will retry after 4.254472154s: waiting for machine to come up
I0425 19:53:10.726097 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:10.726659 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find current IP address of domain old-k8s-version-210442 in network mk-old-k8s-version-210442
I0425 19:53:10.726690 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | I0425 19:53:10.726600 65243 retry.go:31] will retry after 6.496652794s: waiting for machine to come up
I0425 19:53:17.227920 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:17.228560 64931 main.go:141] libmachine: (old-k8s-version-210442) Found IP for machine: 192.168.61.136
I0425 19:53:17.228588 64931 main.go:141] libmachine: (old-k8s-version-210442) Reserving static IP address...
I0425 19:53:17.228602 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has current primary IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:17.228966 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-210442", mac: "52:54:00:11:0b:ca", ip: "192.168.61.136"} in network mk-old-k8s-version-210442
I0425 19:53:17.317629 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Getting to WaitForSSH function...
I0425 19:53:17.317661 64931 main.go:141] libmachine: (old-k8s-version-210442) Reserved static IP address: 192.168.61.136
I0425 19:53:17.317674 64931 main.go:141] libmachine: (old-k8s-version-210442) Waiting for SSH to be available...
I0425 19:53:17.324024 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:17.324398 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442
I0425 19:53:17.324423 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | unable to find defined IP address of network mk-old-k8s-version-210442 interface with MAC address 52:54:00:11:0b:ca
I0425 19:53:17.324601 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Using SSH client type: external
I0425 19:53:17.324624 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Using SSH private key: /home/jenkins/minikube-integration/18757-6355/.minikube/machines/old-k8s-version-210442/id_rsa (-rw-------)
I0425 19:53:17.324677 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18757-6355/.minikube/machines/old-k8s-version-210442/id_rsa -p 22] /usr/bin/ssh <nil>}
I0425 19:53:17.324691 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | About to run SSH command:
I0425 19:53:17.324705 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | exit 0
I0425 19:53:17.329006 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | SSH cmd err, output: exit status 255:
I0425 19:53:17.329041 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0425 19:53:17.329063 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | command : exit 0
I0425 19:53:17.329075 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | err : exit status 255
I0425 19:53:17.329088 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | output :
I0425 19:53:20.329321 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Getting to WaitForSSH function...
I0425 19:53:20.332151 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:20.332632 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:20.332677 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:20.332786 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Using SSH client type: external
I0425 19:53:20.332816 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Using SSH private key: /home/jenkins/minikube-integration/18757-6355/.minikube/machines/old-k8s-version-210442/id_rsa (-rw-------)
I0425 19:53:20.332863 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.136 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18757-6355/.minikube/machines/old-k8s-version-210442/id_rsa -p 22] /usr/bin/ssh <nil>}
I0425 19:53:20.332880 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | About to run SSH command:
I0425 19:53:20.332912 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | exit 0
I0425 19:53:20.470884 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | SSH cmd err, output: <nil>:
I0425 19:53:20.471538 64931 main.go:141] libmachine: (old-k8s-version-210442) KVM machine creation complete!
I0425 19:53:20.471615 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetConfigRaw
I0425 19:53:20.472166 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .DriverName
I0425 19:53:20.472397 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .DriverName
I0425 19:53:20.472575 64931 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0425 19:53:20.472607 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetState
I0425 19:53:20.474045 64931 main.go:141] libmachine: Detecting operating system of created instance...
I0425 19:53:20.474060 64931 main.go:141] libmachine: Waiting for SSH to be available...
I0425 19:53:20.474065 64931 main.go:141] libmachine: Getting to WaitForSSH function...
I0425 19:53:20.474071 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHHostname
I0425 19:53:20.476575 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:20.476936 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:20.476964 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:20.477120 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHPort
I0425 19:53:20.477286 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHKeyPath
I0425 19:53:20.477428 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHKeyPath
I0425 19:53:20.477551 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHUsername
I0425 19:53:20.477710 64931 main.go:141] libmachine: Using SSH client type: native
I0425 19:53:20.477951 64931 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.136 22 <nil> <nil>}
I0425 19:53:20.477969 64931 main.go:141] libmachine: About to run SSH command:
exit 0
I0425 19:53:20.605934 64931 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0425 19:53:20.605958 64931 main.go:141] libmachine: Detecting the provisioner...
I0425 19:53:20.605968 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHHostname
I0425 19:53:20.608756 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:20.609182 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:20.609230 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:20.609362 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHPort
I0425 19:53:20.609542 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHKeyPath
I0425 19:53:20.609710 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHKeyPath
I0425 19:53:20.609904 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHUsername
I0425 19:53:20.610080 64931 main.go:141] libmachine: Using SSH client type: native
I0425 19:53:20.610330 64931 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.136 22 <nil> <nil>}
I0425 19:53:20.610343 64931 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0425 19:53:20.733484 64931 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0425 19:53:20.733562 64931 main.go:141] libmachine: found compatible host: buildroot
I0425 19:53:20.733576 64931 main.go:141] libmachine: Provisioning with buildroot...
I0425 19:53:20.733588 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetMachineName
I0425 19:53:20.733895 64931 buildroot.go:166] provisioning hostname "old-k8s-version-210442"
I0425 19:53:20.733920 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetMachineName
I0425 19:53:20.734110 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHHostname
I0425 19:53:20.738005 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:20.738391 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:20.738427 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:20.738567 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHPort
I0425 19:53:20.738761 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHKeyPath
I0425 19:53:20.739157 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHKeyPath
I0425 19:53:20.739532 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHUsername
I0425 19:53:20.739726 64931 main.go:141] libmachine: Using SSH client type: native
I0425 19:53:20.739946 64931 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.136 22 <nil> <nil>}
I0425 19:53:20.739966 64931 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-210442 && echo "old-k8s-version-210442" | sudo tee /etc/hostname
I0425 19:53:20.887240 64931 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-210442
I0425 19:53:20.887270 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHHostname
I0425 19:53:20.890040 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:20.890467 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:20.890499 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:20.890663 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHPort
I0425 19:53:20.890839 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHKeyPath
I0425 19:53:20.890958 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHKeyPath
I0425 19:53:20.891136 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHUsername
I0425 19:53:20.891253 64931 main.go:141] libmachine: Using SSH client type: native
I0425 19:53:20.891441 64931 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.136 22 <nil> <nil>}
I0425 19:53:20.891459 64931 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-210442' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-210442/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-210442' | sudo tee -a /etc/hosts;
fi
fi
I0425 19:53:21.028373 64931 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0425 19:53:21.028406 64931 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18757-6355/.minikube CaCertPath:/home/jenkins/minikube-integration/18757-6355/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18757-6355/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18757-6355/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18757-6355/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18757-6355/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18757-6355/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18757-6355/.minikube}
I0425 19:53:21.028431 64931 buildroot.go:174] setting up certificates
I0425 19:53:21.028442 64931 provision.go:84] configureAuth start
I0425 19:53:21.028451 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetMachineName
I0425 19:53:21.028760 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetIP
I0425 19:53:21.031665 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:21.032074 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:21.032115 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:21.032260 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHHostname
I0425 19:53:21.034829 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:21.035195 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:21.035224 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:21.035403 64931 provision.go:143] copyHostCerts
I0425 19:53:21.035467 64931 exec_runner.go:144] found /home/jenkins/minikube-integration/18757-6355/.minikube/ca.pem, removing ...
I0425 19:53:21.035477 64931 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18757-6355/.minikube/ca.pem
I0425 19:53:21.035543 64931 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18757-6355/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18757-6355/.minikube/ca.pem (1082 bytes)
I0425 19:53:21.035697 64931 exec_runner.go:144] found /home/jenkins/minikube-integration/18757-6355/.minikube/cert.pem, removing ...
I0425 19:53:21.035706 64931 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18757-6355/.minikube/cert.pem
I0425 19:53:21.035736 64931 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18757-6355/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18757-6355/.minikube/cert.pem (1123 bytes)
I0425 19:53:21.035823 64931 exec_runner.go:144] found /home/jenkins/minikube-integration/18757-6355/.minikube/key.pem, removing ...
I0425 19:53:21.035830 64931 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18757-6355/.minikube/key.pem
I0425 19:53:21.035857 64931 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18757-6355/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18757-6355/.minikube/key.pem (1679 bytes)
I0425 19:53:21.035923 64931 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18757-6355/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18757-6355/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18757-6355/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-210442 san=[127.0.0.1 192.168.61.136 localhost minikube old-k8s-version-210442]
I0425 19:53:21.220917 64931 provision.go:177] copyRemoteCerts
I0425 19:53:21.220969 64931 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0425 19:53:21.220991 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHHostname
I0425 19:53:21.224214 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:21.224855 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:21.224885 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:21.224924 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHPort
I0425 19:53:21.225119 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHKeyPath
I0425 19:53:21.225311 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHUsername
I0425 19:53:21.225448 64931 sshutil.go:53] new ssh client: &{IP:192.168.61.136 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18757-6355/.minikube/machines/old-k8s-version-210442/id_rsa Username:docker}
I0425 19:53:21.326079 64931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18757-6355/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0425 19:53:21.361842 64931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18757-6355/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0425 19:53:21.395359 64931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18757-6355/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0425 19:53:21.429866 64931 provision.go:87] duration metric: took 401.411591ms to configureAuth
I0425 19:53:21.429897 64931 buildroot.go:189] setting minikube options for container-runtime
I0425 19:53:21.430078 64931 config.go:182] Loaded profile config "old-k8s-version-210442": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0425 19:53:21.430163 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHHostname
I0425 19:53:21.433083 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:21.433438 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:21.433464 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:21.433605 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHPort
I0425 19:53:21.433777 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHKeyPath
I0425 19:53:21.433958 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHKeyPath
I0425 19:53:21.434101 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHUsername
I0425 19:53:21.434291 64931 main.go:141] libmachine: Using SSH client type: native
I0425 19:53:21.434515 64931 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.136 22 <nil> <nil>}
I0425 19:53:21.434539 64931 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0425 19:53:21.973332 64931 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0425 19:53:21.973357 64931 main.go:141] libmachine: Checking connection to Docker...
I0425 19:53:21.973365 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetURL
I0425 19:53:21.974715 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | Using libvirt version 6000000
I0425 19:53:21.977700 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:21.978405 64931 main.go:141] libmachine: Docker is up and running!
I0425 19:53:21.978430 64931 main.go:141] libmachine: Reticulating splines...
I0425 19:53:21.978438 64931 client.go:171] duration metric: took 33.261224201s to LocalClient.Create
I0425 19:53:21.978455 64931 start.go:167] duration metric: took 33.261279179s to libmachine.API.Create "old-k8s-version-210442"
I0425 19:53:21.978464 64931 start.go:293] postStartSetup for "old-k8s-version-210442" (driver="kvm2")
I0425 19:53:21.978473 64931 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0425 19:53:21.978503 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .DriverName
I0425 19:53:21.978223 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:21.978716 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:21.978766 64931 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0425 19:53:21.978790 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHHostname
I0425 19:53:21.983288 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:21.983691 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:21.983754 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:21.983942 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHPort
I0425 19:53:21.984128 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHKeyPath
I0425 19:53:21.984321 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHUsername
I0425 19:53:21.984564 64931 sshutil.go:53] new ssh client: &{IP:192.168.61.136 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18757-6355/.minikube/machines/old-k8s-version-210442/id_rsa Username:docker}
I0425 19:53:22.078894 64931 ssh_runner.go:195] Run: cat /etc/os-release
I0425 19:53:22.084802 64931 info.go:137] Remote host: Buildroot 2023.02.9
I0425 19:53:22.084841 64931 filesync.go:126] Scanning /home/jenkins/minikube-integration/18757-6355/.minikube/addons for local assets ...
I0425 19:53:22.084916 64931 filesync.go:126] Scanning /home/jenkins/minikube-integration/18757-6355/.minikube/files for local assets ...
I0425 19:53:22.085001 64931 filesync.go:149] local asset: /home/jenkins/minikube-integration/18757-6355/.minikube/files/etc/ssl/certs/136822.pem -> 136822.pem in /etc/ssl/certs
I0425 19:53:22.085116 64931 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0425 19:53:22.096232 64931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18757-6355/.minikube/files/etc/ssl/certs/136822.pem --> /etc/ssl/certs/136822.pem (1708 bytes)
I0425 19:53:22.126871 64931 start.go:296] duration metric: took 148.386359ms for postStartSetup
I0425 19:53:22.126934 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetConfigRaw
I0425 19:53:22.174371 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetIP
I0425 19:53:22.177535 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:22.177928 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:22.177965 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:22.178351 64931 profile.go:143] Saving config to /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/config.json ...
I0425 19:53:22.239191 64931 start.go:128] duration metric: took 33.546644805s to createHost
I0425 19:53:22.239242 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHHostname
I0425 19:53:22.242386 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:22.242737 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:22.242769 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:22.242949 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHPort
I0425 19:53:22.243209 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHKeyPath
I0425 19:53:22.243424 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHKeyPath
I0425 19:53:22.243586 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHUsername
I0425 19:53:22.243742 64931 main.go:141] libmachine: Using SSH client type: native
I0425 19:53:22.243968 64931 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.61.136 22 <nil> <nil>}
I0425 19:53:22.243986 64931 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0425 19:53:22.374747 64931 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714074802.364049295
I0425 19:53:22.374770 64931 fix.go:216] guest clock: 1714074802.364049295
I0425 19:53:22.374780 64931 fix.go:229] Guest: 2024-04-25 19:53:22.364049295 +0000 UTC Remote: 2024-04-25 19:53:22.239220738 +0000 UTC m=+64.299693658 (delta=124.828557ms)
I0425 19:53:22.374828 64931 fix.go:200] guest clock delta is within tolerance: 124.828557ms
I0425 19:53:22.374838 64931 start.go:83] releasing machines lock for "old-k8s-version-210442", held for 33.682515011s
I0425 19:53:22.374862 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .DriverName
I0425 19:53:22.375139 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetIP
I0425 19:53:22.379083 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:22.379362 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:22.379383 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:22.379691 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .DriverName
I0425 19:53:22.380720 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .DriverName
I0425 19:53:22.380932 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .DriverName
I0425 19:53:22.381014 64931 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0425 19:53:22.381048 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHHostname
I0425 19:53:22.381373 64931 ssh_runner.go:195] Run: cat /version.json
I0425 19:53:22.381390 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHHostname
I0425 19:53:22.384375 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:22.384879 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:22.384902 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:22.385044 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHPort
I0425 19:53:22.385162 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHKeyPath
I0425 19:53:22.385259 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHUsername
I0425 19:53:22.385364 64931 sshutil.go:53] new ssh client: &{IP:192.168.61.136 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18757-6355/.minikube/machines/old-k8s-version-210442/id_rsa Username:docker}
I0425 19:53:22.394953 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:22.397309 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:22.397384 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:22.397554 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHPort
I0425 19:53:22.397731 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHKeyPath
I0425 19:53:22.397892 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetSSHUsername
I0425 19:53:22.398080 64931 sshutil.go:53] new ssh client: &{IP:192.168.61.136 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18757-6355/.minikube/machines/old-k8s-version-210442/id_rsa Username:docker}
I0425 19:53:22.489094 64931 ssh_runner.go:195] Run: systemctl --version
I0425 19:53:22.517994 64931 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0425 19:53:22.700025 64931 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0425 19:53:22.708589 64931 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0425 19:53:22.708670 64931 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0425 19:53:22.730925 64931 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0425 19:53:22.730948 64931 start.go:494] detecting cgroup driver to use...
I0425 19:53:22.731003 64931 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0425 19:53:22.754650 64931 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0425 19:53:22.780391 64931 docker.go:217] disabling cri-docker service (if available) ...
I0425 19:53:22.780476 64931 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0425 19:53:22.800520 64931 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0425 19:53:22.817449 64931 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0425 19:53:22.970919 64931 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0425 19:53:23.147024 64931 docker.go:233] disabling docker service ...
I0425 19:53:23.147078 64931 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0425 19:53:23.170261 64931 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0425 19:53:23.192848 64931 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0425 19:53:23.374021 64931 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0425 19:53:23.534299 64931 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0425 19:53:23.554824 64931 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0425 19:53:23.585684 64931 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0425 19:53:23.585755 64931 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0425 19:53:23.602325 64931 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0425 19:53:23.602405 64931 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0425 19:53:23.619086 64931 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0425 19:53:23.635939 64931 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0425 19:53:23.651537 64931 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0425 19:53:23.668067 64931 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0425 19:53:23.689555 64931 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0425 19:53:23.689630 64931 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0425 19:53:23.715320 64931 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0425 19:53:23.727021 64931 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0425 19:53:23.877482 64931 ssh_runner.go:195] Run: sudo systemctl restart crio
I0425 19:53:24.067502 64931 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0425 19:53:24.067586 64931 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0425 19:53:24.074729 64931 start.go:562] Will wait 60s for crictl version
I0425 19:53:24.074782 64931 ssh_runner.go:195] Run: which crictl
I0425 19:53:24.080638 64931 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0425 19:53:24.129322 64931 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0425 19:53:24.129407 64931 ssh_runner.go:195] Run: crio --version
I0425 19:53:24.164531 64931 ssh_runner.go:195] Run: crio --version
I0425 19:53:24.211157 64931 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0425 19:53:24.212890 64931 main.go:141] libmachine: (old-k8s-version-210442) Calling .GetIP
I0425 19:53:24.216088 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:24.216509 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:11:0b:ca", ip: ""} in network mk-old-k8s-version-210442: {Iface:virbr4 ExpiryTime:2024-04-25 20:53:07 +0000 UTC Type:0 Mac:52:54:00:11:0b:ca Iaid: IPaddr:192.168.61.136 Prefix:24 Hostname:old-k8s-version-210442 Clientid:01:52:54:00:11:0b:ca}
I0425 19:53:24.216541 64931 main.go:141] libmachine: (old-k8s-version-210442) DBG | domain old-k8s-version-210442 has defined IP address 192.168.61.136 and MAC address 52:54:00:11:0b:ca in network mk-old-k8s-version-210442
I0425 19:53:24.216742 64931 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0425 19:53:24.223404 64931 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0425 19:53:24.244051 64931 kubeadm.go:877] updating cluster {Name:old-k8s-version-210442 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-210442 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.136 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0425 19:53:24.244171 64931 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0425 19:53:24.244223 64931 ssh_runner.go:195] Run: sudo crictl images --output json
I0425 19:53:24.293109 64931 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0425 19:53:24.293178 64931 ssh_runner.go:195] Run: which lz4
I0425 19:53:24.299155 64931 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0425 19:53:24.305234 64931 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0425 19:53:24.305272 64931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18757-6355/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0425 19:53:26.582626 64931 crio.go:462] duration metric: took 2.283506669s to copy over tarball
I0425 19:53:26.582694 64931 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0425 19:53:30.531770 64931 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.949039869s)
I0425 19:53:30.531799 64931 crio.go:469] duration metric: took 3.949147243s to extract the tarball
I0425 19:53:30.531806 64931 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0425 19:53:30.586086 64931 ssh_runner.go:195] Run: sudo crictl images --output json
I0425 19:53:30.646196 64931 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0425 19:53:30.646253 64931 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0425 19:53:30.646331 64931 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0425 19:53:30.646388 64931 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0425 19:53:30.646651 64931 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0425 19:53:30.646712 64931 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0425 19:53:30.646737 64931 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0425 19:53:30.646888 64931 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0425 19:53:30.646986 64931 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0425 19:53:30.646339 64931 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0425 19:53:30.647623 64931 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0425 19:53:30.647636 64931 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0425 19:53:30.647644 64931 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0425 19:53:30.647732 64931 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0425 19:53:30.647758 64931 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0425 19:53:30.647813 64931 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0425 19:53:30.647873 64931 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0425 19:53:30.648436 64931 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0425 19:53:30.788807 64931 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0425 19:53:30.795328 64931 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0425 19:53:30.803516 64931 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0425 19:53:30.804585 64931 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0425 19:53:30.810630 64931 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0425 19:53:30.820520 64931 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0425 19:53:30.860532 64931 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0425 19:53:30.933806 64931 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0425 19:53:30.933862 64931 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0425 19:53:30.933920 64931 ssh_runner.go:195] Run: which crictl
I0425 19:53:31.019592 64931 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0425 19:53:31.019638 64931 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0425 19:53:31.019687 64931 ssh_runner.go:195] Run: which crictl
I0425 19:53:31.029705 64931 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0425 19:53:31.029747 64931 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0425 19:53:31.029812 64931 ssh_runner.go:195] Run: which crictl
I0425 19:53:31.035895 64931 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0425 19:53:31.035952 64931 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0425 19:53:31.036009 64931 ssh_runner.go:195] Run: which crictl
I0425 19:53:31.036009 64931 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0425 19:53:31.036039 64931 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0425 19:53:31.036073 64931 ssh_runner.go:195] Run: which crictl
I0425 19:53:31.036108 64931 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0425 19:53:31.036160 64931 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0425 19:53:31.036237 64931 ssh_runner.go:195] Run: which crictl
I0425 19:53:31.061626 64931 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0425 19:53:31.061672 64931 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0425 19:53:31.061718 64931 ssh_runner.go:195] Run: which crictl
I0425 19:53:31.061722 64931 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0425 19:53:31.061775 64931 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0425 19:53:31.061809 64931 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0425 19:53:31.061837 64931 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0425 19:53:31.061884 64931 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0425 19:53:31.061920 64931 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0425 19:53:31.221696 64931 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0425 19:53:31.221790 64931 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18757-6355/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0425 19:53:31.241455 64931 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18757-6355/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0425 19:53:31.241535 64931 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18757-6355/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0425 19:53:31.241571 64931 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18757-6355/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0425 19:53:31.241630 64931 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18757-6355/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0425 19:53:31.241704 64931 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18757-6355/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0425 19:53:31.263169 64931 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18757-6355/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0425 19:53:31.562186 64931 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0425 19:53:31.717709 64931 cache_images.go:92] duration metric: took 1.071435503s to LoadCachedImages
W0425 19:53:31.717875 64931 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18757-6355/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18757-6355/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I0425 19:53:31.717929 64931 kubeadm.go:928] updating node { 192.168.61.136 8443 v1.20.0 crio true true} ...
I0425 19:53:31.718077 64931 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-210442 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.136
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-210442 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0425 19:53:31.718239 64931 ssh_runner.go:195] Run: crio config
I0425 19:53:31.790378 64931 cni.go:84] Creating CNI manager for ""
I0425 19:53:31.790486 64931 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0425 19:53:31.790518 64931 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0425 19:53:31.790570 64931 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.136 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-210442 NodeName:old-k8s-version-210442 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.136"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.136 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0425 19:53:31.790794 64931 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.136
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-210442"
kubeletExtraArgs:
node-ip: 192.168.61.136
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.136"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0425 19:53:31.790921 64931 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0425 19:53:31.808599 64931 binaries.go:44] Found k8s binaries, skipping transfer
I0425 19:53:31.808685 64931 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0425 19:53:31.824250 64931 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0425 19:53:31.853018 64931 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0425 19:53:31.886269 64931 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0425 19:53:31.922584 64931 ssh_runner.go:195] Run: grep 192.168.61.136 control-plane.minikube.internal$ /etc/hosts
I0425 19:53:31.929295 64931 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.136 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0425 19:53:31.949757 64931 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0425 19:53:32.134483 64931 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0425 19:53:32.165679 64931 certs.go:68] Setting up /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442 for IP: 192.168.61.136
I0425 19:53:32.165709 64931 certs.go:194] generating shared ca certs ...
I0425 19:53:32.165729 64931 certs.go:226] acquiring lock for ca certs: {Name:mk3bbe1de7b9dbd80b3410882890f16cc0d1315a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0425 19:53:32.165916 64931 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18757-6355/.minikube/ca.key
I0425 19:53:32.165984 64931 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18757-6355/.minikube/proxy-client-ca.key
I0425 19:53:32.166001 64931 certs.go:256] generating profile certs ...
I0425 19:53:32.166073 64931 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/client.key
I0425 19:53:32.166092 64931 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/client.crt with IP's: []
I0425 19:53:32.433637 64931 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/client.crt ...
I0425 19:53:32.433680 64931 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/client.crt: {Name:mkdc68b904dcb5f81ac68e7eba56450f9d50db26 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0425 19:53:32.433910 64931 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/client.key ...
I0425 19:53:32.433936 64931 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/client.key: {Name:mkc119ee4b2c16bf6ba695391601b24487c622fd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0425 19:53:32.434083 64931 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/apiserver.key.1533c9ac
I0425 19:53:32.434109 64931 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/apiserver.crt.1533c9ac with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.136]
I0425 19:53:32.626791 64931 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/apiserver.crt.1533c9ac ...
I0425 19:53:32.626832 64931 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/apiserver.crt.1533c9ac: {Name:mkfc44346b74462890c6e0557b5528bf865f7b90 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0425 19:53:32.627038 64931 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/apiserver.key.1533c9ac ...
I0425 19:53:32.627056 64931 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/apiserver.key.1533c9ac: {Name:mk35252177723bebf759f89f98270df205f61a01 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0425 19:53:32.627154 64931 certs.go:381] copying /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/apiserver.crt.1533c9ac -> /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/apiserver.crt
I0425 19:53:32.627267 64931 certs.go:385] copying /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/apiserver.key.1533c9ac -> /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/apiserver.key
I0425 19:53:32.627349 64931 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/proxy-client.key
I0425 19:53:32.627374 64931 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/proxy-client.crt with IP's: []
I0425 19:53:32.821046 64931 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/proxy-client.crt ...
I0425 19:53:32.821087 64931 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/proxy-client.crt: {Name:mkfa0ae33bfce5f2eb1f92e8cfbac6e444380012 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0425 19:53:32.821290 64931 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/proxy-client.key ...
I0425 19:53:32.821307 64931 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/proxy-client.key: {Name:mk3ba98a2fdfb1238a118982d89bb537f121e173 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0425 19:53:32.821549 64931 certs.go:484] found cert: /home/jenkins/minikube-integration/18757-6355/.minikube/certs/13682.pem (1338 bytes)
W0425 19:53:32.821612 64931 certs.go:480] ignoring /home/jenkins/minikube-integration/18757-6355/.minikube/certs/13682_empty.pem, impossibly tiny 0 bytes
I0425 19:53:32.821626 64931 certs.go:484] found cert: /home/jenkins/minikube-integration/18757-6355/.minikube/certs/ca-key.pem (1675 bytes)
I0425 19:53:32.821662 64931 certs.go:484] found cert: /home/jenkins/minikube-integration/18757-6355/.minikube/certs/ca.pem (1082 bytes)
I0425 19:53:32.821698 64931 certs.go:484] found cert: /home/jenkins/minikube-integration/18757-6355/.minikube/certs/cert.pem (1123 bytes)
I0425 19:53:32.821731 64931 certs.go:484] found cert: /home/jenkins/minikube-integration/18757-6355/.minikube/certs/key.pem (1679 bytes)
I0425 19:53:32.821786 64931 certs.go:484] found cert: /home/jenkins/minikube-integration/18757-6355/.minikube/files/etc/ssl/certs/136822.pem (1708 bytes)
I0425 19:53:32.823067 64931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18757-6355/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0425 19:53:32.868481 64931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18757-6355/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0425 19:53:32.908291 64931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18757-6355/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0425 19:53:32.951840 64931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18757-6355/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0425 19:53:33.003890 64931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0425 19:53:33.044110 64931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0425 19:53:33.080884 64931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0425 19:53:33.114408 64931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18757-6355/.minikube/profiles/old-k8s-version-210442/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0425 19:53:33.158524 64931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18757-6355/.minikube/files/etc/ssl/certs/136822.pem --> /usr/share/ca-certificates/136822.pem (1708 bytes)
I0425 19:53:33.206516 64931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18757-6355/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0425 19:53:33.246085 64931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18757-6355/.minikube/certs/13682.pem --> /usr/share/ca-certificates/13682.pem (1338 bytes)
I0425 19:53:33.309392 64931 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0425 19:53:33.348015 64931 ssh_runner.go:195] Run: openssl version
I0425 19:53:33.357011 64931 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/136822.pem && ln -fs /usr/share/ca-certificates/136822.pem /etc/ssl/certs/136822.pem"
I0425 19:53:33.374483 64931 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/136822.pem
I0425 19:53:33.381767 64931 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 25 18:45 /usr/share/ca-certificates/136822.pem
I0425 19:53:33.381896 64931 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/136822.pem
I0425 19:53:33.392135 64931 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/136822.pem /etc/ssl/certs/3ec20f2e.0"
I0425 19:53:33.409677 64931 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0425 19:53:33.424480 64931 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0425 19:53:33.430135 64931 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 25 18:32 /usr/share/ca-certificates/minikubeCA.pem
I0425 19:53:33.430193 64931 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0425 19:53:33.436579 64931 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0425 19:53:33.450423 64931 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/13682.pem && ln -fs /usr/share/ca-certificates/13682.pem /etc/ssl/certs/13682.pem"
I0425 19:53:33.467041 64931 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/13682.pem
I0425 19:53:33.473143 64931 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 25 18:45 /usr/share/ca-certificates/13682.pem
I0425 19:53:33.473191 64931 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/13682.pem
I0425 19:53:33.481016 64931 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/13682.pem /etc/ssl/certs/51391683.0"
I0425 19:53:33.496513 64931 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0425 19:53:33.501758 64931 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0425 19:53:33.501830 64931 kubeadm.go:391] StartCluster: {Name:old-k8s-version-210442 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-210442 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.136 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0425 19:53:33.501935 64931 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0425 19:53:33.501992 64931 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0425 19:53:33.546739 64931 cri.go:89] found id: ""
I0425 19:53:33.546881 64931 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0425 19:53:33.561176 64931 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0425 19:53:33.572915 64931 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0425 19:53:33.589009 64931 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0425 19:53:33.589038 64931 kubeadm.go:156] found existing configuration files:
I0425 19:53:33.589090 64931 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0425 19:53:33.602697 64931 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0425 19:53:33.602808 64931 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0425 19:53:33.618278 64931 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0425 19:53:33.633133 64931 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0425 19:53:33.633193 64931 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0425 19:53:33.647349 64931 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0425 19:53:33.662019 64931 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0425 19:53:33.662082 64931 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0425 19:53:33.675385 64931 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0425 19:53:33.690011 64931 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0425 19:53:33.690075 64931 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0425 19:53:33.703405 64931 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0425 19:53:33.885470 64931 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0425 19:53:33.885652 64931 kubeadm.go:309] [preflight] Running pre-flight checks
I0425 19:53:34.062788 64931 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0425 19:53:34.062949 64931 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0425 19:53:34.063114 64931 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0425 19:53:34.358102 64931 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0425 19:53:34.359985 64931 out.go:204] - Generating certificates and keys ...
I0425 19:53:34.363304 64931 kubeadm.go:309] [certs] Using existing ca certificate authority
I0425 19:53:34.363403 64931 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0425 19:53:34.566392 64931 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0425 19:53:35.131077 64931 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0425 19:53:35.248999 64931 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0425 19:53:35.419406 64931 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0425 19:53:35.598586 64931 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0425 19:53:35.598958 64931 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-210442] and IPs [192.168.61.136 127.0.0.1 ::1]
I0425 19:53:35.821027 64931 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0425 19:53:35.821236 64931 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-210442] and IPs [192.168.61.136 127.0.0.1 ::1]
I0425 19:53:36.067133 64931 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0425 19:53:36.203000 64931 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0425 19:53:36.279224 64931 kubeadm.go:309] [certs] Generating "sa" key and public key
I0425 19:53:36.279335 64931 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0425 19:53:36.669279 64931 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0425 19:53:36.803326 64931 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0425 19:53:37.012152 64931 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0425 19:53:37.094375 64931 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0425 19:53:37.112482 64931 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0425 19:53:37.113825 64931 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0425 19:53:37.113954 64931 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0425 19:53:37.290353 64931 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0425 19:53:37.293594 64931 out.go:204] - Booting up control plane ...
I0425 19:53:37.293706 64931 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0425 19:53:37.307387 64931 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0425 19:53:37.308975 64931 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0425 19:53:37.310268 64931 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0425 19:53:37.315380 64931 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0425 19:54:17.315209 64931 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0425 19:54:17.315484 64931 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0425 19:54:17.315788 64931 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0425 19:54:22.316222 64931 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0425 19:54:22.316508 64931 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0425 19:54:32.317359 64931 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0425 19:54:32.317666 64931 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0425 19:54:52.318579 64931 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0425 19:54:52.318861 64931 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0425 19:55:32.318993 64931 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0425 19:55:32.319277 64931 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0425 19:55:32.319300 64931 kubeadm.go:309]
I0425 19:55:32.319348 64931 kubeadm.go:309] Unfortunately, an error has occurred:
I0425 19:55:32.319399 64931 kubeadm.go:309] timed out waiting for the condition
I0425 19:55:32.319418 64931 kubeadm.go:309]
I0425 19:55:32.319464 64931 kubeadm.go:309] This error is likely caused by:
I0425 19:55:32.319510 64931 kubeadm.go:309] - The kubelet is not running
I0425 19:55:32.319646 64931 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0425 19:55:32.319661 64931 kubeadm.go:309]
I0425 19:55:32.319774 64931 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0425 19:55:32.319805 64931 kubeadm.go:309] - 'systemctl status kubelet'
I0425 19:55:32.319834 64931 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0425 19:55:32.319840 64931 kubeadm.go:309]
I0425 19:55:32.319931 64931 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0425 19:55:32.320000 64931 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0425 19:55:32.320007 64931 kubeadm.go:309]
I0425 19:55:32.320089 64931 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0425 19:55:32.320162 64931 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0425 19:55:32.320238 64931 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0425 19:55:32.320316 64931 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0425 19:55:32.320331 64931 kubeadm.go:309]
I0425 19:55:32.321397 64931 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0425 19:55:32.321514 64931 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0425 19:55:32.321597 64931 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0425 19:55:32.321780 64931 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-210442] and IPs [192.168.61.136 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-210442] and IPs [192.168.61.136 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-210442] and IPs [192.168.61.136 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-210442] and IPs [192.168.61.136 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0425 19:55:32.321846 64931 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0425 19:55:35.525280 64931 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (3.203405812s)
I0425 19:55:35.525355 64931 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0425 19:55:35.542057 64931 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0425 19:55:35.553425 64931 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0425 19:55:35.553455 64931 kubeadm.go:156] found existing configuration files:
I0425 19:55:35.553512 64931 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0425 19:55:35.565219 64931 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0425 19:55:35.565281 64931 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0425 19:55:35.577713 64931 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0425 19:55:35.589108 64931 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0425 19:55:35.589157 64931 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0425 19:55:35.601159 64931 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0425 19:55:35.611842 64931 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0425 19:55:35.611906 64931 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0425 19:55:35.623101 64931 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0425 19:55:35.634414 64931 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0425 19:55:35.634466 64931 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0425 19:55:35.645505 64931 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0425 19:55:35.726131 64931 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0425 19:55:35.726188 64931 kubeadm.go:309] [preflight] Running pre-flight checks
I0425 19:55:35.883125 64931 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0425 19:55:35.883236 64931 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0425 19:55:35.883358 64931 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0425 19:55:36.130721 64931 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0425 19:55:36.132213 64931 out.go:204] - Generating certificates and keys ...
I0425 19:55:36.132326 64931 kubeadm.go:309] [certs] Using existing ca certificate authority
I0425 19:55:36.132583 64931 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0425 19:55:36.134196 64931 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0425 19:55:36.134286 64931 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0425 19:55:36.134362 64931 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0425 19:55:36.134433 64931 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0425 19:55:36.135001 64931 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0425 19:55:36.135527 64931 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0425 19:55:36.136093 64931 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0425 19:55:36.136592 64931 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0425 19:55:36.136853 64931 kubeadm.go:309] [certs] Using the existing "sa" key
I0425 19:55:36.136983 64931 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0425 19:55:36.333739 64931 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0425 19:55:36.427372 64931 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0425 19:55:36.532648 64931 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0425 19:55:36.951649 64931 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0425 19:55:36.971195 64931 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0425 19:55:36.972465 64931 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0425 19:55:36.972574 64931 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0425 19:55:37.165124 64931 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0425 19:55:37.166969 64931 out.go:204] - Booting up control plane ...
I0425 19:55:37.167051 64931 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0425 19:55:37.185410 64931 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0425 19:55:37.186877 64931 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0425 19:55:37.188489 64931 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0425 19:55:37.192335 64931 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0425 19:56:17.195402 64931 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0425 19:56:17.195740 64931 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0425 19:56:17.196238 64931 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0425 19:56:22.197261 64931 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0425 19:56:22.197459 64931 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0425 19:56:32.198413 64931 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0425 19:56:32.198646 64931 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0425 19:56:52.199746 64931 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0425 19:56:52.199945 64931 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0425 19:57:32.198680 64931 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0425 19:57:32.198925 64931 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0425 19:57:32.198943 64931 kubeadm.go:309]
I0425 19:57:32.199000 64931 kubeadm.go:309] Unfortunately, an error has occurred:
I0425 19:57:32.199053 64931 kubeadm.go:309] timed out waiting for the condition
I0425 19:57:32.199084 64931 kubeadm.go:309]
I0425 19:57:32.199140 64931 kubeadm.go:309] This error is likely caused by:
I0425 19:57:32.199186 64931 kubeadm.go:309] - The kubelet is not running
I0425 19:57:32.199334 64931 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0425 19:57:32.199345 64931 kubeadm.go:309]
I0425 19:57:32.199475 64931 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0425 19:57:32.199533 64931 kubeadm.go:309] - 'systemctl status kubelet'
I0425 19:57:32.199583 64931 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0425 19:57:32.199598 64931 kubeadm.go:309]
I0425 19:57:32.199748 64931 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0425 19:57:32.199850 64931 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0425 19:57:32.199863 64931 kubeadm.go:309]
I0425 19:57:32.200023 64931 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0425 19:57:32.200153 64931 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0425 19:57:32.200246 64931 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0425 19:57:32.200346 64931 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0425 19:57:32.200372 64931 kubeadm.go:309]
I0425 19:57:32.201435 64931 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0425 19:57:32.201530 64931 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0425 19:57:32.201595 64931 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0425 19:57:32.201647 64931 kubeadm.go:393] duration metric: took 3m58.699822508s to StartCluster
I0425 19:57:32.201707 64931 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0425 19:57:32.201761 64931 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0425 19:57:32.247023 64931 cri.go:89] found id: ""
I0425 19:57:32.247047 64931 logs.go:276] 0 containers: []
W0425 19:57:32.247054 64931 logs.go:278] No container was found matching "kube-apiserver"
I0425 19:57:32.247060 64931 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0425 19:57:32.247115 64931 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0425 19:57:32.284910 64931 cri.go:89] found id: ""
I0425 19:57:32.284939 64931 logs.go:276] 0 containers: []
W0425 19:57:32.284950 64931 logs.go:278] No container was found matching "etcd"
I0425 19:57:32.284956 64931 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0425 19:57:32.285018 64931 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0425 19:57:32.320326 64931 cri.go:89] found id: ""
I0425 19:57:32.320351 64931 logs.go:276] 0 containers: []
W0425 19:57:32.320362 64931 logs.go:278] No container was found matching "coredns"
I0425 19:57:32.320369 64931 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0425 19:57:32.320424 64931 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0425 19:57:32.356503 64931 cri.go:89] found id: ""
I0425 19:57:32.356526 64931 logs.go:276] 0 containers: []
W0425 19:57:32.356536 64931 logs.go:278] No container was found matching "kube-scheduler"
I0425 19:57:32.356544 64931 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0425 19:57:32.356597 64931 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0425 19:57:32.391404 64931 cri.go:89] found id: ""
I0425 19:57:32.391425 64931 logs.go:276] 0 containers: []
W0425 19:57:32.391432 64931 logs.go:278] No container was found matching "kube-proxy"
I0425 19:57:32.391437 64931 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0425 19:57:32.391487 64931 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0425 19:57:32.428356 64931 cri.go:89] found id: ""
I0425 19:57:32.428388 64931 logs.go:276] 0 containers: []
W0425 19:57:32.428396 64931 logs.go:278] No container was found matching "kube-controller-manager"
I0425 19:57:32.428402 64931 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0425 19:57:32.428462 64931 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0425 19:57:32.482693 64931 cri.go:89] found id: ""
I0425 19:57:32.482721 64931 logs.go:276] 0 containers: []
W0425 19:57:32.482729 64931 logs.go:278] No container was found matching "kindnet"
I0425 19:57:32.482737 64931 logs.go:123] Gathering logs for kubelet ...
I0425 19:57:32.482750 64931 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0425 19:57:32.535482 64931 logs.go:123] Gathering logs for dmesg ...
I0425 19:57:32.535515 64931 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0425 19:57:32.550608 64931 logs.go:123] Gathering logs for describe nodes ...
I0425 19:57:32.550635 64931 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0425 19:57:32.676486 64931 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0425 19:57:32.676516 64931 logs.go:123] Gathering logs for CRI-O ...
I0425 19:57:32.676530 64931 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0425 19:57:32.775490 64931 logs.go:123] Gathering logs for container status ...
I0425 19:57:32.775523 64931 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0425 19:57:32.818978 64931 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0425 19:57:32.819024 64931 out.go:239] *
*
W0425 19:57:32.819076 64931 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0425 19:57:32.819098 64931 out.go:239] *
*
W0425 19:57:32.819961 64931 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0425 19:57:32.823516 64931 out.go:177]
W0425 19:57:32.824901 64931 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0425 19:57:32.824962 64931 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0425 19:57:32.824988 64931 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0425 19:57:32.827107 64931 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-210442 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-210442 -n old-k8s-version-210442
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-210442 -n old-k8s-version-210442: exit status 6 (243.196202ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0425 19:57:33.107829 71650 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-210442" does not appear in /home/jenkins/minikube-integration/18757-6355/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-210442" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (315.19s)