=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-556121 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
E0914 17:58:48.015412 16016 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/functional-764671/client.crt: no such file or directory" logger="UnhandledError"
E0914 17:59:04.946525 16016 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/functional-764671/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-556121 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m28.86159741s)
-- stdout --
* [old-k8s-version-556121] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19643
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19643-8806/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19643-8806/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-556121" primary control-plane node in "old-k8s-version-556121" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0914 17:58:46.248253 58869 out.go:345] Setting OutFile to fd 1 ...
I0914 17:58:46.248569 58869 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0914 17:58:46.248580 58869 out.go:358] Setting ErrFile to fd 2...
I0914 17:58:46.248586 58869 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0914 17:58:46.248804 58869 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19643-8806/.minikube/bin
I0914 17:58:46.249440 58869 out.go:352] Setting JSON to false
I0914 17:58:46.250526 58869 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":6070,"bootTime":1726330656,"procs":211,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1068-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0914 17:58:46.250634 58869 start.go:139] virtualization: kvm guest
I0914 17:58:46.253110 58869 out.go:177] * [old-k8s-version-556121] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I0914 17:58:46.254623 58869 notify.go:220] Checking for updates...
I0914 17:58:46.254639 58869 out.go:177] - MINIKUBE_LOCATION=19643
I0914 17:58:46.255872 58869 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0914 17:58:46.257119 58869 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19643-8806/kubeconfig
I0914 17:58:46.258535 58869 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19643-8806/.minikube
I0914 17:58:46.259842 58869 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0914 17:58:46.261127 58869 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0914 17:58:46.262978 58869 config.go:182] Loaded profile config "cert-expiration-724454": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0914 17:58:46.263116 58869 config.go:182] Loaded profile config "kubernetes-upgrade-470019": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0914 17:58:46.263264 58869 config.go:182] Loaded profile config "stopped-upgrade-319416": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.24.1
I0914 17:58:46.263378 58869 driver.go:394] Setting default libvirt URI to qemu:///system
I0914 17:58:46.303121 58869 out.go:177] * Using the kvm2 driver based on user configuration
I0914 17:58:46.304469 58869 start.go:297] selected driver: kvm2
I0914 17:58:46.304484 58869 start.go:901] validating driver "kvm2" against <nil>
I0914 17:58:46.304500 58869 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0914 17:58:46.305205 58869 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0914 17:58:46.305288 58869 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19643-8806/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0914 17:58:46.321191 58869 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0
I0914 17:58:46.321249 58869 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0914 17:58:46.321540 58869 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0914 17:58:46.321587 58869 cni.go:84] Creating CNI manager for ""
I0914 17:58:46.321644 58869 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0914 17:58:46.321661 58869 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0914 17:58:46.321740 58869 start.go:340] cluster config:
{Name:old-k8s-version-556121 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-556121 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0914 17:58:46.321893 58869 iso.go:125] acquiring lock: {Name:mk538f7a4abc7956f82511183088cbfac1e66ebb Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0914 17:58:46.324006 58869 out.go:177] * Starting "old-k8s-version-556121" primary control-plane node in "old-k8s-version-556121" cluster
I0914 17:58:46.325279 58869 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0914 17:58:46.325339 58869 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19643-8806/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0914 17:58:46.325364 58869 cache.go:56] Caching tarball of preloaded images
I0914 17:58:46.325482 58869 preload.go:172] Found /home/jenkins/minikube-integration/19643-8806/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0914 17:58:46.325497 58869 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0914 17:58:46.325646 58869 profile.go:143] Saving config to /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/config.json ...
I0914 17:58:46.325686 58869 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/config.json: {Name:mka2de300a20de90b964d8913e88dc862d0ec6c8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:58:46.325904 58869 start.go:360] acquireMachinesLock for old-k8s-version-556121: {Name:mk26748ac63472c3f8b6f3848c12e76160c2970c Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0914 17:58:46.325958 58869 start.go:364] duration metric: took 29.115µs to acquireMachinesLock for "old-k8s-version-556121"
I0914 17:58:46.325985 58869 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-556121 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19643/minikube-v1.34.0-1726281733-19643-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-556121 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0914 17:58:46.326073 58869 start.go:125] createHost starting for "" (driver="kvm2")
I0914 17:58:46.328574 58869 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0914 17:58:46.328781 58869 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0914 17:58:46.328837 58869 main.go:141] libmachine: Launching plugin server for driver kvm2
I0914 17:58:46.344454 58869 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41631
I0914 17:58:46.344944 58869 main.go:141] libmachine: () Calling .GetVersion
I0914 17:58:46.345633 58869 main.go:141] libmachine: Using API Version 1
I0914 17:58:46.345663 58869 main.go:141] libmachine: () Calling .SetConfigRaw
I0914 17:58:46.346097 58869 main.go:141] libmachine: () Calling .GetMachineName
I0914 17:58:46.346344 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetMachineName
I0914 17:58:46.346525 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .DriverName
I0914 17:58:46.346691 58869 start.go:159] libmachine.API.Create for "old-k8s-version-556121" (driver="kvm2")
I0914 17:58:46.346725 58869 client.go:168] LocalClient.Create starting
I0914 17:58:46.346754 58869 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19643-8806/.minikube/certs/ca.pem
I0914 17:58:46.346789 58869 main.go:141] libmachine: Decoding PEM data...
I0914 17:58:46.346806 58869 main.go:141] libmachine: Parsing certificate...
I0914 17:58:46.346855 58869 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19643-8806/.minikube/certs/cert.pem
I0914 17:58:46.346874 58869 main.go:141] libmachine: Decoding PEM data...
I0914 17:58:46.346887 58869 main.go:141] libmachine: Parsing certificate...
I0914 17:58:46.346906 58869 main.go:141] libmachine: Running pre-create checks...
I0914 17:58:46.346920 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .PreCreateCheck
I0914 17:58:46.347348 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetConfigRaw
I0914 17:58:46.347710 58869 main.go:141] libmachine: Creating machine...
I0914 17:58:46.347723 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .Create
I0914 17:58:46.347855 58869 main.go:141] libmachine: (old-k8s-version-556121) Creating KVM machine...
I0914 17:58:46.349021 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found existing default KVM network
I0914 17:58:46.351684 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:46.351485 58892 network.go:209] skipping subnet 192.168.39.0/24 that is reserved: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0914 17:58:46.352444 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:46.352364 58892 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:51:2b:d7} reservation:<nil>}
I0914 17:58:46.353250 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:46.353195 58892 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:2b:09:15} reservation:<nil>}
I0914 17:58:46.353979 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:46.353919 58892 network.go:211] skipping subnet 192.168.72.0/24 that is taken: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.72.1 IfaceMTU:1500 IfaceMAC:52:54:00:13:eb:94} reservation:<nil>}
I0914 17:58:46.355201 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:46.355080 58892 network.go:206] using free private subnet 192.168.83.0/24: &{IP:192.168.83.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.83.0/24 Gateway:192.168.83.1 ClientMin:192.168.83.2 ClientMax:192.168.83.254 Broadcast:192.168.83.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00042c610}
I0914 17:58:46.355234 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | created network xml:
I0914 17:58:46.355247 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | <network>
I0914 17:58:46.355263 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | <name>mk-old-k8s-version-556121</name>
I0914 17:58:46.355276 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | <dns enable='no'/>
I0914 17:58:46.355285 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG |
I0914 17:58:46.355302 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | <ip address='192.168.83.1' netmask='255.255.255.0'>
I0914 17:58:46.355322 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | <dhcp>
I0914 17:58:46.355347 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | <range start='192.168.83.2' end='192.168.83.253'/>
I0914 17:58:46.355364 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | </dhcp>
I0914 17:58:46.355374 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | </ip>
I0914 17:58:46.355381 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG |
I0914 17:58:46.355390 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | </network>
I0914 17:58:46.355399 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG |
I0914 17:58:46.361028 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | trying to create private KVM network mk-old-k8s-version-556121 192.168.83.0/24...
I0914 17:58:46.433621 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | private KVM network mk-old-k8s-version-556121 192.168.83.0/24 created
I0914 17:58:46.433699 58869 main.go:141] libmachine: (old-k8s-version-556121) Setting up store path in /home/jenkins/minikube-integration/19643-8806/.minikube/machines/old-k8s-version-556121 ...
I0914 17:58:46.433774 58869 main.go:141] libmachine: (old-k8s-version-556121) Building disk image from file:///home/jenkins/minikube-integration/19643-8806/.minikube/cache/iso/amd64/minikube-v1.34.0-1726281733-19643-amd64.iso
I0914 17:58:46.433888 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:46.433578 58892 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19643-8806/.minikube
I0914 17:58:46.434532 58869 main.go:141] libmachine: (old-k8s-version-556121) Downloading /home/jenkins/minikube-integration/19643-8806/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19643-8806/.minikube/cache/iso/amd64/minikube-v1.34.0-1726281733-19643-amd64.iso...
I0914 17:58:46.685468 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:46.685300 58892 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19643-8806/.minikube/machines/old-k8s-version-556121/id_rsa...
I0914 17:58:46.826926 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:46.826790 58892 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19643-8806/.minikube/machines/old-k8s-version-556121/old-k8s-version-556121.rawdisk...
I0914 17:58:46.826958 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | Writing magic tar header
I0914 17:58:46.826976 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | Writing SSH key tar header
I0914 17:58:46.826990 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:46.826893 58892 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19643-8806/.minikube/machines/old-k8s-version-556121 ...
I0914 17:58:46.827005 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19643-8806/.minikube/machines/old-k8s-version-556121
I0914 17:58:46.827019 58869 main.go:141] libmachine: (old-k8s-version-556121) Setting executable bit set on /home/jenkins/minikube-integration/19643-8806/.minikube/machines/old-k8s-version-556121 (perms=drwx------)
I0914 17:58:46.827033 58869 main.go:141] libmachine: (old-k8s-version-556121) Setting executable bit set on /home/jenkins/minikube-integration/19643-8806/.minikube/machines (perms=drwxr-xr-x)
I0914 17:58:46.827046 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19643-8806/.minikube/machines
I0914 17:58:46.827058 58869 main.go:141] libmachine: (old-k8s-version-556121) Setting executable bit set on /home/jenkins/minikube-integration/19643-8806/.minikube (perms=drwxr-xr-x)
I0914 17:58:46.827073 58869 main.go:141] libmachine: (old-k8s-version-556121) Setting executable bit set on /home/jenkins/minikube-integration/19643-8806 (perms=drwxrwxr-x)
I0914 17:58:46.827106 58869 main.go:141] libmachine: (old-k8s-version-556121) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0914 17:58:46.827119 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19643-8806/.minikube
I0914 17:58:46.827129 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19643-8806
I0914 17:58:46.827138 58869 main.go:141] libmachine: (old-k8s-version-556121) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0914 17:58:46.827148 58869 main.go:141] libmachine: (old-k8s-version-556121) Creating domain...
I0914 17:58:46.827158 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0914 17:58:46.827167 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | Checking permissions on dir: /home/jenkins
I0914 17:58:46.827181 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | Checking permissions on dir: /home
I0914 17:58:46.827191 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | Skipping /home - not owner
I0914 17:58:46.828505 58869 main.go:141] libmachine: (old-k8s-version-556121) define libvirt domain using xml:
I0914 17:58:46.828526 58869 main.go:141] libmachine: (old-k8s-version-556121) <domain type='kvm'>
I0914 17:58:46.828535 58869 main.go:141] libmachine: (old-k8s-version-556121) <name>old-k8s-version-556121</name>
I0914 17:58:46.828544 58869 main.go:141] libmachine: (old-k8s-version-556121) <memory unit='MiB'>2200</memory>
I0914 17:58:46.828550 58869 main.go:141] libmachine: (old-k8s-version-556121) <vcpu>2</vcpu>
I0914 17:58:46.828556 58869 main.go:141] libmachine: (old-k8s-version-556121) <features>
I0914 17:58:46.828563 58869 main.go:141] libmachine: (old-k8s-version-556121) <acpi/>
I0914 17:58:46.828569 58869 main.go:141] libmachine: (old-k8s-version-556121) <apic/>
I0914 17:58:46.828576 58869 main.go:141] libmachine: (old-k8s-version-556121) <pae/>
I0914 17:58:46.828584 58869 main.go:141] libmachine: (old-k8s-version-556121)
I0914 17:58:46.828595 58869 main.go:141] libmachine: (old-k8s-version-556121) </features>
I0914 17:58:46.828603 58869 main.go:141] libmachine: (old-k8s-version-556121) <cpu mode='host-passthrough'>
I0914 17:58:46.828612 58869 main.go:141] libmachine: (old-k8s-version-556121)
I0914 17:58:46.828624 58869 main.go:141] libmachine: (old-k8s-version-556121) </cpu>
I0914 17:58:46.828653 58869 main.go:141] libmachine: (old-k8s-version-556121) <os>
I0914 17:58:46.828677 58869 main.go:141] libmachine: (old-k8s-version-556121) <type>hvm</type>
I0914 17:58:46.828686 58869 main.go:141] libmachine: (old-k8s-version-556121) <boot dev='cdrom'/>
I0914 17:58:46.828696 58869 main.go:141] libmachine: (old-k8s-version-556121) <boot dev='hd'/>
I0914 17:58:46.828705 58869 main.go:141] libmachine: (old-k8s-version-556121) <bootmenu enable='no'/>
I0914 17:58:46.828713 58869 main.go:141] libmachine: (old-k8s-version-556121) </os>
I0914 17:58:46.828720 58869 main.go:141] libmachine: (old-k8s-version-556121) <devices>
I0914 17:58:46.828730 58869 main.go:141] libmachine: (old-k8s-version-556121) <disk type='file' device='cdrom'>
I0914 17:58:46.828745 58869 main.go:141] libmachine: (old-k8s-version-556121) <source file='/home/jenkins/minikube-integration/19643-8806/.minikube/machines/old-k8s-version-556121/boot2docker.iso'/>
I0914 17:58:46.828759 58869 main.go:141] libmachine: (old-k8s-version-556121) <target dev='hdc' bus='scsi'/>
I0914 17:58:46.828847 58869 main.go:141] libmachine: (old-k8s-version-556121) <readonly/>
I0914 17:58:46.828883 58869 main.go:141] libmachine: (old-k8s-version-556121) </disk>
I0914 17:58:46.828906 58869 main.go:141] libmachine: (old-k8s-version-556121) <disk type='file' device='disk'>
I0914 17:58:46.828926 58869 main.go:141] libmachine: (old-k8s-version-556121) <driver name='qemu' type='raw' cache='default' io='threads' />
I0914 17:58:46.828966 58869 main.go:141] libmachine: (old-k8s-version-556121) <source file='/home/jenkins/minikube-integration/19643-8806/.minikube/machines/old-k8s-version-556121/old-k8s-version-556121.rawdisk'/>
I0914 17:58:46.828978 58869 main.go:141] libmachine: (old-k8s-version-556121) <target dev='hda' bus='virtio'/>
I0914 17:58:46.828986 58869 main.go:141] libmachine: (old-k8s-version-556121) </disk>
I0914 17:58:46.829001 58869 main.go:141] libmachine: (old-k8s-version-556121) <interface type='network'>
I0914 17:58:46.829014 58869 main.go:141] libmachine: (old-k8s-version-556121) <source network='mk-old-k8s-version-556121'/>
I0914 17:58:46.829024 58869 main.go:141] libmachine: (old-k8s-version-556121) <model type='virtio'/>
I0914 17:58:46.829035 58869 main.go:141] libmachine: (old-k8s-version-556121) </interface>
I0914 17:58:46.829045 58869 main.go:141] libmachine: (old-k8s-version-556121) <interface type='network'>
I0914 17:58:46.829055 58869 main.go:141] libmachine: (old-k8s-version-556121) <source network='default'/>
I0914 17:58:46.829070 58869 main.go:141] libmachine: (old-k8s-version-556121) <model type='virtio'/>
I0914 17:58:46.829082 58869 main.go:141] libmachine: (old-k8s-version-556121) </interface>
I0914 17:58:46.829096 58869 main.go:141] libmachine: (old-k8s-version-556121) <serial type='pty'>
I0914 17:58:46.829117 58869 main.go:141] libmachine: (old-k8s-version-556121) <target port='0'/>
I0914 17:58:46.829129 58869 main.go:141] libmachine: (old-k8s-version-556121) </serial>
I0914 17:58:46.829139 58869 main.go:141] libmachine: (old-k8s-version-556121) <console type='pty'>
I0914 17:58:46.829148 58869 main.go:141] libmachine: (old-k8s-version-556121) <target type='serial' port='0'/>
I0914 17:58:46.829159 58869 main.go:141] libmachine: (old-k8s-version-556121) </console>
I0914 17:58:46.829166 58869 main.go:141] libmachine: (old-k8s-version-556121) <rng model='virtio'>
I0914 17:58:46.829181 58869 main.go:141] libmachine: (old-k8s-version-556121) <backend model='random'>/dev/random</backend>
I0914 17:58:46.829200 58869 main.go:141] libmachine: (old-k8s-version-556121) </rng>
I0914 17:58:46.829225 58869 main.go:141] libmachine: (old-k8s-version-556121)
I0914 17:58:46.829238 58869 main.go:141] libmachine: (old-k8s-version-556121)
I0914 17:58:46.829249 58869 main.go:141] libmachine: (old-k8s-version-556121) </devices>
I0914 17:58:46.829261 58869 main.go:141] libmachine: (old-k8s-version-556121) </domain>
I0914 17:58:46.829271 58869 main.go:141] libmachine: (old-k8s-version-556121)
I0914 17:58:46.833694 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:e6:18:3c in network default
I0914 17:58:46.834361 58869 main.go:141] libmachine: (old-k8s-version-556121) Ensuring networks are active...
I0914 17:58:46.834385 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:58:46.834962 58869 main.go:141] libmachine: (old-k8s-version-556121) Ensuring network default is active
I0914 17:58:46.835309 58869 main.go:141] libmachine: (old-k8s-version-556121) Ensuring network mk-old-k8s-version-556121 is active
I0914 17:58:46.836020 58869 main.go:141] libmachine: (old-k8s-version-556121) Getting domain xml...
I0914 17:58:46.836723 58869 main.go:141] libmachine: (old-k8s-version-556121) Creating domain...
I0914 17:58:48.091663 58869 main.go:141] libmachine: (old-k8s-version-556121) Waiting to get IP...
I0914 17:58:48.092646 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:58:48.093187 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | unable to find current IP address of domain old-k8s-version-556121 in network mk-old-k8s-version-556121
I0914 17:58:48.093211 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:48.093158 58892 retry.go:31] will retry after 211.891454ms: waiting for machine to come up
I0914 17:58:48.306628 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:58:48.307195 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | unable to find current IP address of domain old-k8s-version-556121 in network mk-old-k8s-version-556121
I0914 17:58:48.307226 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:48.307169 58892 retry.go:31] will retry after 370.208351ms: waiting for machine to come up
I0914 17:58:48.678687 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:58:48.679267 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | unable to find current IP address of domain old-k8s-version-556121 in network mk-old-k8s-version-556121
I0914 17:58:48.679299 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:48.679213 58892 retry.go:31] will retry after 334.144923ms: waiting for machine to come up
I0914 17:58:49.014836 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:58:49.015347 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | unable to find current IP address of domain old-k8s-version-556121 in network mk-old-k8s-version-556121
I0914 17:58:49.015374 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:49.015280 58892 retry.go:31] will retry after 548.247462ms: waiting for machine to come up
I0914 17:58:49.565051 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:58:49.565492 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | unable to find current IP address of domain old-k8s-version-556121 in network mk-old-k8s-version-556121
I0914 17:58:49.565521 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:49.565433 58892 retry.go:31] will retry after 595.859425ms: waiting for machine to come up
I0914 17:58:50.163319 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:58:50.164015 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | unable to find current IP address of domain old-k8s-version-556121 in network mk-old-k8s-version-556121
I0914 17:58:50.164042 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:50.163957 58892 retry.go:31] will retry after 906.266357ms: waiting for machine to come up
I0914 17:58:51.071872 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:58:51.072323 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | unable to find current IP address of domain old-k8s-version-556121 in network mk-old-k8s-version-556121
I0914 17:58:51.072355 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:51.072279 58892 retry.go:31] will retry after 758.956539ms: waiting for machine to come up
I0914 17:58:51.832720 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:58:51.833298 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | unable to find current IP address of domain old-k8s-version-556121 in network mk-old-k8s-version-556121
I0914 17:58:51.833328 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:51.833270 58892 retry.go:31] will retry after 1.07773386s: waiting for machine to come up
I0914 17:58:52.912835 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:58:52.913490 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | unable to find current IP address of domain old-k8s-version-556121 in network mk-old-k8s-version-556121
I0914 17:58:52.913519 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:52.913422 58892 retry.go:31] will retry after 1.489546928s: waiting for machine to come up
I0914 17:58:54.405292 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:58:54.405841 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | unable to find current IP address of domain old-k8s-version-556121 in network mk-old-k8s-version-556121
I0914 17:58:54.405862 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:54.405794 58892 retry.go:31] will retry after 1.518422746s: waiting for machine to come up
I0914 17:58:55.926086 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:58:55.926695 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | unable to find current IP address of domain old-k8s-version-556121 in network mk-old-k8s-version-556121
I0914 17:58:55.926753 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:55.926653 58892 retry.go:31] will retry after 2.571567034s: waiting for machine to come up
I0914 17:58:58.500141 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:58:58.500735 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | unable to find current IP address of domain old-k8s-version-556121 in network mk-old-k8s-version-556121
I0914 17:58:58.500759 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:58:58.500681 58892 retry.go:31] will retry after 2.475374693s: waiting for machine to come up
I0914 17:59:00.977288 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:00.977811 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | unable to find current IP address of domain old-k8s-version-556121 in network mk-old-k8s-version-556121
I0914 17:59:00.977838 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:59:00.977776 58892 retry.go:31] will retry after 2.747111234s: waiting for machine to come up
I0914 17:59:03.728332 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:03.728899 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | unable to find current IP address of domain old-k8s-version-556121 in network mk-old-k8s-version-556121
I0914 17:59:03.728919 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | I0914 17:59:03.728865 58892 retry.go:31] will retry after 4.748088658s: waiting for machine to come up
I0914 17:59:08.479466 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:08.479988 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has current primary IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:08.480006 58869 main.go:141] libmachine: (old-k8s-version-556121) Found IP for machine: 192.168.83.80
I0914 17:59:08.480015 58869 main.go:141] libmachine: (old-k8s-version-556121) Reserving static IP address...
I0914 17:59:08.480540 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-556121", mac: "52:54:00:76:25:ab", ip: "192.168.83.80"} in network mk-old-k8s-version-556121
I0914 17:59:08.557991 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | Getting to WaitForSSH function...
I0914 17:59:08.558020 58869 main.go:141] libmachine: (old-k8s-version-556121) Reserved static IP address: 192.168.83.80
I0914 17:59:08.558031 58869 main.go:141] libmachine: (old-k8s-version-556121) Waiting for SSH to be available...
I0914 17:59:08.560719 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:08.561142 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:minikube Clientid:01:52:54:00:76:25:ab}
I0914 17:59:08.561176 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:08.561275 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | Using SSH client type: external
I0914 17:59:08.561297 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | Using SSH private key: /home/jenkins/minikube-integration/19643-8806/.minikube/machines/old-k8s-version-556121/id_rsa (-rw-------)
I0914 17:59:08.561340 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.83.80 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19643-8806/.minikube/machines/old-k8s-version-556121/id_rsa -p 22] /usr/bin/ssh <nil>}
I0914 17:59:08.561355 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | About to run SSH command:
I0914 17:59:08.561370 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | exit 0
I0914 17:59:08.682256 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | SSH cmd err, output: <nil>:
I0914 17:59:08.682548 58869 main.go:141] libmachine: (old-k8s-version-556121) KVM machine creation complete!
I0914 17:59:08.682850 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetConfigRaw
I0914 17:59:08.683432 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .DriverName
I0914 17:59:08.683655 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .DriverName
I0914 17:59:08.683846 58869 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0914 17:59:08.683863 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetState
I0914 17:59:08.685220 58869 main.go:141] libmachine: Detecting operating system of created instance...
I0914 17:59:08.685236 58869 main.go:141] libmachine: Waiting for SSH to be available...
I0914 17:59:08.685243 58869 main.go:141] libmachine: Getting to WaitForSSH function...
I0914 17:59:08.685251 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHHostname
I0914 17:59:08.688277 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:08.688766 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:old-k8s-version-556121 Clientid:01:52:54:00:76:25:ab}
I0914 17:59:08.688798 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:08.688944 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHPort
I0914 17:59:08.689092 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHKeyPath
I0914 17:59:08.689278 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHKeyPath
I0914 17:59:08.689408 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHUsername
I0914 17:59:08.689577 58869 main.go:141] libmachine: Using SSH client type: native
I0914 17:59:08.689839 58869 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.83.80 22 <nil> <nil>}
I0914 17:59:08.689858 58869 main.go:141] libmachine: About to run SSH command:
exit 0
I0914 17:59:08.785343 58869 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0914 17:59:08.785372 58869 main.go:141] libmachine: Detecting the provisioner...
I0914 17:59:08.785381 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHHostname
I0914 17:59:08.788725 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:08.789090 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:old-k8s-version-556121 Clientid:01:52:54:00:76:25:ab}
I0914 17:59:08.789128 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:08.789325 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHPort
I0914 17:59:08.789536 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHKeyPath
I0914 17:59:08.789723 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHKeyPath
I0914 17:59:08.789858 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHUsername
I0914 17:59:08.790021 58869 main.go:141] libmachine: Using SSH client type: native
I0914 17:59:08.790225 58869 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.83.80 22 <nil> <nil>}
I0914 17:59:08.790239 58869 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0914 17:59:08.890861 58869 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0914 17:59:08.891001 58869 main.go:141] libmachine: found compatible host: buildroot
I0914 17:59:08.891015 58869 main.go:141] libmachine: Provisioning with buildroot...
I0914 17:59:08.891026 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetMachineName
I0914 17:59:08.891300 58869 buildroot.go:166] provisioning hostname "old-k8s-version-556121"
I0914 17:59:08.891330 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetMachineName
I0914 17:59:08.891533 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHHostname
I0914 17:59:08.894829 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:08.895257 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:old-k8s-version-556121 Clientid:01:52:54:00:76:25:ab}
I0914 17:59:08.895288 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:08.895459 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHPort
I0914 17:59:08.895633 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHKeyPath
I0914 17:59:08.895789 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHKeyPath
I0914 17:59:08.895906 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHUsername
I0914 17:59:08.896046 58869 main.go:141] libmachine: Using SSH client type: native
I0914 17:59:08.896245 58869 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.83.80 22 <nil> <nil>}
I0914 17:59:08.896263 58869 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-556121 && echo "old-k8s-version-556121" | sudo tee /etc/hostname
I0914 17:59:09.015912 58869 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-556121
I0914 17:59:09.015947 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHHostname
I0914 17:59:09.019264 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.019623 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:old-k8s-version-556121 Clientid:01:52:54:00:76:25:ab}
I0914 17:59:09.019653 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.019852 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHPort
I0914 17:59:09.020030 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHKeyPath
I0914 17:59:09.020186 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHKeyPath
I0914 17:59:09.020401 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHUsername
I0914 17:59:09.020584 58869 main.go:141] libmachine: Using SSH client type: native
I0914 17:59:09.020755 58869 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.83.80 22 <nil> <nil>}
I0914 17:59:09.020770 58869 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-556121' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-556121/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-556121' | sudo tee -a /etc/hosts;
fi
fi
I0914 17:59:09.131379 58869 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0914 17:59:09.131415 58869 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19643-8806/.minikube CaCertPath:/home/jenkins/minikube-integration/19643-8806/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19643-8806/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19643-8806/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19643-8806/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19643-8806/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19643-8806/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19643-8806/.minikube}
I0914 17:59:09.131454 58869 buildroot.go:174] setting up certificates
I0914 17:59:09.131464 58869 provision.go:84] configureAuth start
I0914 17:59:09.131473 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetMachineName
I0914 17:59:09.131778 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetIP
I0914 17:59:09.134689 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.135145 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:old-k8s-version-556121 Clientid:01:52:54:00:76:25:ab}
I0914 17:59:09.135200 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.135382 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHHostname
I0914 17:59:09.137829 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.138266 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:old-k8s-version-556121 Clientid:01:52:54:00:76:25:ab}
I0914 17:59:09.138294 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.138481 58869 provision.go:143] copyHostCerts
I0914 17:59:09.138564 58869 exec_runner.go:144] found /home/jenkins/minikube-integration/19643-8806/.minikube/ca.pem, removing ...
I0914 17:59:09.138590 58869 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19643-8806/.minikube/ca.pem
I0914 17:59:09.138666 58869 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19643-8806/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19643-8806/.minikube/ca.pem (1082 bytes)
I0914 17:59:09.138795 58869 exec_runner.go:144] found /home/jenkins/minikube-integration/19643-8806/.minikube/cert.pem, removing ...
I0914 17:59:09.138808 58869 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19643-8806/.minikube/cert.pem
I0914 17:59:09.138843 58869 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19643-8806/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19643-8806/.minikube/cert.pem (1123 bytes)
I0914 17:59:09.138922 58869 exec_runner.go:144] found /home/jenkins/minikube-integration/19643-8806/.minikube/key.pem, removing ...
I0914 17:59:09.138934 58869 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19643-8806/.minikube/key.pem
I0914 17:59:09.138965 58869 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19643-8806/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19643-8806/.minikube/key.pem (1675 bytes)
I0914 17:59:09.139045 58869 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19643-8806/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19643-8806/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19643-8806/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-556121 san=[127.0.0.1 192.168.83.80 localhost minikube old-k8s-version-556121]
I0914 17:59:09.365868 58869 provision.go:177] copyRemoteCerts
I0914 17:59:09.365925 58869 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0914 17:59:09.365950 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHHostname
I0914 17:59:09.369043 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.369426 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:old-k8s-version-556121 Clientid:01:52:54:00:76:25:ab}
I0914 17:59:09.369456 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.369621 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHPort
I0914 17:59:09.369796 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHKeyPath
I0914 17:59:09.369922 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHUsername
I0914 17:59:09.370098 58869 sshutil.go:53] new ssh client: &{IP:192.168.83.80 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19643-8806/.minikube/machines/old-k8s-version-556121/id_rsa Username:docker}
I0914 17:59:09.452767 58869 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-8806/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0914 17:59:09.476935 58869 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-8806/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0914 17:59:09.502000 58869 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-8806/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0914 17:59:09.531885 58869 provision.go:87] duration metric: took 400.408175ms to configureAuth
I0914 17:59:09.531934 58869 buildroot.go:189] setting minikube options for container-runtime
I0914 17:59:09.532173 58869 config.go:182] Loaded profile config "old-k8s-version-556121": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0914 17:59:09.532278 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHHostname
I0914 17:59:09.534906 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.535220 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:old-k8s-version-556121 Clientid:01:52:54:00:76:25:ab}
I0914 17:59:09.535245 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.535413 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHPort
I0914 17:59:09.535587 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHKeyPath
I0914 17:59:09.535716 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHKeyPath
I0914 17:59:09.535823 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHUsername
I0914 17:59:09.535939 58869 main.go:141] libmachine: Using SSH client type: native
I0914 17:59:09.536105 58869 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.83.80 22 <nil> <nil>}
I0914 17:59:09.536122 58869 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0914 17:59:09.763699 58869 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0914 17:59:09.763729 58869 main.go:141] libmachine: Checking connection to Docker...
I0914 17:59:09.763741 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetURL
I0914 17:59:09.765114 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | Using libvirt version 6000000
I0914 17:59:09.767825 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.768231 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:old-k8s-version-556121 Clientid:01:52:54:00:76:25:ab}
I0914 17:59:09.768289 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.768426 58869 main.go:141] libmachine: Docker is up and running!
I0914 17:59:09.768437 58869 main.go:141] libmachine: Reticulating splines...
I0914 17:59:09.768443 58869 client.go:171] duration metric: took 23.42170954s to LocalClient.Create
I0914 17:59:09.768467 58869 start.go:167] duration metric: took 23.421776036s to libmachine.API.Create "old-k8s-version-556121"
I0914 17:59:09.768480 58869 start.go:293] postStartSetup for "old-k8s-version-556121" (driver="kvm2")
I0914 17:59:09.768504 58869 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0914 17:59:09.768524 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .DriverName
I0914 17:59:09.768845 58869 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0914 17:59:09.768878 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHHostname
I0914 17:59:09.771857 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.772263 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:old-k8s-version-556121 Clientid:01:52:54:00:76:25:ab}
I0914 17:59:09.772293 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.772525 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHPort
I0914 17:59:09.772736 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHKeyPath
I0914 17:59:09.772887 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHUsername
I0914 17:59:09.773010 58869 sshutil.go:53] new ssh client: &{IP:192.168.83.80 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19643-8806/.minikube/machines/old-k8s-version-556121/id_rsa Username:docker}
I0914 17:59:09.852816 58869 ssh_runner.go:195] Run: cat /etc/os-release
I0914 17:59:09.857434 58869 info.go:137] Remote host: Buildroot 2023.02.9
I0914 17:59:09.857466 58869 filesync.go:126] Scanning /home/jenkins/minikube-integration/19643-8806/.minikube/addons for local assets ...
I0914 17:59:09.857545 58869 filesync.go:126] Scanning /home/jenkins/minikube-integration/19643-8806/.minikube/files for local assets ...
I0914 17:59:09.857659 58869 filesync.go:149] local asset: /home/jenkins/minikube-integration/19643-8806/.minikube/files/etc/ssl/certs/160162.pem -> 160162.pem in /etc/ssl/certs
I0914 17:59:09.857780 58869 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0914 17:59:09.868729 58869 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-8806/.minikube/files/etc/ssl/certs/160162.pem --> /etc/ssl/certs/160162.pem (1708 bytes)
I0914 17:59:09.897753 58869 start.go:296] duration metric: took 129.259758ms for postStartSetup
I0914 17:59:09.897798 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetConfigRaw
I0914 17:59:09.898457 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetIP
I0914 17:59:09.901262 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.901624 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:old-k8s-version-556121 Clientid:01:52:54:00:76:25:ab}
I0914 17:59:09.901658 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.902016 58869 profile.go:143] Saving config to /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/config.json ...
I0914 17:59:09.902266 58869 start.go:128] duration metric: took 23.576180248s to createHost
I0914 17:59:09.902303 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHHostname
I0914 17:59:09.904943 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.905418 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:old-k8s-version-556121 Clientid:01:52:54:00:76:25:ab}
I0914 17:59:09.905562 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:09.905633 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHPort
I0914 17:59:09.905838 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHKeyPath
I0914 17:59:09.906024 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHKeyPath
I0914 17:59:09.906186 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHUsername
I0914 17:59:09.906361 58869 main.go:141] libmachine: Using SSH client type: native
I0914 17:59:09.906548 58869 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 192.168.83.80 22 <nil> <nil>}
I0914 17:59:09.906561 58869 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0914 17:59:10.010627 58869 main.go:141] libmachine: SSH cmd err, output: <nil>: 1726336749.969032342
I0914 17:59:10.010653 58869 fix.go:216] guest clock: 1726336749.969032342
I0914 17:59:10.010662 58869 fix.go:229] Guest: 2024-09-14 17:59:09.969032342 +0000 UTC Remote: 2024-09-14 17:59:09.902287679 +0000 UTC m=+23.697482421 (delta=66.744663ms)
I0914 17:59:10.010688 58869 fix.go:200] guest clock delta is within tolerance: 66.744663ms
I0914 17:59:10.010699 58869 start.go:83] releasing machines lock for "old-k8s-version-556121", held for 23.684728144s
I0914 17:59:10.010722 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .DriverName
I0914 17:59:10.010968 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetIP
I0914 17:59:10.013680 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:10.014031 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:old-k8s-version-556121 Clientid:01:52:54:00:76:25:ab}
I0914 17:59:10.014056 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:10.014226 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .DriverName
I0914 17:59:10.014854 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .DriverName
I0914 17:59:10.015048 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .DriverName
I0914 17:59:10.015169 58869 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0914 17:59:10.015214 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHHostname
I0914 17:59:10.015336 58869 ssh_runner.go:195] Run: cat /version.json
I0914 17:59:10.015365 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHHostname
I0914 17:59:10.017973 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:10.018225 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:10.018406 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:old-k8s-version-556121 Clientid:01:52:54:00:76:25:ab}
I0914 17:59:10.018454 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:10.018585 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHPort
I0914 17:59:10.018742 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:old-k8s-version-556121 Clientid:01:52:54:00:76:25:ab}
I0914 17:59:10.018767 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHKeyPath
I0914 17:59:10.018814 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:10.018930 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHUsername
I0914 17:59:10.018948 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHPort
I0914 17:59:10.019084 58869 sshutil.go:53] new ssh client: &{IP:192.168.83.80 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19643-8806/.minikube/machines/old-k8s-version-556121/id_rsa Username:docker}
I0914 17:59:10.019114 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHKeyPath
I0914 17:59:10.019238 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetSSHUsername
I0914 17:59:10.019463 58869 sshutil.go:53] new ssh client: &{IP:192.168.83.80 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19643-8806/.minikube/machines/old-k8s-version-556121/id_rsa Username:docker}
I0914 17:59:10.129894 58869 ssh_runner.go:195] Run: systemctl --version
I0914 17:59:10.136296 58869 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0914 17:59:10.299797 58869 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0914 17:59:10.306272 58869 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0914 17:59:10.306356 58869 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0914 17:59:10.322468 58869 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0914 17:59:10.322497 58869 start.go:495] detecting cgroup driver to use...
I0914 17:59:10.322575 58869 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0914 17:59:10.338520 58869 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0914 17:59:10.352392 58869 docker.go:217] disabling cri-docker service (if available) ...
I0914 17:59:10.352473 58869 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0914 17:59:10.366398 58869 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0914 17:59:10.380913 58869 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0914 17:59:10.505790 58869 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0914 17:59:10.660393 58869 docker.go:233] disabling docker service ...
I0914 17:59:10.660494 58869 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0914 17:59:10.677139 58869 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0914 17:59:10.690467 58869 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0914 17:59:10.848041 58869 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0914 17:59:10.986028 58869 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0914 17:59:11.000510 58869 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0914 17:59:11.023864 58869 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0914 17:59:11.023928 58869 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0914 17:59:11.035815 58869 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0914 17:59:11.035876 58869 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0914 17:59:11.050311 58869 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0914 17:59:11.062231 58869 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0914 17:59:11.074146 58869 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0914 17:59:11.088951 58869 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0914 17:59:11.100109 58869 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0914 17:59:11.100174 58869 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0914 17:59:11.114880 58869 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0914 17:59:11.127665 58869 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0914 17:59:11.268970 58869 ssh_runner.go:195] Run: sudo systemctl restart crio
I0914 17:59:11.375404 58869 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0914 17:59:11.375472 58869 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0914 17:59:11.385779 58869 start.go:563] Will wait 60s for crictl version
I0914 17:59:11.385844 58869 ssh_runner.go:195] Run: which crictl
I0914 17:59:11.389649 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0914 17:59:11.453485 58869 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0914 17:59:11.453568 58869 ssh_runner.go:195] Run: crio --version
I0914 17:59:11.483702 58869 ssh_runner.go:195] Run: crio --version
I0914 17:59:11.522858 58869 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0914 17:59:11.523954 58869 main.go:141] libmachine: (old-k8s-version-556121) Calling .GetIP
I0914 17:59:11.526871 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:11.527237 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:76:25:ab", ip: ""} in network mk-old-k8s-version-556121: {Iface:virbr1 ExpiryTime:2024-09-14 18:59:00 +0000 UTC Type:0 Mac:52:54:00:76:25:ab Iaid: IPaddr:192.168.83.80 Prefix:24 Hostname:old-k8s-version-556121 Clientid:01:52:54:00:76:25:ab}
I0914 17:59:11.527274 58869 main.go:141] libmachine: (old-k8s-version-556121) DBG | domain old-k8s-version-556121 has defined IP address 192.168.83.80 and MAC address 52:54:00:76:25:ab in network mk-old-k8s-version-556121
I0914 17:59:11.527500 58869 ssh_runner.go:195] Run: grep 192.168.83.1 host.minikube.internal$ /etc/hosts
I0914 17:59:11.532395 58869 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.83.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0914 17:59:11.545988 58869 kubeadm.go:883] updating cluster {Name:old-k8s-version-556121 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19643/minikube-v1.34.0-1726281733-19643-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-556121 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.83.80 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0914 17:59:11.546142 58869 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0914 17:59:11.546240 58869 ssh_runner.go:195] Run: sudo crictl images --output json
I0914 17:59:11.584862 58869 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0914 17:59:11.584925 58869 ssh_runner.go:195] Run: which lz4
I0914 17:59:11.588935 58869 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0914 17:59:11.593198 58869 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0914 17:59:11.593238 58869 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-8806/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0914 17:59:13.102261 58869 crio.go:462] duration metric: took 1.51337867s to copy over tarball
I0914 17:59:13.102360 58869 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0914 17:59:15.596749 58869 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.49436094s)
I0914 17:59:15.596774 58869 crio.go:469] duration metric: took 2.49447977s to extract the tarball
I0914 17:59:15.596781 58869 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0914 17:59:15.637798 58869 ssh_runner.go:195] Run: sudo crictl images --output json
I0914 17:59:15.681257 58869 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0914 17:59:15.681283 58869 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0914 17:59:15.681346 58869 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0914 17:59:15.681405 58869 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0914 17:59:15.681402 58869 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0914 17:59:15.681420 58869 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0914 17:59:15.681376 58869 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0914 17:59:15.681441 58869 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0914 17:59:15.681506 58869 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0914 17:59:15.681523 58869 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0914 17:59:15.682932 58869 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0914 17:59:15.682962 58869 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0914 17:59:15.682967 58869 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0914 17:59:15.682962 58869 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0914 17:59:15.682992 58869 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0914 17:59:15.683027 58869 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0914 17:59:15.683043 58869 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0914 17:59:15.682962 58869 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0914 17:59:15.877343 58869 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0914 17:59:15.881659 58869 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0914 17:59:15.897181 58869 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0914 17:59:15.906088 58869 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0914 17:59:15.907056 58869 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0914 17:59:15.915185 58869 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0914 17:59:15.926471 58869 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0914 17:59:15.939167 58869 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0914 17:59:15.939217 58869 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0914 17:59:15.939256 58869 ssh_runner.go:195] Run: which crictl
I0914 17:59:15.991042 58869 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0914 17:59:15.991079 58869 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0914 17:59:15.991118 58869 ssh_runner.go:195] Run: which crictl
I0914 17:59:16.012531 58869 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0914 17:59:16.012589 58869 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0914 17:59:16.012658 58869 ssh_runner.go:195] Run: which crictl
I0914 17:59:16.024611 58869 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0914 17:59:16.024659 58869 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0914 17:59:16.024713 58869 ssh_runner.go:195] Run: which crictl
I0914 17:59:16.041899 58869 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0914 17:59:16.041950 58869 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0914 17:59:16.042026 58869 ssh_runner.go:195] Run: which crictl
I0914 17:59:16.054984 58869 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0914 17:59:16.055030 58869 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0914 17:59:16.055076 58869 ssh_runner.go:195] Run: which crictl
I0914 17:59:16.059846 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0914 17:59:16.059884 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0914 17:59:16.059857 58869 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0914 17:59:16.059929 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0914 17:59:16.059936 58869 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0914 17:59:16.059988 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0914 17:59:16.060029 58869 ssh_runner.go:195] Run: which crictl
I0914 17:59:16.060030 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0914 17:59:16.061788 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0914 17:59:16.198832 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0914 17:59:16.198876 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0914 17:59:16.198886 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0914 17:59:16.198892 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0914 17:59:16.198950 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0914 17:59:16.199039 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0914 17:59:16.199052 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0914 17:59:16.334414 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0914 17:59:16.334462 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0914 17:59:16.334463 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0914 17:59:16.334590 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0914 17:59:16.334618 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0914 17:59:16.334677 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0914 17:59:16.341383 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0914 17:59:16.464511 58869 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0914 17:59:16.464582 58869 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19643-8806/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0914 17:59:16.475029 58869 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19643-8806/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0914 17:59:16.486652 58869 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19643-8806/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0914 17:59:16.494911 58869 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19643-8806/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0914 17:59:16.494940 58869 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19643-8806/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0914 17:59:16.509407 58869 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19643-8806/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0914 17:59:16.515409 58869 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19643-8806/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0914 17:59:16.911198 58869 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0914 17:59:17.052636 58869 cache_images.go:92] duration metric: took 1.371335838s to LoadCachedImages
W0914 17:59:17.052735 58869 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19643-8806/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19643-8806/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I0914 17:59:17.052754 58869 kubeadm.go:934] updating node { 192.168.83.80 8443 v1.20.0 crio true true} ...
I0914 17:59:17.052885 58869 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-556121 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.83.80
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-556121 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0914 17:59:17.052976 58869 ssh_runner.go:195] Run: crio config
I0914 17:59:17.099243 58869 cni.go:84] Creating CNI manager for ""
I0914 17:59:17.099269 58869 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0914 17:59:17.099283 58869 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0914 17:59:17.099305 58869 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.83.80 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-556121 NodeName:old-k8s-version-556121 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.83.80"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.83.80 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0914 17:59:17.099450 58869 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.83.80
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-556121"
kubeletExtraArgs:
node-ip: 192.168.83.80
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.83.80"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0914 17:59:17.099522 58869 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0914 17:59:17.109589 58869 binaries.go:44] Found k8s binaries, skipping transfer
I0914 17:59:17.109656 58869 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0914 17:59:17.118807 58869 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0914 17:59:17.134723 58869 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0914 17:59:17.150395 58869 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0914 17:59:17.165952 58869 ssh_runner.go:195] Run: grep 192.168.83.80 control-plane.minikube.internal$ /etc/hosts
I0914 17:59:17.169509 58869 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.83.80 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0914 17:59:17.180996 58869 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0914 17:59:17.295279 58869 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0914 17:59:17.312345 58869 certs.go:68] Setting up /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121 for IP: 192.168.83.80
I0914 17:59:17.312372 58869 certs.go:194] generating shared ca certs ...
I0914 17:59:17.312393 58869 certs.go:226] acquiring lock for ca certs: {Name:mkb663a3180967f5f94f0c355b2cd55067394331 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:59:17.312576 58869 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19643-8806/.minikube/ca.key
I0914 17:59:17.312632 58869 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19643-8806/.minikube/proxy-client-ca.key
I0914 17:59:17.312644 58869 certs.go:256] generating profile certs ...
I0914 17:59:17.312699 58869 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/client.key
I0914 17:59:17.312713 58869 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/client.crt with IP's: []
I0914 17:59:17.632692 58869 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/client.crt ...
I0914 17:59:17.632725 58869 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/client.crt: {Name:mk66d5dee7befcd4473acc1ed0432b5ce0c6ea84 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:59:17.632891 58869 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/client.key ...
I0914 17:59:17.632904 58869 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/client.key: {Name:mk3111b842fe6f58b384cbc8c46298e4bb083a5c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:59:17.632975 58869 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/apiserver.key.faf839ab
I0914 17:59:17.632991 58869 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/apiserver.crt.faf839ab with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.83.80]
I0914 17:59:17.711094 58869 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/apiserver.crt.faf839ab ...
I0914 17:59:17.711130 58869 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/apiserver.crt.faf839ab: {Name:mk70e7769fce18b4af7eb7ef0fbec926babf5c29 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:59:17.747701 58869 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/apiserver.key.faf839ab ...
I0914 17:59:17.747742 58869 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/apiserver.key.faf839ab: {Name:mk321b0aa90ba08b3613d1c74a3903d985c53dc5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:59:17.747905 58869 certs.go:381] copying /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/apiserver.crt.faf839ab -> /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/apiserver.crt
I0914 17:59:17.748006 58869 certs.go:385] copying /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/apiserver.key.faf839ab -> /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/apiserver.key
I0914 17:59:17.748078 58869 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/proxy-client.key
I0914 17:59:17.748104 58869 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/proxy-client.crt with IP's: []
I0914 17:59:17.845869 58869 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/proxy-client.crt ...
I0914 17:59:17.845897 58869 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/proxy-client.crt: {Name:mk74dbda75bd8161c4032753baabaf2aafdb6c03 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:59:17.846077 58869 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/proxy-client.key ...
I0914 17:59:17.846099 58869 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/proxy-client.key: {Name:mkf4d25b5f584b927f1271ef3a5930dc4f76cf12 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:59:17.846346 58869 certs.go:484] found cert: /home/jenkins/minikube-integration/19643-8806/.minikube/certs/16016.pem (1338 bytes)
W0914 17:59:17.846390 58869 certs.go:480] ignoring /home/jenkins/minikube-integration/19643-8806/.minikube/certs/16016_empty.pem, impossibly tiny 0 bytes
I0914 17:59:17.846405 58869 certs.go:484] found cert: /home/jenkins/minikube-integration/19643-8806/.minikube/certs/ca-key.pem (1679 bytes)
I0914 17:59:17.846435 58869 certs.go:484] found cert: /home/jenkins/minikube-integration/19643-8806/.minikube/certs/ca.pem (1082 bytes)
I0914 17:59:17.846463 58869 certs.go:484] found cert: /home/jenkins/minikube-integration/19643-8806/.minikube/certs/cert.pem (1123 bytes)
I0914 17:59:17.846503 58869 certs.go:484] found cert: /home/jenkins/minikube-integration/19643-8806/.minikube/certs/key.pem (1675 bytes)
I0914 17:59:17.846558 58869 certs.go:484] found cert: /home/jenkins/minikube-integration/19643-8806/.minikube/files/etc/ssl/certs/160162.pem (1708 bytes)
I0914 17:59:17.847205 58869 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-8806/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0914 17:59:17.871811 58869 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-8806/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0914 17:59:17.895637 58869 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-8806/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0914 17:59:17.919416 58869 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-8806/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0914 17:59:17.943361 58869 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0914 17:59:17.968518 58869 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0914 17:59:17.995129 58869 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0914 17:59:18.020058 58869 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-8806/.minikube/profiles/old-k8s-version-556121/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0914 17:59:18.043937 58869 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-8806/.minikube/certs/16016.pem --> /usr/share/ca-certificates/16016.pem (1338 bytes)
I0914 17:59:18.066888 58869 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-8806/.minikube/files/etc/ssl/certs/160162.pem --> /usr/share/ca-certificates/160162.pem (1708 bytes)
I0914 17:59:18.093834 58869 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-8806/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0914 17:59:18.120867 58869 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0914 17:59:18.148129 58869 ssh_runner.go:195] Run: openssl version
I0914 17:59:18.155542 58869 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0914 17:59:18.178002 58869 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0914 17:59:18.184527 58869 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 14 16:44 /usr/share/ca-certificates/minikubeCA.pem
I0914 17:59:18.184600 58869 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0914 17:59:18.195661 58869 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0914 17:59:18.208046 58869 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/16016.pem && ln -fs /usr/share/ca-certificates/16016.pem /etc/ssl/certs/16016.pem"
I0914 17:59:18.219004 58869 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/16016.pem
I0914 17:59:18.223596 58869 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 14 17:01 /usr/share/ca-certificates/16016.pem
I0914 17:59:18.223676 58869 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/16016.pem
I0914 17:59:18.229166 58869 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/16016.pem /etc/ssl/certs/51391683.0"
I0914 17:59:18.239282 58869 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/160162.pem && ln -fs /usr/share/ca-certificates/160162.pem /etc/ssl/certs/160162.pem"
I0914 17:59:18.249788 58869 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/160162.pem
I0914 17:59:18.254271 58869 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 14 17:01 /usr/share/ca-certificates/160162.pem
I0914 17:59:18.254345 58869 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/160162.pem
I0914 17:59:18.260293 58869 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/160162.pem /etc/ssl/certs/3ec20f2e.0"
I0914 17:59:18.275466 58869 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0914 17:59:18.279924 58869 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0914 17:59:18.279993 58869 kubeadm.go:392] StartCluster: {Name:old-k8s-version-556121 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19643/minikube-v1.34.0-1726281733-19643-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-556121 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.83.80 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0914 17:59:18.280086 58869 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0914 17:59:18.280180 58869 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0914 17:59:18.322744 58869 cri.go:89] found id: ""
I0914 17:59:18.322828 58869 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0914 17:59:18.332496 58869 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0914 17:59:18.342272 58869 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0914 17:59:18.351668 58869 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0914 17:59:18.351694 58869 kubeadm.go:157] found existing configuration files:
I0914 17:59:18.351744 58869 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0914 17:59:18.361000 58869 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0914 17:59:18.361074 58869 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0914 17:59:18.371402 58869 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0914 17:59:18.380884 58869 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0914 17:59:18.380962 58869 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0914 17:59:18.391024 58869 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0914 17:59:18.401086 58869 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0914 17:59:18.401157 58869 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0914 17:59:18.411492 58869 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0914 17:59:18.420836 58869 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0914 17:59:18.420897 58869 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0914 17:59:18.430446 58869 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0914 17:59:18.536950 58869 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0914 17:59:18.537080 58869 kubeadm.go:310] [preflight] Running pre-flight checks
I0914 17:59:18.686885 58869 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0914 17:59:18.687017 58869 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0914 17:59:18.687128 58869 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0914 17:59:18.878320 58869 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0914 17:59:18.941978 58869 out.go:235] - Generating certificates and keys ...
I0914 17:59:18.942098 58869 kubeadm.go:310] [certs] Using existing ca certificate authority
I0914 17:59:18.942232 58869 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0914 17:59:19.032813 58869 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0914 17:59:19.342427 58869 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0914 17:59:19.465411 58869 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0914 17:59:19.586765 58869 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0914 17:59:19.860884 58869 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0914 17:59:19.861449 58869 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-556121] and IPs [192.168.83.80 127.0.0.1 ::1]
I0914 17:59:20.056525 58869 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0914 17:59:20.056724 58869 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-556121] and IPs [192.168.83.80 127.0.0.1 ::1]
I0914 17:59:20.327760 58869 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0914 17:59:20.421703 58869 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0914 17:59:20.563779 58869 kubeadm.go:310] [certs] Generating "sa" key and public key
I0914 17:59:20.564025 58869 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0914 17:59:20.719205 58869 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0914 17:59:21.109744 58869 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0914 17:59:21.352057 58869 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0914 17:59:21.585753 58869 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0914 17:59:21.604837 58869 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0914 17:59:21.608901 58869 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0914 17:59:21.609081 58869 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0914 17:59:21.747627 58869 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0914 17:59:21.749642 58869 out.go:235] - Booting up control plane ...
I0914 17:59:21.749790 58869 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0914 17:59:21.758970 58869 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0914 17:59:21.760096 58869 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0914 17:59:21.760988 58869 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0914 17:59:21.774177 58869 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0914 18:00:01.741486 58869 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0914 18:00:01.742195 58869 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0914 18:00:01.742448 58869 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0914 18:00:06.741763 58869 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0914 18:00:06.742061 58869 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0914 18:00:16.740802 58869 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0914 18:00:16.741366 58869 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0914 18:00:36.741253 58869 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0914 18:00:36.741531 58869 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0914 18:01:16.739708 58869 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0914 18:01:16.739919 58869 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0914 18:01:16.739930 58869 kubeadm.go:310]
I0914 18:01:16.739993 58869 kubeadm.go:310] Unfortunately, an error has occurred:
I0914 18:01:16.740061 58869 kubeadm.go:310] timed out waiting for the condition
I0914 18:01:16.740070 58869 kubeadm.go:310]
I0914 18:01:16.740124 58869 kubeadm.go:310] This error is likely caused by:
I0914 18:01:16.740178 58869 kubeadm.go:310] - The kubelet is not running
I0914 18:01:16.740349 58869 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0914 18:01:16.740376 58869 kubeadm.go:310]
I0914 18:01:16.740523 58869 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0914 18:01:16.740585 58869 kubeadm.go:310] - 'systemctl status kubelet'
I0914 18:01:16.740636 58869 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0914 18:01:16.740648 58869 kubeadm.go:310]
I0914 18:01:16.740787 58869 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0914 18:01:16.740911 58869 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0914 18:01:16.740925 58869 kubeadm.go:310]
I0914 18:01:16.741054 58869 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0914 18:01:16.741173 58869 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0914 18:01:16.741284 58869 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0914 18:01:16.741393 58869 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0914 18:01:16.741415 58869 kubeadm.go:310]
I0914 18:01:16.741881 58869 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0914 18:01:16.742013 58869 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0914 18:01:16.742132 58869 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0914 18:01:16.742388 58869 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-556121] and IPs [192.168.83.80 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-556121] and IPs [192.168.83.80 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-556121] and IPs [192.168.83.80 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-556121] and IPs [192.168.83.80 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0914 18:01:16.742436 58869 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0914 18:01:17.991424 58869 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.248954104s)
I0914 18:01:17.991525 58869 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0914 18:01:18.005398 58869 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0914 18:01:18.014912 58869 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0914 18:01:18.014935 58869 kubeadm.go:157] found existing configuration files:
I0914 18:01:18.014990 58869 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0914 18:01:18.023888 58869 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0914 18:01:18.023959 58869 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0914 18:01:18.033298 58869 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0914 18:01:18.042068 58869 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0914 18:01:18.042131 58869 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0914 18:01:18.051280 58869 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0914 18:01:18.060590 58869 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0914 18:01:18.060658 58869 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0914 18:01:18.070598 58869 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0914 18:01:18.079528 58869 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0914 18:01:18.079616 58869 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0914 18:01:18.088846 58869 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0914 18:01:18.153451 58869 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0914 18:01:18.153536 58869 kubeadm.go:310] [preflight] Running pre-flight checks
I0914 18:01:18.286076 58869 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0914 18:01:18.286226 58869 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0914 18:01:18.286356 58869 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0914 18:01:18.472590 58869 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0914 18:01:18.475855 58869 out.go:235] - Generating certificates and keys ...
I0914 18:01:18.475965 58869 kubeadm.go:310] [certs] Using existing ca certificate authority
I0914 18:01:18.476059 58869 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0914 18:01:18.476171 58869 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0914 18:01:18.476263 58869 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0914 18:01:18.476390 58869 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0914 18:01:18.476509 58869 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0914 18:01:18.476617 58869 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0914 18:01:18.476700 58869 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0914 18:01:18.476797 58869 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0914 18:01:18.476884 58869 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0914 18:01:18.476937 58869 kubeadm.go:310] [certs] Using the existing "sa" key
I0914 18:01:18.476988 58869 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0914 18:01:18.617127 58869 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0914 18:01:18.808731 58869 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0914 18:01:18.951934 58869 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0914 18:01:19.328137 58869 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0914 18:01:19.344036 58869 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0914 18:01:19.344156 58869 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0914 18:01:19.344236 58869 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0914 18:01:19.465625 58869 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0914 18:01:19.467752 58869 out.go:235] - Booting up control plane ...
I0914 18:01:19.467893 58869 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0914 18:01:19.470981 58869 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0914 18:01:19.473576 58869 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0914 18:01:19.474278 58869 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0914 18:01:19.476916 58869 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0914 18:01:59.478612 58869 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0914 18:01:59.479029 58869 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0914 18:01:59.479276 58869 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0914 18:02:04.479769 58869 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0914 18:02:04.479985 58869 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0914 18:02:14.480829 58869 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0914 18:02:14.481021 58869 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0914 18:02:34.482400 58869 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0914 18:02:34.482652 58869 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0914 18:03:14.481987 58869 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0914 18:03:14.482300 58869 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0914 18:03:14.482342 58869 kubeadm.go:310]
I0914 18:03:14.482403 58869 kubeadm.go:310] Unfortunately, an error has occurred:
I0914 18:03:14.482453 58869 kubeadm.go:310] timed out waiting for the condition
I0914 18:03:14.482462 58869 kubeadm.go:310]
I0914 18:03:14.482504 58869 kubeadm.go:310] This error is likely caused by:
I0914 18:03:14.482550 58869 kubeadm.go:310] - The kubelet is not running
I0914 18:03:14.482689 58869 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0914 18:03:14.482702 58869 kubeadm.go:310]
I0914 18:03:14.482823 58869 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0914 18:03:14.482868 58869 kubeadm.go:310] - 'systemctl status kubelet'
I0914 18:03:14.482907 58869 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0914 18:03:14.482915 58869 kubeadm.go:310]
I0914 18:03:14.483034 58869 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0914 18:03:14.483137 58869 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0914 18:03:14.483149 58869 kubeadm.go:310]
I0914 18:03:14.483356 58869 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0914 18:03:14.483441 58869 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0914 18:03:14.483507 58869 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0914 18:03:14.483569 58869 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0914 18:03:14.483576 58869 kubeadm.go:310]
I0914 18:03:14.484215 58869 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0914 18:03:14.484361 58869 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0914 18:03:14.484460 58869 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0914 18:03:14.484551 58869 kubeadm.go:394] duration metric: took 3m56.204563968s to StartCluster
I0914 18:03:14.484627 58869 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0914 18:03:14.484706 58869 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0914 18:03:14.525072 58869 cri.go:89] found id: ""
I0914 18:03:14.525113 58869 logs.go:276] 0 containers: []
W0914 18:03:14.525126 58869 logs.go:278] No container was found matching "kube-apiserver"
I0914 18:03:14.525133 58869 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0914 18:03:14.525194 58869 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0914 18:03:14.558129 58869 cri.go:89] found id: ""
I0914 18:03:14.558180 58869 logs.go:276] 0 containers: []
W0914 18:03:14.558193 58869 logs.go:278] No container was found matching "etcd"
I0914 18:03:14.558201 58869 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0914 18:03:14.558289 58869 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0914 18:03:14.591135 58869 cri.go:89] found id: ""
I0914 18:03:14.591165 58869 logs.go:276] 0 containers: []
W0914 18:03:14.591175 58869 logs.go:278] No container was found matching "coredns"
I0914 18:03:14.591182 58869 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0914 18:03:14.591244 58869 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0914 18:03:14.634334 58869 cri.go:89] found id: ""
I0914 18:03:14.634362 58869 logs.go:276] 0 containers: []
W0914 18:03:14.634372 58869 logs.go:278] No container was found matching "kube-scheduler"
I0914 18:03:14.634379 58869 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0914 18:03:14.634439 58869 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0914 18:03:14.669809 58869 cri.go:89] found id: ""
I0914 18:03:14.669846 58869 logs.go:276] 0 containers: []
W0914 18:03:14.669860 58869 logs.go:278] No container was found matching "kube-proxy"
I0914 18:03:14.669869 58869 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0914 18:03:14.669937 58869 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0914 18:03:14.704889 58869 cri.go:89] found id: ""
I0914 18:03:14.704912 58869 logs.go:276] 0 containers: []
W0914 18:03:14.704924 58869 logs.go:278] No container was found matching "kube-controller-manager"
I0914 18:03:14.704938 58869 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0914 18:03:14.704993 58869 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0914 18:03:14.736149 58869 cri.go:89] found id: ""
I0914 18:03:14.736178 58869 logs.go:276] 0 containers: []
W0914 18:03:14.736189 58869 logs.go:278] No container was found matching "kindnet"
I0914 18:03:14.736208 58869 logs.go:123] Gathering logs for kubelet ...
I0914 18:03:14.736223 58869 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0914 18:03:14.785300 58869 logs.go:123] Gathering logs for dmesg ...
I0914 18:03:14.785347 58869 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0914 18:03:14.798649 58869 logs.go:123] Gathering logs for describe nodes ...
I0914 18:03:14.798679 58869 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0914 18:03:14.910913 58869 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0914 18:03:14.910934 58869 logs.go:123] Gathering logs for CRI-O ...
I0914 18:03:14.910949 58869 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0914 18:03:15.014543 58869 logs.go:123] Gathering logs for container status ...
I0914 18:03:15.014580 58869 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0914 18:03:15.051605 58869 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0914 18:03:15.051662 58869 out.go:270] *
*
W0914 18:03:15.051744 58869 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0914 18:03:15.051762 58869 out.go:270] *
*
W0914 18:03:15.052941 58869 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0914 18:03:15.055806 58869 out.go:201]
W0914 18:03:15.056727 58869 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0914 18:03:15.056782 58869 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0914 18:03:15.056805 58869 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0914 18:03:15.058278 58869 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-556121 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-556121 -n old-k8s-version-556121
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-556121 -n old-k8s-version-556121: exit status 6 (218.768216ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0914 18:03:15.316487 61953 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-556121" does not appear in /home/jenkins/minikube-integration/19643-8806/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-556121" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (269.13s)