=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-642238 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
E0912 22:52:07.200084 13083 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/addons-694635/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-642238 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m40.159066687s)
-- stdout --
* [old-k8s-version-642238] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19616
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19616-5891/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19616-5891/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-642238" primary control-plane node in "old-k8s-version-642238" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0912 22:52:06.297222 57925 out.go:345] Setting OutFile to fd 1 ...
I0912 22:52:06.297317 57925 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0912 22:52:06.297322 57925 out.go:358] Setting ErrFile to fd 2...
I0912 22:52:06.297326 57925 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0912 22:52:06.297533 57925 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19616-5891/.minikube/bin
I0912 22:52:06.298209 57925 out.go:352] Setting JSON to false
I0912 22:52:06.299145 57925 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":5668,"bootTime":1726175858,"procs":217,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1067-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0912 22:52:06.299207 57925 start.go:139] virtualization: kvm guest
I0912 22:52:06.301320 57925 out.go:177] * [old-k8s-version-642238] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I0912 22:52:06.302427 57925 out.go:177] - MINIKUBE_LOCATION=19616
I0912 22:52:06.302437 57925 notify.go:220] Checking for updates...
I0912 22:52:06.304296 57925 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0912 22:52:06.305335 57925 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19616-5891/kubeconfig
I0912 22:52:06.306310 57925 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19616-5891/.minikube
I0912 22:52:06.307399 57925 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0912 22:52:06.308289 57925 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0912 22:52:06.309916 57925 config.go:182] Loaded profile config "NoKubernetes-204793": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v0.0.0
I0912 22:52:06.310050 57925 config.go:182] Loaded profile config "cert-expiration-408779": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0912 22:52:06.310172 57925 config.go:182] Loaded profile config "kubernetes-upgrade-848420": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.1
I0912 22:52:06.310287 57925 driver.go:394] Setting default libvirt URI to qemu:///system
I0912 22:52:06.348089 57925 out.go:177] * Using the kvm2 driver based on user configuration
I0912 22:52:06.349163 57925 start.go:297] selected driver: kvm2
I0912 22:52:06.349187 57925 start.go:901] validating driver "kvm2" against <nil>
I0912 22:52:06.349198 57925 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0912 22:52:06.349924 57925 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0912 22:52:06.350003 57925 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19616-5891/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0912 22:52:06.365544 57925 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0
I0912 22:52:06.365596 57925 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0912 22:52:06.365842 57925 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0912 22:52:06.365900 57925 cni.go:84] Creating CNI manager for ""
I0912 22:52:06.365913 57925 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0912 22:52:06.365920 57925 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0912 22:52:06.365971 57925 start.go:340] cluster config:
{Name:old-k8s-version-642238 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-642238 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0912 22:52:06.366069 57925 iso.go:125] acquiring lock: {Name:mk3ec3c4afd4210b7425f6425f55e7f581d9a5a9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0912 22:52:06.367696 57925 out.go:177] * Starting "old-k8s-version-642238" primary control-plane node in "old-k8s-version-642238" cluster
I0912 22:52:06.368558 57925 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0912 22:52:06.368585 57925 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19616-5891/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0912 22:52:06.368596 57925 cache.go:56] Caching tarball of preloaded images
I0912 22:52:06.368682 57925 preload.go:172] Found /home/jenkins/minikube-integration/19616-5891/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0912 22:52:06.368692 57925 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0912 22:52:06.368771 57925 profile.go:143] Saving config to /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/config.json ...
I0912 22:52:06.368788 57925 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/config.json: {Name:mka1e1328f9dc2cedc0fa574fbaea819fe56b836 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0912 22:52:06.368905 57925 start.go:360] acquireMachinesLock for old-k8s-version-642238: {Name:mkbb0a9e58b1349e86a63b6069c42d4248d92c3b Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0912 22:52:17.678344 57925 start.go:364] duration metric: took 11.309381465s to acquireMachinesLock for "old-k8s-version-642238"
I0912 22:52:17.678417 57925 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-642238 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-642238 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0912 22:52:17.678539 57925 start.go:125] createHost starting for "" (driver="kvm2")
I0912 22:52:17.680621 57925 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0912 22:52:17.680857 57925 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0912 22:52:17.680940 57925 main.go:141] libmachine: Launching plugin server for driver kvm2
I0912 22:52:17.704989 57925 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34061
I0912 22:52:17.705558 57925 main.go:141] libmachine: () Calling .GetVersion
I0912 22:52:17.706413 57925 main.go:141] libmachine: Using API Version 1
I0912 22:52:17.706435 57925 main.go:141] libmachine: () Calling .SetConfigRaw
I0912 22:52:17.706853 57925 main.go:141] libmachine: () Calling .GetMachineName
I0912 22:52:17.707247 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetMachineName
I0912 22:52:17.707528 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .DriverName
I0912 22:52:17.707828 57925 start.go:159] libmachine.API.Create for "old-k8s-version-642238" (driver="kvm2")
I0912 22:52:17.707869 57925 client.go:168] LocalClient.Create starting
I0912 22:52:17.707907 57925 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19616-5891/.minikube/certs/ca.pem
I0912 22:52:17.707964 57925 main.go:141] libmachine: Decoding PEM data...
I0912 22:52:17.707993 57925 main.go:141] libmachine: Parsing certificate...
I0912 22:52:17.708070 57925 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19616-5891/.minikube/certs/cert.pem
I0912 22:52:17.708104 57925 main.go:141] libmachine: Decoding PEM data...
I0912 22:52:17.708125 57925 main.go:141] libmachine: Parsing certificate...
I0912 22:52:17.708151 57925 main.go:141] libmachine: Running pre-create checks...
I0912 22:52:17.708163 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .PreCreateCheck
I0912 22:52:17.708667 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetConfigRaw
I0912 22:52:17.709402 57925 main.go:141] libmachine: Creating machine...
I0912 22:52:17.709422 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .Create
I0912 22:52:17.709632 57925 main.go:141] libmachine: (old-k8s-version-642238) Creating KVM machine...
I0912 22:52:17.711251 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found existing default KVM network
I0912 22:52:17.712567 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:17.712362 58109 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:0b:ee:fc} reservation:<nil>}
I0912 22:52:17.713490 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:17.713383 58109 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:cd:00:cf} reservation:<nil>}
I0912 22:52:17.714677 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:17.714576 58109 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002dc400}
I0912 22:52:17.714705 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | created network xml:
I0912 22:52:17.714719 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | <network>
I0912 22:52:17.714728 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | <name>mk-old-k8s-version-642238</name>
I0912 22:52:17.714746 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | <dns enable='no'/>
I0912 22:52:17.714753 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG |
I0912 22:52:17.714763 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0912 22:52:17.714771 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | <dhcp>
I0912 22:52:17.714800 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0912 22:52:17.714822 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | </dhcp>
I0912 22:52:17.714835 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | </ip>
I0912 22:52:17.714841 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG |
I0912 22:52:17.714850 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | </network>
I0912 22:52:17.714860 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG |
I0912 22:52:17.721969 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | trying to create private KVM network mk-old-k8s-version-642238 192.168.61.0/24...
I0912 22:52:17.803623 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | private KVM network mk-old-k8s-version-642238 192.168.61.0/24 created
I0912 22:52:17.803661 57925 main.go:141] libmachine: (old-k8s-version-642238) Setting up store path in /home/jenkins/minikube-integration/19616-5891/.minikube/machines/old-k8s-version-642238 ...
I0912 22:52:17.803680 57925 main.go:141] libmachine: (old-k8s-version-642238) Building disk image from file:///home/jenkins/minikube-integration/19616-5891/.minikube/cache/iso/amd64/minikube-v1.34.0-1726156389-19616-amd64.iso
I0912 22:52:17.803694 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:17.803634 58109 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19616-5891/.minikube
I0912 22:52:17.803856 57925 main.go:141] libmachine: (old-k8s-version-642238) Downloading /home/jenkins/minikube-integration/19616-5891/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19616-5891/.minikube/cache/iso/amd64/minikube-v1.34.0-1726156389-19616-amd64.iso...
I0912 22:52:18.049345 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:18.049213 58109 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19616-5891/.minikube/machines/old-k8s-version-642238/id_rsa...
I0912 22:52:18.168144 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:18.167982 58109 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19616-5891/.minikube/machines/old-k8s-version-642238/old-k8s-version-642238.rawdisk...
I0912 22:52:18.168214 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | Writing magic tar header
I0912 22:52:18.168232 57925 main.go:141] libmachine: (old-k8s-version-642238) Setting executable bit set on /home/jenkins/minikube-integration/19616-5891/.minikube/machines/old-k8s-version-642238 (perms=drwx------)
I0912 22:52:18.168241 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | Writing SSH key tar header
I0912 22:52:18.168258 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:18.168107 58109 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19616-5891/.minikube/machines/old-k8s-version-642238 ...
I0912 22:52:18.168271 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19616-5891/.minikube/machines/old-k8s-version-642238
I0912 22:52:18.168285 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19616-5891/.minikube/machines
I0912 22:52:18.168302 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19616-5891/.minikube
I0912 22:52:18.168334 57925 main.go:141] libmachine: (old-k8s-version-642238) Setting executable bit set on /home/jenkins/minikube-integration/19616-5891/.minikube/machines (perms=drwxr-xr-x)
I0912 22:52:18.168352 57925 main.go:141] libmachine: (old-k8s-version-642238) Setting executable bit set on /home/jenkins/minikube-integration/19616-5891/.minikube (perms=drwxr-xr-x)
I0912 22:52:18.168366 57925 main.go:141] libmachine: (old-k8s-version-642238) Setting executable bit set on /home/jenkins/minikube-integration/19616-5891 (perms=drwxrwxr-x)
I0912 22:52:18.168379 57925 main.go:141] libmachine: (old-k8s-version-642238) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0912 22:52:18.168392 57925 main.go:141] libmachine: (old-k8s-version-642238) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0912 22:52:18.168400 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19616-5891
I0912 22:52:18.168413 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0912 22:52:18.168420 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | Checking permissions on dir: /home/jenkins
I0912 22:52:18.168429 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | Checking permissions on dir: /home
I0912 22:52:18.168437 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | Skipping /home - not owner
I0912 22:52:18.168452 57925 main.go:141] libmachine: (old-k8s-version-642238) Creating domain...
I0912 22:52:18.169653 57925 main.go:141] libmachine: (old-k8s-version-642238) define libvirt domain using xml:
I0912 22:52:18.169703 57925 main.go:141] libmachine: (old-k8s-version-642238) <domain type='kvm'>
I0912 22:52:18.169718 57925 main.go:141] libmachine: (old-k8s-version-642238) <name>old-k8s-version-642238</name>
I0912 22:52:18.169730 57925 main.go:141] libmachine: (old-k8s-version-642238) <memory unit='MiB'>2200</memory>
I0912 22:52:18.169742 57925 main.go:141] libmachine: (old-k8s-version-642238) <vcpu>2</vcpu>
I0912 22:52:18.169755 57925 main.go:141] libmachine: (old-k8s-version-642238) <features>
I0912 22:52:18.169791 57925 main.go:141] libmachine: (old-k8s-version-642238) <acpi/>
I0912 22:52:18.169813 57925 main.go:141] libmachine: (old-k8s-version-642238) <apic/>
I0912 22:52:18.169836 57925 main.go:141] libmachine: (old-k8s-version-642238) <pae/>
I0912 22:52:18.169848 57925 main.go:141] libmachine: (old-k8s-version-642238)
I0912 22:52:18.169876 57925 main.go:141] libmachine: (old-k8s-version-642238) </features>
I0912 22:52:18.169889 57925 main.go:141] libmachine: (old-k8s-version-642238) <cpu mode='host-passthrough'>
I0912 22:52:18.169901 57925 main.go:141] libmachine: (old-k8s-version-642238)
I0912 22:52:18.169909 57925 main.go:141] libmachine: (old-k8s-version-642238) </cpu>
I0912 22:52:18.169919 57925 main.go:141] libmachine: (old-k8s-version-642238) <os>
I0912 22:52:18.169936 57925 main.go:141] libmachine: (old-k8s-version-642238) <type>hvm</type>
I0912 22:52:18.169949 57925 main.go:141] libmachine: (old-k8s-version-642238) <boot dev='cdrom'/>
I0912 22:52:18.169960 57925 main.go:141] libmachine: (old-k8s-version-642238) <boot dev='hd'/>
I0912 22:52:18.169971 57925 main.go:141] libmachine: (old-k8s-version-642238) <bootmenu enable='no'/>
I0912 22:52:18.169981 57925 main.go:141] libmachine: (old-k8s-version-642238) </os>
I0912 22:52:18.169991 57925 main.go:141] libmachine: (old-k8s-version-642238) <devices>
I0912 22:52:18.170018 57925 main.go:141] libmachine: (old-k8s-version-642238) <disk type='file' device='cdrom'>
I0912 22:52:18.170035 57925 main.go:141] libmachine: (old-k8s-version-642238) <source file='/home/jenkins/minikube-integration/19616-5891/.minikube/machines/old-k8s-version-642238/boot2docker.iso'/>
I0912 22:52:18.170055 57925 main.go:141] libmachine: (old-k8s-version-642238) <target dev='hdc' bus='scsi'/>
I0912 22:52:18.170071 57925 main.go:141] libmachine: (old-k8s-version-642238) <readonly/>
I0912 22:52:18.170089 57925 main.go:141] libmachine: (old-k8s-version-642238) </disk>
I0912 22:52:18.170099 57925 main.go:141] libmachine: (old-k8s-version-642238) <disk type='file' device='disk'>
I0912 22:52:18.170126 57925 main.go:141] libmachine: (old-k8s-version-642238) <driver name='qemu' type='raw' cache='default' io='threads' />
I0912 22:52:18.170150 57925 main.go:141] libmachine: (old-k8s-version-642238) <source file='/home/jenkins/minikube-integration/19616-5891/.minikube/machines/old-k8s-version-642238/old-k8s-version-642238.rawdisk'/>
I0912 22:52:18.170164 57925 main.go:141] libmachine: (old-k8s-version-642238) <target dev='hda' bus='virtio'/>
I0912 22:52:18.170175 57925 main.go:141] libmachine: (old-k8s-version-642238) </disk>
I0912 22:52:18.170189 57925 main.go:141] libmachine: (old-k8s-version-642238) <interface type='network'>
I0912 22:52:18.170201 57925 main.go:141] libmachine: (old-k8s-version-642238) <source network='mk-old-k8s-version-642238'/>
I0912 22:52:18.170215 57925 main.go:141] libmachine: (old-k8s-version-642238) <model type='virtio'/>
I0912 22:52:18.170226 57925 main.go:141] libmachine: (old-k8s-version-642238) </interface>
I0912 22:52:18.170240 57925 main.go:141] libmachine: (old-k8s-version-642238) <interface type='network'>
I0912 22:52:18.170251 57925 main.go:141] libmachine: (old-k8s-version-642238) <source network='default'/>
I0912 22:52:18.170263 57925 main.go:141] libmachine: (old-k8s-version-642238) <model type='virtio'/>
I0912 22:52:18.170274 57925 main.go:141] libmachine: (old-k8s-version-642238) </interface>
I0912 22:52:18.170285 57925 main.go:141] libmachine: (old-k8s-version-642238) <serial type='pty'>
I0912 22:52:18.170294 57925 main.go:141] libmachine: (old-k8s-version-642238) <target port='0'/>
I0912 22:52:18.170300 57925 main.go:141] libmachine: (old-k8s-version-642238) </serial>
I0912 22:52:18.170318 57925 main.go:141] libmachine: (old-k8s-version-642238) <console type='pty'>
I0912 22:52:18.170330 57925 main.go:141] libmachine: (old-k8s-version-642238) <target type='serial' port='0'/>
I0912 22:52:18.170369 57925 main.go:141] libmachine: (old-k8s-version-642238) </console>
I0912 22:52:18.170387 57925 main.go:141] libmachine: (old-k8s-version-642238) <rng model='virtio'>
I0912 22:52:18.170398 57925 main.go:141] libmachine: (old-k8s-version-642238) <backend model='random'>/dev/random</backend>
I0912 22:52:18.170409 57925 main.go:141] libmachine: (old-k8s-version-642238) </rng>
I0912 22:52:18.170421 57925 main.go:141] libmachine: (old-k8s-version-642238)
I0912 22:52:18.170434 57925 main.go:141] libmachine: (old-k8s-version-642238)
I0912 22:52:18.170447 57925 main.go:141] libmachine: (old-k8s-version-642238) </devices>
I0912 22:52:18.170457 57925 main.go:141] libmachine: (old-k8s-version-642238) </domain>
I0912 22:52:18.170471 57925 main.go:141] libmachine: (old-k8s-version-642238)
I0912 22:52:18.174858 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:53:a7:4a in network default
I0912 22:52:18.175729 57925 main.go:141] libmachine: (old-k8s-version-642238) Ensuring networks are active...
I0912 22:52:18.175751 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:18.176532 57925 main.go:141] libmachine: (old-k8s-version-642238) Ensuring network default is active
I0912 22:52:18.176945 57925 main.go:141] libmachine: (old-k8s-version-642238) Ensuring network mk-old-k8s-version-642238 is active
I0912 22:52:18.177643 57925 main.go:141] libmachine: (old-k8s-version-642238) Getting domain xml...
I0912 22:52:18.178456 57925 main.go:141] libmachine: (old-k8s-version-642238) Creating domain...
I0912 22:52:19.473797 57925 main.go:141] libmachine: (old-k8s-version-642238) Waiting to get IP...
I0912 22:52:19.474480 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:19.474872 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | unable to find current IP address of domain old-k8s-version-642238 in network mk-old-k8s-version-642238
I0912 22:52:19.474892 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:19.474863 58109 retry.go:31] will retry after 286.330243ms: waiting for machine to come up
I0912 22:52:19.762384 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:19.763004 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | unable to find current IP address of domain old-k8s-version-642238 in network mk-old-k8s-version-642238
I0912 22:52:19.763033 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:19.762958 58109 retry.go:31] will retry after 248.581952ms: waiting for machine to come up
I0912 22:52:20.013442 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:20.013919 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | unable to find current IP address of domain old-k8s-version-642238 in network mk-old-k8s-version-642238
I0912 22:52:20.013943 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:20.013874 58109 retry.go:31] will retry after 423.642047ms: waiting for machine to come up
I0912 22:52:20.439556 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:20.440066 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | unable to find current IP address of domain old-k8s-version-642238 in network mk-old-k8s-version-642238
I0912 22:52:20.440095 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:20.439978 58109 retry.go:31] will retry after 424.276527ms: waiting for machine to come up
I0912 22:52:20.865441 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:20.865947 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | unable to find current IP address of domain old-k8s-version-642238 in network mk-old-k8s-version-642238
I0912 22:52:20.865981 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:20.865899 58109 retry.go:31] will retry after 731.460727ms: waiting for machine to come up
I0912 22:52:21.598729 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:21.599316 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | unable to find current IP address of domain old-k8s-version-642238 in network mk-old-k8s-version-642238
I0912 22:52:21.599345 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:21.599251 58109 retry.go:31] will retry after 627.251312ms: waiting for machine to come up
I0912 22:52:22.228066 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:22.228710 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | unable to find current IP address of domain old-k8s-version-642238 in network mk-old-k8s-version-642238
I0912 22:52:22.228741 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:22.228654 58109 retry.go:31] will retry after 742.568865ms: waiting for machine to come up
I0912 22:52:22.972970 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:22.973481 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | unable to find current IP address of domain old-k8s-version-642238 in network mk-old-k8s-version-642238
I0912 22:52:22.973510 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:22.973432 58109 retry.go:31] will retry after 1.239439432s: waiting for machine to come up
I0912 22:52:24.214810 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:24.215291 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | unable to find current IP address of domain old-k8s-version-642238 in network mk-old-k8s-version-642238
I0912 22:52:24.215350 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:24.215279 58109 retry.go:31] will retry after 1.485467947s: waiting for machine to come up
I0912 22:52:25.702925 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:25.703370 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | unable to find current IP address of domain old-k8s-version-642238 in network mk-old-k8s-version-642238
I0912 22:52:25.703405 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:25.703316 58109 retry.go:31] will retry after 2.147552553s: waiting for machine to come up
I0912 22:52:27.852616 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:27.853179 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | unable to find current IP address of domain old-k8s-version-642238 in network mk-old-k8s-version-642238
I0912 22:52:27.853228 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:27.853153 58109 retry.go:31] will retry after 2.593428158s: waiting for machine to come up
I0912 22:52:30.447820 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:30.448391 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | unable to find current IP address of domain old-k8s-version-642238 in network mk-old-k8s-version-642238
I0912 22:52:30.448430 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:30.448337 58109 retry.go:31] will retry after 3.337034208s: waiting for machine to come up
I0912 22:52:33.787486 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:33.787953 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | unable to find current IP address of domain old-k8s-version-642238 in network mk-old-k8s-version-642238
I0912 22:52:33.787986 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:33.787904 58109 retry.go:31] will retry after 2.976452066s: waiting for machine to come up
I0912 22:52:36.767192 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:36.767796 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | unable to find current IP address of domain old-k8s-version-642238 in network mk-old-k8s-version-642238
I0912 22:52:36.767826 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | I0912 22:52:36.767747 58109 retry.go:31] will retry after 4.491525175s: waiting for machine to come up
I0912 22:52:41.263611 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:41.264228 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has current primary IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:41.264257 57925 main.go:141] libmachine: (old-k8s-version-642238) Found IP for machine: 192.168.61.69
I0912 22:52:41.264271 57925 main.go:141] libmachine: (old-k8s-version-642238) Reserving static IP address...
I0912 22:52:41.264726 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-642238", mac: "52:54:00:75:cb:57", ip: "192.168.61.69"} in network mk-old-k8s-version-642238
I0912 22:52:41.339270 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | Getting to WaitForSSH function...
I0912 22:52:41.339303 57925 main.go:141] libmachine: (old-k8s-version-642238) Reserved static IP address: 192.168.61.69
I0912 22:52:41.339320 57925 main.go:141] libmachine: (old-k8s-version-642238) Waiting for SSH to be available...
I0912 22:52:41.342293 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:41.342661 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:minikube Clientid:01:52:54:00:75:cb:57}
I0912 22:52:41.342693 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:41.342867 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | Using SSH client type: external
I0912 22:52:41.342902 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | Using SSH private key: /home/jenkins/minikube-integration/19616-5891/.minikube/machines/old-k8s-version-642238/id_rsa (-rw-------)
I0912 22:52:41.342939 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.69 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19616-5891/.minikube/machines/old-k8s-version-642238/id_rsa -p 22] /usr/bin/ssh <nil>}
I0912 22:52:41.342960 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | About to run SSH command:
I0912 22:52:41.342989 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | exit 0
I0912 22:52:41.469537 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | SSH cmd err, output: <nil>:
I0912 22:52:41.469798 57925 main.go:141] libmachine: (old-k8s-version-642238) KVM machine creation complete!
I0912 22:52:41.470098 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetConfigRaw
I0912 22:52:41.470662 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .DriverName
I0912 22:52:41.470867 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .DriverName
I0912 22:52:41.471041 57925 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0912 22:52:41.471057 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetState
I0912 22:52:41.472315 57925 main.go:141] libmachine: Detecting operating system of created instance...
I0912 22:52:41.472328 57925 main.go:141] libmachine: Waiting for SSH to be available...
I0912 22:52:41.472334 57925 main.go:141] libmachine: Getting to WaitForSSH function...
I0912 22:52:41.472339 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHHostname
I0912 22:52:41.474453 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:41.474790 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:old-k8s-version-642238 Clientid:01:52:54:00:75:cb:57}
I0912 22:52:41.474813 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:41.475018 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHPort
I0912 22:52:41.475184 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHKeyPath
I0912 22:52:41.475347 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHKeyPath
I0912 22:52:41.475485 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHUsername
I0912 22:52:41.475668 57925 main.go:141] libmachine: Using SSH client type: native
I0912 22:52:41.475844 57925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 192.168.61.69 22 <nil> <nil>}
I0912 22:52:41.475854 57925 main.go:141] libmachine: About to run SSH command:
exit 0
I0912 22:52:41.585116 57925 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0912 22:52:41.585139 57925 main.go:141] libmachine: Detecting the provisioner...
I0912 22:52:41.585146 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHHostname
I0912 22:52:41.587770 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:41.588088 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:old-k8s-version-642238 Clientid:01:52:54:00:75:cb:57}
I0912 22:52:41.588113 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:41.588293 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHPort
I0912 22:52:41.588479 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHKeyPath
I0912 22:52:41.588636 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHKeyPath
I0912 22:52:41.588737 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHUsername
I0912 22:52:41.588879 57925 main.go:141] libmachine: Using SSH client type: native
I0912 22:52:41.589061 57925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 192.168.61.69 22 <nil> <nil>}
I0912 22:52:41.589072 57925 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0912 22:52:41.698156 57925 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0912 22:52:41.698217 57925 main.go:141] libmachine: found compatible host: buildroot
I0912 22:52:41.698229 57925 main.go:141] libmachine: Provisioning with buildroot...
I0912 22:52:41.698244 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetMachineName
I0912 22:52:41.698472 57925 buildroot.go:166] provisioning hostname "old-k8s-version-642238"
I0912 22:52:41.698497 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetMachineName
I0912 22:52:41.698709 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHHostname
I0912 22:52:41.701394 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:41.701875 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:old-k8s-version-642238 Clientid:01:52:54:00:75:cb:57}
I0912 22:52:41.701902 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:41.702110 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHPort
I0912 22:52:41.702324 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHKeyPath
I0912 22:52:41.702499 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHKeyPath
I0912 22:52:41.702663 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHUsername
I0912 22:52:41.702845 57925 main.go:141] libmachine: Using SSH client type: native
I0912 22:52:41.703008 57925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 192.168.61.69 22 <nil> <nil>}
I0912 22:52:41.703019 57925 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-642238 && echo "old-k8s-version-642238" | sudo tee /etc/hostname
I0912 22:52:41.823243 57925 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-642238
I0912 22:52:41.823279 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHHostname
I0912 22:52:41.825983 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:41.826401 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:old-k8s-version-642238 Clientid:01:52:54:00:75:cb:57}
I0912 22:52:41.826433 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:41.826598 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHPort
I0912 22:52:41.826783 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHKeyPath
I0912 22:52:41.826949 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHKeyPath
I0912 22:52:41.827125 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHUsername
I0912 22:52:41.827301 57925 main.go:141] libmachine: Using SSH client type: native
I0912 22:52:41.827513 57925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 192.168.61.69 22 <nil> <nil>}
I0912 22:52:41.827532 57925 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-642238' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-642238/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-642238' | sudo tee -a /etc/hosts;
fi
fi
I0912 22:52:41.946923 57925 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0912 22:52:41.946956 57925 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19616-5891/.minikube CaCertPath:/home/jenkins/minikube-integration/19616-5891/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19616-5891/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19616-5891/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19616-5891/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19616-5891/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19616-5891/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19616-5891/.minikube}
I0912 22:52:41.947018 57925 buildroot.go:174] setting up certificates
I0912 22:52:41.947031 57925 provision.go:84] configureAuth start
I0912 22:52:41.947049 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetMachineName
I0912 22:52:41.947368 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetIP
I0912 22:52:41.950472 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:41.950874 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:old-k8s-version-642238 Clientid:01:52:54:00:75:cb:57}
I0912 22:52:41.950904 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:41.951015 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHHostname
I0912 22:52:41.953142 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:41.953522 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:old-k8s-version-642238 Clientid:01:52:54:00:75:cb:57}
I0912 22:52:41.953549 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:41.953763 57925 provision.go:143] copyHostCerts
I0912 22:52:41.953829 57925 exec_runner.go:144] found /home/jenkins/minikube-integration/19616-5891/.minikube/ca.pem, removing ...
I0912 22:52:41.953841 57925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19616-5891/.minikube/ca.pem
I0912 22:52:41.953899 57925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19616-5891/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19616-5891/.minikube/ca.pem (1082 bytes)
I0912 22:52:41.953985 57925 exec_runner.go:144] found /home/jenkins/minikube-integration/19616-5891/.minikube/cert.pem, removing ...
I0912 22:52:41.953992 57925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19616-5891/.minikube/cert.pem
I0912 22:52:41.954011 57925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19616-5891/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19616-5891/.minikube/cert.pem (1123 bytes)
I0912 22:52:41.954057 57925 exec_runner.go:144] found /home/jenkins/minikube-integration/19616-5891/.minikube/key.pem, removing ...
I0912 22:52:41.954064 57925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19616-5891/.minikube/key.pem
I0912 22:52:41.954080 57925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19616-5891/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19616-5891/.minikube/key.pem (1679 bytes)
I0912 22:52:41.954121 57925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19616-5891/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19616-5891/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19616-5891/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-642238 san=[127.0.0.1 192.168.61.69 localhost minikube old-k8s-version-642238]
I0912 22:52:42.074469 57925 provision.go:177] copyRemoteCerts
I0912 22:52:42.074525 57925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0912 22:52:42.074550 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHHostname
I0912 22:52:42.077329 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.077789 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:old-k8s-version-642238 Clientid:01:52:54:00:75:cb:57}
I0912 22:52:42.077811 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.077995 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHPort
I0912 22:52:42.078204 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHKeyPath
I0912 22:52:42.078391 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHUsername
I0912 22:52:42.078614 57925 sshutil.go:53] new ssh client: &{IP:192.168.61.69 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19616-5891/.minikube/machines/old-k8s-version-642238/id_rsa Username:docker}
I0912 22:52:42.164306 57925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19616-5891/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0912 22:52:42.187713 57925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19616-5891/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0912 22:52:42.210253 57925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19616-5891/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0912 22:52:42.233998 57925 provision.go:87] duration metric: took 286.949458ms to configureAuth
I0912 22:52:42.234033 57925 buildroot.go:189] setting minikube options for container-runtime
I0912 22:52:42.234215 57925 config.go:182] Loaded profile config "old-k8s-version-642238": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0912 22:52:42.234278 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHHostname
I0912 22:52:42.236627 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.236899 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:old-k8s-version-642238 Clientid:01:52:54:00:75:cb:57}
I0912 22:52:42.236933 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.237214 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHPort
I0912 22:52:42.237422 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHKeyPath
I0912 22:52:42.237595 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHKeyPath
I0912 22:52:42.237744 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHUsername
I0912 22:52:42.237929 57925 main.go:141] libmachine: Using SSH client type: native
I0912 22:52:42.238143 57925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 192.168.61.69 22 <nil> <nil>}
I0912 22:52:42.238162 57925 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0912 22:52:42.462050 57925 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0912 22:52:42.462076 57925 main.go:141] libmachine: Checking connection to Docker...
I0912 22:52:42.462087 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetURL
I0912 22:52:42.463358 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | Using libvirt version 6000000
I0912 22:52:42.465912 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.466315 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:old-k8s-version-642238 Clientid:01:52:54:00:75:cb:57}
I0912 22:52:42.466345 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.466546 57925 main.go:141] libmachine: Docker is up and running!
I0912 22:52:42.466559 57925 main.go:141] libmachine: Reticulating splines...
I0912 22:52:42.466565 57925 client.go:171] duration metric: took 24.758689755s to LocalClient.Create
I0912 22:52:42.466586 57925 start.go:167] duration metric: took 24.758760221s to libmachine.API.Create "old-k8s-version-642238"
I0912 22:52:42.466598 57925 start.go:293] postStartSetup for "old-k8s-version-642238" (driver="kvm2")
I0912 22:52:42.466623 57925 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0912 22:52:42.466641 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .DriverName
I0912 22:52:42.466875 57925 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0912 22:52:42.466899 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHHostname
I0912 22:52:42.468858 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.469200 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:old-k8s-version-642238 Clientid:01:52:54:00:75:cb:57}
I0912 22:52:42.469244 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.469327 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHPort
I0912 22:52:42.469512 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHKeyPath
I0912 22:52:42.469706 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHUsername
I0912 22:52:42.469840 57925 sshutil.go:53] new ssh client: &{IP:192.168.61.69 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19616-5891/.minikube/machines/old-k8s-version-642238/id_rsa Username:docker}
I0912 22:52:42.559595 57925 ssh_runner.go:195] Run: cat /etc/os-release
I0912 22:52:42.565483 57925 info.go:137] Remote host: Buildroot 2023.02.9
I0912 22:52:42.565508 57925 filesync.go:126] Scanning /home/jenkins/minikube-integration/19616-5891/.minikube/addons for local assets ...
I0912 22:52:42.565590 57925 filesync.go:126] Scanning /home/jenkins/minikube-integration/19616-5891/.minikube/files for local assets ...
I0912 22:52:42.565695 57925 filesync.go:149] local asset: /home/jenkins/minikube-integration/19616-5891/.minikube/files/etc/ssl/certs/130832.pem -> 130832.pem in /etc/ssl/certs
I0912 22:52:42.565801 57925 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0912 22:52:42.575169 57925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19616-5891/.minikube/files/etc/ssl/certs/130832.pem --> /etc/ssl/certs/130832.pem (1708 bytes)
I0912 22:52:42.598163 57925 start.go:296] duration metric: took 131.55045ms for postStartSetup
I0912 22:52:42.598206 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetConfigRaw
I0912 22:52:42.598763 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetIP
I0912 22:52:42.601072 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.601372 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:old-k8s-version-642238 Clientid:01:52:54:00:75:cb:57}
I0912 22:52:42.601400 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.601646 57925 profile.go:143] Saving config to /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/config.json ...
I0912 22:52:42.601837 57925 start.go:128] duration metric: took 24.923286821s to createHost
I0912 22:52:42.601858 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHHostname
I0912 22:52:42.604172 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.604496 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:old-k8s-version-642238 Clientid:01:52:54:00:75:cb:57}
I0912 22:52:42.604530 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.604728 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHPort
I0912 22:52:42.604917 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHKeyPath
I0912 22:52:42.605100 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHKeyPath
I0912 22:52:42.605273 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHUsername
I0912 22:52:42.605459 57925 main.go:141] libmachine: Using SSH client type: native
I0912 22:52:42.605658 57925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8375c0] 0x83a320 <nil> [] 0s} 192.168.61.69 22 <nil> <nil>}
I0912 22:52:42.605669 57925 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0912 22:52:42.714199 57925 main.go:141] libmachine: SSH cmd err, output: <nil>: 1726181562.692289590
I0912 22:52:42.714230 57925 fix.go:216] guest clock: 1726181562.692289590
I0912 22:52:42.714247 57925 fix.go:229] Guest: 2024-09-12 22:52:42.69228959 +0000 UTC Remote: 2024-09-12 22:52:42.601847989 +0000 UTC m=+36.339825032 (delta=90.441601ms)
I0912 22:52:42.714299 57925 fix.go:200] guest clock delta is within tolerance: 90.441601ms
I0912 22:52:42.714308 57925 start.go:83] releasing machines lock for "old-k8s-version-642238", held for 25.035923878s
I0912 22:52:42.714347 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .DriverName
I0912 22:52:42.714611 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetIP
I0912 22:52:42.717869 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.718359 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:old-k8s-version-642238 Clientid:01:52:54:00:75:cb:57}
I0912 22:52:42.718403 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.718557 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .DriverName
I0912 22:52:42.719010 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .DriverName
I0912 22:52:42.719200 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .DriverName
I0912 22:52:42.719334 57925 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0912 22:52:42.719382 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHHostname
I0912 22:52:42.719511 57925 ssh_runner.go:195] Run: cat /version.json
I0912 22:52:42.719542 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHHostname
I0912 22:52:42.722384 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.722750 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:old-k8s-version-642238 Clientid:01:52:54:00:75:cb:57}
I0912 22:52:42.722780 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.722817 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.722925 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHPort
I0912 22:52:42.723131 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHKeyPath
I0912 22:52:42.723251 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:old-k8s-version-642238 Clientid:01:52:54:00:75:cb:57}
I0912 22:52:42.723274 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHUsername
I0912 22:52:42.723275 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:42.723439 57925 sshutil.go:53] new ssh client: &{IP:192.168.61.69 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19616-5891/.minikube/machines/old-k8s-version-642238/id_rsa Username:docker}
I0912 22:52:42.723481 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHPort
I0912 22:52:42.723626 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHKeyPath
I0912 22:52:42.723775 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetSSHUsername
I0912 22:52:42.723941 57925 sshutil.go:53] new ssh client: &{IP:192.168.61.69 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19616-5891/.minikube/machines/old-k8s-version-642238/id_rsa Username:docker}
I0912 22:52:42.802884 57925 ssh_runner.go:195] Run: systemctl --version
I0912 22:52:42.834504 57925 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0912 22:52:43.001104 57925 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0912 22:52:43.007658 57925 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0912 22:52:43.007755 57925 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0912 22:52:43.024995 57925 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0912 22:52:43.025023 57925 start.go:495] detecting cgroup driver to use...
I0912 22:52:43.025093 57925 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0912 22:52:43.040884 57925 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0912 22:52:43.054630 57925 docker.go:217] disabling cri-docker service (if available) ...
I0912 22:52:43.054700 57925 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0912 22:52:43.068462 57925 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0912 22:52:43.082436 57925 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0912 22:52:43.195163 57925 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0912 22:52:43.353255 57925 docker.go:233] disabling docker service ...
I0912 22:52:43.353330 57925 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0912 22:52:43.367709 57925 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0912 22:52:43.380773 57925 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0912 22:52:43.507325 57925 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0912 22:52:43.632893 57925 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0912 22:52:43.647145 57925 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0912 22:52:43.668829 57925 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0912 22:52:43.668883 57925 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0912 22:52:43.680339 57925 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0912 22:52:43.680417 57925 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0912 22:52:43.690346 57925 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0912 22:52:43.700558 57925 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0912 22:52:43.710662 57925 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0912 22:52:43.721063 57925 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0912 22:52:43.731299 57925 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0912 22:52:43.731360 57925 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0912 22:52:43.745285 57925 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0912 22:52:43.755169 57925 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0912 22:52:43.881840 57925 ssh_runner.go:195] Run: sudo systemctl restart crio
I0912 22:52:43.984142 57925 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0912 22:52:43.984211 57925 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0912 22:52:43.988832 57925 start.go:563] Will wait 60s for crictl version
I0912 22:52:43.988891 57925 ssh_runner.go:195] Run: which crictl
I0912 22:52:43.992662 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0912 22:52:44.032984 57925 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0912 22:52:44.033089 57925 ssh_runner.go:195] Run: crio --version
I0912 22:52:44.061151 57925 ssh_runner.go:195] Run: crio --version
I0912 22:52:44.095536 57925 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0912 22:52:44.097047 57925 main.go:141] libmachine: (old-k8s-version-642238) Calling .GetIP
I0912 22:52:44.100829 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:44.101363 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:75:cb:57", ip: ""} in network mk-old-k8s-version-642238: {Iface:virbr3 ExpiryTime:2024-09-12 23:52:31 +0000 UTC Type:0 Mac:52:54:00:75:cb:57 Iaid: IPaddr:192.168.61.69 Prefix:24 Hostname:old-k8s-version-642238 Clientid:01:52:54:00:75:cb:57}
I0912 22:52:44.101397 57925 main.go:141] libmachine: (old-k8s-version-642238) DBG | domain old-k8s-version-642238 has defined IP address 192.168.61.69 and MAC address 52:54:00:75:cb:57 in network mk-old-k8s-version-642238
I0912 22:52:44.101747 57925 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0912 22:52:44.105914 57925 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0912 22:52:44.118699 57925 kubeadm.go:883] updating cluster {Name:old-k8s-version-642238 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-642238 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.69 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0912 22:52:44.118852 57925 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0912 22:52:44.118922 57925 ssh_runner.go:195] Run: sudo crictl images --output json
I0912 22:52:44.154174 57925 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0912 22:52:44.154238 57925 ssh_runner.go:195] Run: which lz4
I0912 22:52:44.158324 57925 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0912 22:52:44.162751 57925 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0912 22:52:44.162789 57925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19616-5891/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0912 22:52:45.762998 57925 crio.go:462] duration metric: took 1.604700507s to copy over tarball
I0912 22:52:45.763107 57925 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0912 22:52:48.390767 57925 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.627623654s)
I0912 22:52:48.390799 57925 crio.go:469] duration metric: took 2.627754027s to extract the tarball
I0912 22:52:48.390809 57925 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0912 22:52:48.432225 57925 ssh_runner.go:195] Run: sudo crictl images --output json
I0912 22:52:48.484732 57925 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0912 22:52:48.484763 57925 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0912 22:52:48.484843 57925 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0912 22:52:48.484866 57925 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0912 22:52:48.484880 57925 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0912 22:52:48.484874 57925 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0912 22:52:48.484894 57925 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0912 22:52:48.484897 57925 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0912 22:52:48.484914 57925 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0912 22:52:48.484846 57925 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0912 22:52:48.486497 57925 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0912 22:52:48.486539 57925 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0912 22:52:48.486503 57925 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0912 22:52:48.486515 57925 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0912 22:52:48.486515 57925 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0912 22:52:48.486583 57925 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0912 22:52:48.486508 57925 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0912 22:52:48.486502 57925 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0912 22:52:48.727736 57925 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0912 22:52:48.733408 57925 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0912 22:52:48.748176 57925 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0912 22:52:48.760674 57925 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0912 22:52:48.767426 57925 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0912 22:52:48.783597 57925 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0912 22:52:48.803128 57925 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0912 22:52:48.803209 57925 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0912 22:52:48.803212 57925 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0912 22:52:48.803244 57925 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0912 22:52:48.803268 57925 ssh_runner.go:195] Run: which crictl
I0912 22:52:48.803302 57925 ssh_runner.go:195] Run: which crictl
I0912 22:52:48.857696 57925 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0912 22:52:48.857745 57925 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0912 22:52:48.857770 57925 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0912 22:52:48.857793 57925 ssh_runner.go:195] Run: which crictl
I0912 22:52:48.857799 57925 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0912 22:52:48.857837 57925 ssh_runner.go:195] Run: which crictl
I0912 22:52:48.865027 57925 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0912 22:52:48.901741 57925 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0912 22:52:48.901795 57925 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0912 22:52:48.901816 57925 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0912 22:52:48.901851 57925 ssh_runner.go:195] Run: which crictl
I0912 22:52:48.901859 57925 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0912 22:52:48.901889 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0912 22:52:48.901934 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0912 22:52:48.901891 57925 ssh_runner.go:195] Run: which crictl
I0912 22:52:48.901946 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0912 22:52:48.901976 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0912 22:52:48.934007 57925 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0912 22:52:48.934056 57925 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0912 22:52:48.934102 57925 ssh_runner.go:195] Run: which crictl
I0912 22:52:49.006500 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0912 22:52:49.016679 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0912 22:52:49.016735 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0912 22:52:49.016797 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0912 22:52:49.016824 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0912 22:52:49.016846 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0912 22:52:49.016886 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0912 22:52:49.133314 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0912 22:52:49.162065 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0912 22:52:49.162163 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0912 22:52:49.162213 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0912 22:52:49.162163 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0912 22:52:49.162277 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0912 22:52:49.170178 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0912 22:52:49.261688 57925 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19616-5891/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0912 22:52:49.317713 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0912 22:52:49.317713 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0912 22:52:49.317828 57925 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0912 22:52:49.317975 57925 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19616-5891/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0912 22:52:49.318029 57925 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19616-5891/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0912 22:52:49.318064 57925 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19616-5891/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0912 22:52:49.381042 57925 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19616-5891/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0912 22:52:49.381133 57925 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19616-5891/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0912 22:52:49.386668 57925 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19616-5891/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0912 22:52:49.550806 57925 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0912 22:52:49.694417 57925 cache_images.go:92] duration metric: took 1.209639188s to LoadCachedImages
W0912 22:52:49.694512 57925 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19616-5891/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19616-5891/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
I0912 22:52:49.694530 57925 kubeadm.go:934] updating node { 192.168.61.69 8443 v1.20.0 crio true true} ...
I0912 22:52:49.694647 57925 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-642238 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.69
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-642238 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0912 22:52:49.694720 57925 ssh_runner.go:195] Run: crio config
I0912 22:52:49.759672 57925 cni.go:84] Creating CNI manager for ""
I0912 22:52:49.759699 57925 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0912 22:52:49.759711 57925 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0912 22:52:49.759727 57925 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.69 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-642238 NodeName:old-k8s-version-642238 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.69"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.69 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0912 22:52:49.759843 57925 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.69
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-642238"
kubeletExtraArgs:
node-ip: 192.168.61.69
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.69"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0912 22:52:49.759901 57925 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0912 22:52:49.770518 57925 binaries.go:44] Found k8s binaries, skipping transfer
I0912 22:52:49.770592 57925 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0912 22:52:49.780437 57925 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0912 22:52:49.801132 57925 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0912 22:52:49.819109 57925 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0912 22:52:49.838382 57925 ssh_runner.go:195] Run: grep 192.168.61.69 control-plane.minikube.internal$ /etc/hosts
I0912 22:52:49.842687 57925 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.69 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0912 22:52:49.855169 57925 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0912 22:52:49.984253 57925 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0912 22:52:50.001705 57925 certs.go:68] Setting up /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238 for IP: 192.168.61.69
I0912 22:52:50.001732 57925 certs.go:194] generating shared ca certs ...
I0912 22:52:50.001753 57925 certs.go:226] acquiring lock for ca certs: {Name:mk5e19f2c2757edc3fcb6b43a39efee0885b349c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0912 22:52:50.001919 57925 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19616-5891/.minikube/ca.key
I0912 22:52:50.001989 57925 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19616-5891/.minikube/proxy-client-ca.key
I0912 22:52:50.002004 57925 certs.go:256] generating profile certs ...
I0912 22:52:50.002066 57925 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/client.key
I0912 22:52:50.002092 57925 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/client.crt with IP's: []
I0912 22:52:50.223450 57925 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/client.crt ...
I0912 22:52:50.223489 57925 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/client.crt: {Name:mk31c734b731787e02b2f625a25fa30bc15752e2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0912 22:52:50.223699 57925 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/client.key ...
I0912 22:52:50.223717 57925 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/client.key: {Name:mkd5733bf65606e06bfb6a398f55d243a90257ac Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0912 22:52:50.223826 57925 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/apiserver.key.fcb0a37b
I0912 22:52:50.223844 57925 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/apiserver.crt.fcb0a37b with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.69]
I0912 22:52:50.612862 57925 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/apiserver.crt.fcb0a37b ...
I0912 22:52:50.612900 57925 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/apiserver.crt.fcb0a37b: {Name:mk63ffb3c9cb311cad012560539dfd8f371bd937 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0912 22:52:50.613066 57925 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/apiserver.key.fcb0a37b ...
I0912 22:52:50.613079 57925 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/apiserver.key.fcb0a37b: {Name:mk61aef47f3b68d26b7a7a5383b93bc5b73f7dd2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0912 22:52:50.613147 57925 certs.go:381] copying /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/apiserver.crt.fcb0a37b -> /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/apiserver.crt
I0912 22:52:50.613215 57925 certs.go:385] copying /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/apiserver.key.fcb0a37b -> /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/apiserver.key
I0912 22:52:50.613313 57925 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/proxy-client.key
I0912 22:52:50.613329 57925 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/proxy-client.crt with IP's: []
I0912 22:52:50.864145 57925 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/proxy-client.crt ...
I0912 22:52:50.864177 57925 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/proxy-client.crt: {Name:mk122833def54c6ef7e81fff7a1c3f02122d6d83 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0912 22:52:50.864382 57925 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/proxy-client.key ...
I0912 22:52:50.864400 57925 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/proxy-client.key: {Name:mkca325919049bdf85bb55f233979a3db32d858b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0912 22:52:50.864602 57925 certs.go:484] found cert: /home/jenkins/minikube-integration/19616-5891/.minikube/certs/13083.pem (1338 bytes)
W0912 22:52:50.864641 57925 certs.go:480] ignoring /home/jenkins/minikube-integration/19616-5891/.minikube/certs/13083_empty.pem, impossibly tiny 0 bytes
I0912 22:52:50.864651 57925 certs.go:484] found cert: /home/jenkins/minikube-integration/19616-5891/.minikube/certs/ca-key.pem (1679 bytes)
I0912 22:52:50.864673 57925 certs.go:484] found cert: /home/jenkins/minikube-integration/19616-5891/.minikube/certs/ca.pem (1082 bytes)
I0912 22:52:50.864698 57925 certs.go:484] found cert: /home/jenkins/minikube-integration/19616-5891/.minikube/certs/cert.pem (1123 bytes)
I0912 22:52:50.864722 57925 certs.go:484] found cert: /home/jenkins/minikube-integration/19616-5891/.minikube/certs/key.pem (1679 bytes)
I0912 22:52:50.864762 57925 certs.go:484] found cert: /home/jenkins/minikube-integration/19616-5891/.minikube/files/etc/ssl/certs/130832.pem (1708 bytes)
I0912 22:52:50.865360 57925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19616-5891/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0912 22:52:50.893877 57925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19616-5891/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0912 22:52:50.922378 57925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19616-5891/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0912 22:52:50.952003 57925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19616-5891/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0912 22:52:50.979936 57925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0912 22:52:51.007097 57925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0912 22:52:51.035161 57925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0912 22:52:51.058619 57925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19616-5891/.minikube/profiles/old-k8s-version-642238/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0912 22:52:51.086262 57925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19616-5891/.minikube/certs/13083.pem --> /usr/share/ca-certificates/13083.pem (1338 bytes)
I0912 22:52:51.110793 57925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19616-5891/.minikube/files/etc/ssl/certs/130832.pem --> /usr/share/ca-certificates/130832.pem (1708 bytes)
I0912 22:52:51.135491 57925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19616-5891/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0912 22:52:51.157386 57925 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0912 22:52:51.174015 57925 ssh_runner.go:195] Run: openssl version
I0912 22:52:51.179807 57925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/130832.pem && ln -fs /usr/share/ca-certificates/130832.pem /etc/ssl/certs/130832.pem"
I0912 22:52:51.190310 57925 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/130832.pem
I0912 22:52:51.194595 57925 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 12 21:47 /usr/share/ca-certificates/130832.pem
I0912 22:52:51.194658 57925 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/130832.pem
I0912 22:52:51.200321 57925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/130832.pem /etc/ssl/certs/3ec20f2e.0"
I0912 22:52:51.212591 57925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0912 22:52:51.223315 57925 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0912 22:52:51.228023 57925 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 12 21:30 /usr/share/ca-certificates/minikubeCA.pem
I0912 22:52:51.228081 57925 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0912 22:52:51.233787 57925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0912 22:52:51.245469 57925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/13083.pem && ln -fs /usr/share/ca-certificates/13083.pem /etc/ssl/certs/13083.pem"
I0912 22:52:51.257163 57925 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/13083.pem
I0912 22:52:51.262432 57925 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 12 21:47 /usr/share/ca-certificates/13083.pem
I0912 22:52:51.262508 57925 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/13083.pem
I0912 22:52:51.270333 57925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/13083.pem /etc/ssl/certs/51391683.0"
I0912 22:52:51.281802 57925 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0912 22:52:51.286063 57925 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0912 22:52:51.286133 57925 kubeadm.go:392] StartCluster: {Name:old-k8s-version-642238 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19616/minikube-v1.34.0-1726156389-19616-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726156396-19616@sha256:66b06a42534e914a5c8ad765d7508a93a34031939ec9a6b3a818ef0a444ff889 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-642238 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.69 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0912 22:52:51.286222 57925 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0912 22:52:51.286282 57925 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0912 22:52:51.324066 57925 cri.go:89] found id: ""
I0912 22:52:51.324138 57925 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0912 22:52:51.334865 57925 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0912 22:52:51.345742 57925 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0912 22:52:51.355408 57925 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0912 22:52:51.355439 57925 kubeadm.go:157] found existing configuration files:
I0912 22:52:51.355495 57925 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0912 22:52:51.364825 57925 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0912 22:52:51.364888 57925 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0912 22:52:51.374812 57925 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0912 22:52:51.386940 57925 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0912 22:52:51.387011 57925 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0912 22:52:51.398427 57925 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0912 22:52:51.409015 57925 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0912 22:52:51.409081 57925 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0912 22:52:51.419665 57925 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0912 22:52:51.429587 57925 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0912 22:52:51.429663 57925 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0912 22:52:51.439203 57925 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0912 22:52:51.723437 57925 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0912 22:54:49.156343 57925 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0912 22:54:49.156472 57925 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0912 22:54:49.157955 57925 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0912 22:54:49.157998 57925 kubeadm.go:310] [preflight] Running pre-flight checks
I0912 22:54:49.158075 57925 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0912 22:54:49.158179 57925 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0912 22:54:49.158293 57925 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0912 22:54:49.158404 57925 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0912 22:54:49.160510 57925 out.go:235] - Generating certificates and keys ...
I0912 22:54:49.160609 57925 kubeadm.go:310] [certs] Using existing ca certificate authority
I0912 22:54:49.160669 57925 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0912 22:54:49.160726 57925 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0912 22:54:49.160783 57925 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0912 22:54:49.160834 57925 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0912 22:54:49.160880 57925 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0912 22:54:49.160936 57925 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0912 22:54:49.161065 57925 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-642238] and IPs [192.168.61.69 127.0.0.1 ::1]
I0912 22:54:49.161147 57925 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0912 22:54:49.161342 57925 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-642238] and IPs [192.168.61.69 127.0.0.1 ::1]
I0912 22:54:49.161410 57925 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0912 22:54:49.161464 57925 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0912 22:54:49.161505 57925 kubeadm.go:310] [certs] Generating "sa" key and public key
I0912 22:54:49.161552 57925 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0912 22:54:49.161598 57925 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0912 22:54:49.161671 57925 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0912 22:54:49.161726 57925 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0912 22:54:49.161786 57925 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0912 22:54:49.161895 57925 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0912 22:54:49.161972 57925 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0912 22:54:49.162011 57925 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0912 22:54:49.162082 57925 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0912 22:54:49.163775 57925 out.go:235] - Booting up control plane ...
I0912 22:54:49.163870 57925 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0912 22:54:49.163935 57925 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0912 22:54:49.163997 57925 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0912 22:54:49.164068 57925 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0912 22:54:49.164196 57925 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0912 22:54:49.164257 57925 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0912 22:54:49.164325 57925 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0912 22:54:49.164487 57925 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0912 22:54:49.164555 57925 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0912 22:54:49.164710 57925 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0912 22:54:49.164767 57925 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0912 22:54:49.164936 57925 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0912 22:54:49.165003 57925 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0912 22:54:49.165164 57925 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0912 22:54:49.165227 57925 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0912 22:54:49.165403 57925 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0912 22:54:49.165414 57925 kubeadm.go:310]
I0912 22:54:49.165447 57925 kubeadm.go:310] Unfortunately, an error has occurred:
I0912 22:54:49.165485 57925 kubeadm.go:310] timed out waiting for the condition
I0912 22:54:49.165492 57925 kubeadm.go:310]
I0912 22:54:49.165521 57925 kubeadm.go:310] This error is likely caused by:
I0912 22:54:49.165553 57925 kubeadm.go:310] - The kubelet is not running
I0912 22:54:49.165673 57925 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0912 22:54:49.165685 57925 kubeadm.go:310]
I0912 22:54:49.165777 57925 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0912 22:54:49.165817 57925 kubeadm.go:310] - 'systemctl status kubelet'
I0912 22:54:49.165845 57925 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0912 22:54:49.165851 57925 kubeadm.go:310]
I0912 22:54:49.165944 57925 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0912 22:54:49.166020 57925 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0912 22:54:49.166030 57925 kubeadm.go:310]
I0912 22:54:49.166118 57925 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0912 22:54:49.166208 57925 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0912 22:54:49.166310 57925 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0912 22:54:49.166374 57925 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0912 22:54:49.166387 57925 kubeadm.go:310]
W0912 22:54:49.166478 57925 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-642238] and IPs [192.168.61.69 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-642238] and IPs [192.168.61.69 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-642238] and IPs [192.168.61.69 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-642238] and IPs [192.168.61.69 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0912 22:54:49.166520 57925 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0912 22:54:49.627770 57925 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0912 22:54:49.641878 57925 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0912 22:54:49.651201 57925 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0912 22:54:49.651223 57925 kubeadm.go:157] found existing configuration files:
I0912 22:54:49.651267 57925 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0912 22:54:49.660718 57925 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0912 22:54:49.660771 57925 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0912 22:54:49.670023 57925 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0912 22:54:49.678763 57925 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0912 22:54:49.678832 57925 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0912 22:54:49.687795 57925 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0912 22:54:49.696630 57925 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0912 22:54:49.696694 57925 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0912 22:54:49.705711 57925 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0912 22:54:49.714433 57925 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0912 22:54:49.714498 57925 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0912 22:54:49.723733 57925 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0912 22:54:49.787655 57925 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0912 22:54:49.787706 57925 kubeadm.go:310] [preflight] Running pre-flight checks
I0912 22:54:49.940389 57925 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0912 22:54:49.940538 57925 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0912 22:54:49.940629 57925 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0912 22:54:50.114662 57925 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0912 22:54:50.116668 57925 out.go:235] - Generating certificates and keys ...
I0912 22:54:50.116770 57925 kubeadm.go:310] [certs] Using existing ca certificate authority
I0912 22:54:50.116854 57925 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0912 22:54:50.116984 57925 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0912 22:54:50.117096 57925 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0912 22:54:50.117211 57925 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0912 22:54:50.117281 57925 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0912 22:54:50.117370 57925 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0912 22:54:50.117462 57925 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0912 22:54:50.117861 57925 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0912 22:54:50.118231 57925 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0912 22:54:50.118362 57925 kubeadm.go:310] [certs] Using the existing "sa" key
I0912 22:54:50.118435 57925 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0912 22:54:50.205266 57925 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0912 22:54:50.322921 57925 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0912 22:54:50.467411 57925 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0912 22:54:50.607679 57925 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0912 22:54:50.627191 57925 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0912 22:54:50.628251 57925 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0912 22:54:50.628314 57925 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0912 22:54:50.755988 57925 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0912 22:54:50.758452 57925 out.go:235] - Booting up control plane ...
I0912 22:54:50.758596 57925 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0912 22:54:50.762456 57925 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0912 22:54:50.764606 57925 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0912 22:54:50.768205 57925 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0912 22:54:50.769853 57925 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0912 22:55:30.772407 57925 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0912 22:55:30.772750 57925 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0912 22:55:30.772969 57925 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0912 22:55:35.773457 57925 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0912 22:55:35.773736 57925 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0912 22:55:45.774052 57925 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0912 22:55:45.774277 57925 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0912 22:56:05.773158 57925 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0912 22:56:05.773388 57925 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0912 22:56:45.772772 57925 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0912 22:56:45.773049 57925 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0912 22:56:45.773076 57925 kubeadm.go:310]
I0912 22:56:45.773147 57925 kubeadm.go:310] Unfortunately, an error has occurred:
I0912 22:56:45.773202 57925 kubeadm.go:310] timed out waiting for the condition
I0912 22:56:45.773213 57925 kubeadm.go:310]
I0912 22:56:45.773260 57925 kubeadm.go:310] This error is likely caused by:
I0912 22:56:45.773303 57925 kubeadm.go:310] - The kubelet is not running
I0912 22:56:45.773456 57925 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0912 22:56:45.773466 57925 kubeadm.go:310]
I0912 22:56:45.773650 57925 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0912 22:56:45.773703 57925 kubeadm.go:310] - 'systemctl status kubelet'
I0912 22:56:45.773752 57925 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0912 22:56:45.773762 57925 kubeadm.go:310]
I0912 22:56:45.773907 57925 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0912 22:56:45.774026 57925 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0912 22:56:45.774036 57925 kubeadm.go:310]
I0912 22:56:45.774201 57925 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0912 22:56:45.774335 57925 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0912 22:56:45.774462 57925 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0912 22:56:45.774583 57925 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0912 22:56:45.774599 57925 kubeadm.go:310]
I0912 22:56:45.774971 57925 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0912 22:56:45.775085 57925 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0912 22:56:45.775170 57925 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0912 22:56:45.775236 57925 kubeadm.go:394] duration metric: took 3m54.489105968s to StartCluster
I0912 22:56:45.775308 57925 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0912 22:56:45.775376 57925 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0912 22:56:45.818524 57925 cri.go:89] found id: ""
I0912 22:56:45.818550 57925 logs.go:276] 0 containers: []
W0912 22:56:45.818559 57925 logs.go:278] No container was found matching "kube-apiserver"
I0912 22:56:45.818570 57925 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0912 22:56:45.818623 57925 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0912 22:56:45.855101 57925 cri.go:89] found id: ""
I0912 22:56:45.855130 57925 logs.go:276] 0 containers: []
W0912 22:56:45.855139 57925 logs.go:278] No container was found matching "etcd"
I0912 22:56:45.855144 57925 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0912 22:56:45.855197 57925 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0912 22:56:45.892831 57925 cri.go:89] found id: ""
I0912 22:56:45.892856 57925 logs.go:276] 0 containers: []
W0912 22:56:45.892863 57925 logs.go:278] No container was found matching "coredns"
I0912 22:56:45.892868 57925 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0912 22:56:45.892914 57925 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0912 22:56:45.932581 57925 cri.go:89] found id: ""
I0912 22:56:45.932610 57925 logs.go:276] 0 containers: []
W0912 22:56:45.932624 57925 logs.go:278] No container was found matching "kube-scheduler"
I0912 22:56:45.932633 57925 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0912 22:56:45.932698 57925 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0912 22:56:45.971246 57925 cri.go:89] found id: ""
I0912 22:56:45.971276 57925 logs.go:276] 0 containers: []
W0912 22:56:45.971287 57925 logs.go:278] No container was found matching "kube-proxy"
I0912 22:56:45.971295 57925 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0912 22:56:45.971356 57925 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0912 22:56:46.006597 57925 cri.go:89] found id: ""
I0912 22:56:46.006627 57925 logs.go:276] 0 containers: []
W0912 22:56:46.006635 57925 logs.go:278] No container was found matching "kube-controller-manager"
I0912 22:56:46.006641 57925 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0912 22:56:46.006698 57925 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0912 22:56:46.043794 57925 cri.go:89] found id: ""
I0912 22:56:46.043825 57925 logs.go:276] 0 containers: []
W0912 22:56:46.043832 57925 logs.go:278] No container was found matching "kindnet"
I0912 22:56:46.043841 57925 logs.go:123] Gathering logs for kubelet ...
I0912 22:56:46.043852 57925 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0912 22:56:46.093930 57925 logs.go:123] Gathering logs for dmesg ...
I0912 22:56:46.093970 57925 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0912 22:56:46.107765 57925 logs.go:123] Gathering logs for describe nodes ...
I0912 22:56:46.107801 57925 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0912 22:56:46.256864 57925 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0912 22:56:46.256891 57925 logs.go:123] Gathering logs for CRI-O ...
I0912 22:56:46.256906 57925 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0912 22:56:46.368035 57925 logs.go:123] Gathering logs for container status ...
I0912 22:56:46.368078 57925 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0912 22:56:46.405168 57925 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0912 22:56:46.405229 57925 out.go:270] *
*
W0912 22:56:46.405282 57925 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0912 22:56:46.405299 57925 out.go:270] *
*
W0912 22:56:46.406526 57925 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0912 22:56:46.409926 57925 out.go:201]
W0912 22:56:46.410997 57925 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0912 22:56:46.411040 57925 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0912 22:56:46.411059 57925 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0912 22:56:46.412336 57925 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-642238 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-642238 -n old-k8s-version-642238
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-642238 -n old-k8s-version-642238: exit status 6 (222.656952ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0912 22:56:46.685541 61555 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-642238" does not appear in /home/jenkins/minikube-integration/19616-5891/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-642238" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (280.44s)