=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-836310 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-836310 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m32.815203192s)
-- stdout --
* [old-k8s-version-836310] minikube v1.36.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20991
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20991-1550299/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20991-1550299/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-836310" primary control-plane node in "old-k8s-version-836310" cluster
* Creating kvm2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0630 15:43:05.857884 1606769 out.go:345] Setting OutFile to fd 1 ...
I0630 15:43:05.858280 1606769 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0630 15:43:05.858295 1606769 out.go:358] Setting ErrFile to fd 2...
I0630 15:43:05.858300 1606769 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0630 15:43:05.858528 1606769 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20991-1550299/.minikube/bin
I0630 15:43:05.859176 1606769 out.go:352] Setting JSON to false
I0630 15:43:05.860456 1606769 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-6","uptime":33878,"bootTime":1751264308,"procs":222,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1083-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0630 15:43:05.860578 1606769 start.go:140] virtualization: kvm guest
I0630 15:43:05.862839 1606769 out.go:177] * [old-k8s-version-836310] minikube v1.36.0 on Ubuntu 20.04 (kvm/amd64)
I0630 15:43:05.864267 1606769 out.go:177] - MINIKUBE_LOCATION=20991
I0630 15:43:05.864322 1606769 notify.go:220] Checking for updates...
I0630 15:43:05.866678 1606769 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0630 15:43:05.868022 1606769 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20991-1550299/kubeconfig
I0630 15:43:05.869185 1606769 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20991-1550299/.minikube
I0630 15:43:05.870619 1606769 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0630 15:43:05.871840 1606769 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0630 15:43:05.873576 1606769 config.go:182] Loaded profile config "cert-expiration-775975": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.33.2
I0630 15:43:05.873722 1606769 config.go:182] Loaded profile config "cert-options-329017": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.33.2
I0630 15:43:05.873856 1606769 config.go:182] Loaded profile config "kubernetes-upgrade-691468": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.33.2
I0630 15:43:05.874008 1606769 driver.go:404] Setting default libvirt URI to qemu:///system
I0630 15:43:05.915329 1606769 out.go:177] * Using the kvm2 driver based on user configuration
I0630 15:43:05.916564 1606769 start.go:304] selected driver: kvm2
I0630 15:43:05.916578 1606769 start.go:908] validating driver "kvm2" against <nil>
I0630 15:43:05.916589 1606769 start.go:919] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0630 15:43:05.917308 1606769 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0630 15:43:05.917430 1606769 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20991-1550299/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0630 15:43:05.935506 1606769 install.go:137] /home/jenkins/minikube-integration/20991-1550299/.minikube/bin/docker-machine-driver-kvm2 version is 1.36.0
I0630 15:43:05.935582 1606769 start_flags.go:325] no existing cluster config was found, will generate one from the flags
I0630 15:43:05.935972 1606769 start_flags.go:990] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0630 15:43:05.936025 1606769 cni.go:84] Creating CNI manager for ""
I0630 15:43:05.936085 1606769 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0630 15:43:05.936094 1606769 start_flags.go:334] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0630 15:43:05.936200 1606769 start.go:347] cluster config:
{Name:old-k8s-version-836310 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.47@sha256:6ed579c9292b4370177b7ef3c42cc4b4a6dcd0735a1814916cbc22c8bf38412b Memory:3072 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-836310 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0630 15:43:05.936327 1606769 iso.go:125] acquiring lock: {Name:mkca1f6a064e2b51449a4c79998fea909ce647ac Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0630 15:43:05.938161 1606769 out.go:177] * Starting "old-k8s-version-836310" primary control-plane node in "old-k8s-version-836310" cluster
I0630 15:43:05.939504 1606769 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0630 15:43:05.939573 1606769 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20991-1550299/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0630 15:43:05.939589 1606769 cache.go:56] Caching tarball of preloaded images
I0630 15:43:05.939727 1606769 preload.go:172] Found /home/jenkins/minikube-integration/20991-1550299/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0630 15:43:05.939742 1606769 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0630 15:43:05.939860 1606769 profile.go:143] Saving config to /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/config.json ...
I0630 15:43:05.939959 1606769 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/config.json: {Name:mk0f52dce51d02462a458f95b1db15d785dd8567 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0630 15:43:05.940165 1606769 start.go:360] acquireMachinesLock for old-k8s-version-836310: {Name:mk94f28e6e139ddc13f15a3e4e4c9e62d9548530 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0630 15:43:05.940208 1606769 start.go:364] duration metric: took 25.737µs to acquireMachinesLock for "old-k8s-version-836310"
I0630 15:43:05.940231 1606769 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-836310 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/20991/minikube-v1.36.0-1751221996-20991-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.47@sha256:6ed579c9292b4370177b7ef3c42cc4b4a6dcd0735a1814916cbc22c8bf38412b Memory:3072 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.
20.0 ClusterName:old-k8s-version-836310 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountTyp
e:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0630 15:43:05.940320 1606769 start.go:125] createHost starting for "" (driver="kvm2")
I0630 15:43:05.942722 1606769 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
I0630 15:43:05.942944 1606769 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/20991-1550299/.minikube/bin/docker-machine-driver-kvm2
I0630 15:43:05.943011 1606769 main.go:141] libmachine: Launching plugin server for driver kvm2
I0630 15:43:05.959785 1606769 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33903
I0630 15:43:05.960296 1606769 main.go:141] libmachine: () Calling .GetVersion
I0630 15:43:05.960967 1606769 main.go:141] libmachine: Using API Version 1
I0630 15:43:05.960994 1606769 main.go:141] libmachine: () Calling .SetConfigRaw
I0630 15:43:05.961472 1606769 main.go:141] libmachine: () Calling .GetMachineName
I0630 15:43:05.961695 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetMachineName
I0630 15:43:05.961897 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .DriverName
I0630 15:43:05.962079 1606769 start.go:159] libmachine.API.Create for "old-k8s-version-836310" (driver="kvm2")
I0630 15:43:05.962113 1606769 client.go:168] LocalClient.Create starting
I0630 15:43:05.962155 1606769 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20991-1550299/.minikube/certs/ca.pem
I0630 15:43:05.962220 1606769 main.go:141] libmachine: Decoding PEM data...
I0630 15:43:05.962257 1606769 main.go:141] libmachine: Parsing certificate...
I0630 15:43:05.962356 1606769 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20991-1550299/.minikube/certs/cert.pem
I0630 15:43:05.962388 1606769 main.go:141] libmachine: Decoding PEM data...
I0630 15:43:05.962408 1606769 main.go:141] libmachine: Parsing certificate...
I0630 15:43:05.962433 1606769 main.go:141] libmachine: Running pre-create checks...
I0630 15:43:05.962453 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .PreCreateCheck
I0630 15:43:05.962852 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetConfigRaw
I0630 15:43:05.963326 1606769 main.go:141] libmachine: Creating machine...
I0630 15:43:05.963341 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .Create
I0630 15:43:05.963527 1606769 main.go:141] libmachine: (old-k8s-version-836310) creating KVM machine...
I0630 15:43:05.963547 1606769 main.go:141] libmachine: (old-k8s-version-836310) creating network...
I0630 15:43:05.965330 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found existing default KVM network
I0630 15:43:05.966641 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:05.966415 1606791 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:bd:bf:63} reservation:<nil>}
I0630 15:43:05.967294 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:05.967197 1606791 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:94:93:42} reservation:<nil>}
I0630 15:43:05.968531 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:05.968456 1606791 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000286d70}
I0630 15:43:05.968583 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | created network xml:
I0630 15:43:05.968610 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | <network>
I0630 15:43:05.968638 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | <name>mk-old-k8s-version-836310</name>
I0630 15:43:05.968653 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | <dns enable='no'/>
I0630 15:43:05.968662 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG |
I0630 15:43:05.968674 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0630 15:43:05.968692 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | <dhcp>
I0630 15:43:05.968701 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0630 15:43:05.968724 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | </dhcp>
I0630 15:43:05.968738 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | </ip>
I0630 15:43:05.968775 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG |
I0630 15:43:05.968799 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | </network>
I0630 15:43:05.968814 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG |
I0630 15:43:05.975079 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | trying to create private KVM network mk-old-k8s-version-836310 192.168.61.0/24...
I0630 15:43:06.064920 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | private KVM network mk-old-k8s-version-836310 192.168.61.0/24 created
I0630 15:43:06.065067 1606769 main.go:141] libmachine: (old-k8s-version-836310) setting up store path in /home/jenkins/minikube-integration/20991-1550299/.minikube/machines/old-k8s-version-836310 ...
I0630 15:43:06.065119 1606769 main.go:141] libmachine: (old-k8s-version-836310) building disk image from file:///home/jenkins/minikube-integration/20991-1550299/.minikube/cache/iso/amd64/minikube-v1.36.0-1751221996-20991-amd64.iso
I0630 15:43:06.065136 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:06.065058 1606791 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20991-1550299/.minikube
I0630 15:43:06.065206 1606769 main.go:141] libmachine: (old-k8s-version-836310) Downloading /home/jenkins/minikube-integration/20991-1550299/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20991-1550299/.minikube/cache/iso/amd64/minikube-v1.36.0-1751221996-20991-amd64.iso...
I0630 15:43:06.407813 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:06.407660 1606791 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20991-1550299/.minikube/machines/old-k8s-version-836310/id_rsa...
I0630 15:43:07.067323 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:07.067168 1606791 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20991-1550299/.minikube/machines/old-k8s-version-836310/old-k8s-version-836310.rawdisk...
I0630 15:43:07.067384 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | Writing magic tar header
I0630 15:43:07.067405 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | Writing SSH key tar header
I0630 15:43:07.067418 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:07.067331 1606791 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20991-1550299/.minikube/machines/old-k8s-version-836310 ...
I0630 15:43:07.067535 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20991-1550299/.minikube/machines/old-k8s-version-836310
I0630 15:43:07.067568 1606769 main.go:141] libmachine: (old-k8s-version-836310) setting executable bit set on /home/jenkins/minikube-integration/20991-1550299/.minikube/machines/old-k8s-version-836310 (perms=drwx------)
I0630 15:43:07.067580 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20991-1550299/.minikube/machines
I0630 15:43:07.067600 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20991-1550299/.minikube
I0630 15:43:07.067616 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20991-1550299
I0630 15:43:07.067627 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0630 15:43:07.067635 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | checking permissions on dir: /home/jenkins
I0630 15:43:07.067654 1606769 main.go:141] libmachine: (old-k8s-version-836310) setting executable bit set on /home/jenkins/minikube-integration/20991-1550299/.minikube/machines (perms=drwxr-xr-x)
I0630 15:43:07.067667 1606769 main.go:141] libmachine: (old-k8s-version-836310) setting executable bit set on /home/jenkins/minikube-integration/20991-1550299/.minikube (perms=drwxr-xr-x)
I0630 15:43:07.067675 1606769 main.go:141] libmachine: (old-k8s-version-836310) setting executable bit set on /home/jenkins/minikube-integration/20991-1550299 (perms=drwxrwxr-x)
I0630 15:43:07.067688 1606769 main.go:141] libmachine: (old-k8s-version-836310) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0630 15:43:07.067720 1606769 main.go:141] libmachine: (old-k8s-version-836310) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0630 15:43:07.067732 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | checking permissions on dir: /home
I0630 15:43:07.067745 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | skipping /home - not owner
I0630 15:43:07.067758 1606769 main.go:141] libmachine: (old-k8s-version-836310) creating domain...
I0630 15:43:07.068871 1606769 main.go:141] libmachine: (old-k8s-version-836310) define libvirt domain using xml:
I0630 15:43:07.068893 1606769 main.go:141] libmachine: (old-k8s-version-836310) <domain type='kvm'>
I0630 15:43:07.068903 1606769 main.go:141] libmachine: (old-k8s-version-836310) <name>old-k8s-version-836310</name>
I0630 15:43:07.068910 1606769 main.go:141] libmachine: (old-k8s-version-836310) <memory unit='MiB'>3072</memory>
I0630 15:43:07.068919 1606769 main.go:141] libmachine: (old-k8s-version-836310) <vcpu>2</vcpu>
I0630 15:43:07.068925 1606769 main.go:141] libmachine: (old-k8s-version-836310) <features>
I0630 15:43:07.068935 1606769 main.go:141] libmachine: (old-k8s-version-836310) <acpi/>
I0630 15:43:07.068945 1606769 main.go:141] libmachine: (old-k8s-version-836310) <apic/>
I0630 15:43:07.068952 1606769 main.go:141] libmachine: (old-k8s-version-836310) <pae/>
I0630 15:43:07.068960 1606769 main.go:141] libmachine: (old-k8s-version-836310)
I0630 15:43:07.068987 1606769 main.go:141] libmachine: (old-k8s-version-836310) </features>
I0630 15:43:07.069021 1606769 main.go:141] libmachine: (old-k8s-version-836310) <cpu mode='host-passthrough'>
I0630 15:43:07.069030 1606769 main.go:141] libmachine: (old-k8s-version-836310)
I0630 15:43:07.069037 1606769 main.go:141] libmachine: (old-k8s-version-836310) </cpu>
I0630 15:43:07.069046 1606769 main.go:141] libmachine: (old-k8s-version-836310) <os>
I0630 15:43:07.069057 1606769 main.go:141] libmachine: (old-k8s-version-836310) <type>hvm</type>
I0630 15:43:07.069066 1606769 main.go:141] libmachine: (old-k8s-version-836310) <boot dev='cdrom'/>
I0630 15:43:07.069076 1606769 main.go:141] libmachine: (old-k8s-version-836310) <boot dev='hd'/>
I0630 15:43:07.069115 1606769 main.go:141] libmachine: (old-k8s-version-836310) <bootmenu enable='no'/>
I0630 15:43:07.069134 1606769 main.go:141] libmachine: (old-k8s-version-836310) </os>
I0630 15:43:07.069143 1606769 main.go:141] libmachine: (old-k8s-version-836310) <devices>
I0630 15:43:07.069150 1606769 main.go:141] libmachine: (old-k8s-version-836310) <disk type='file' device='cdrom'>
I0630 15:43:07.069160 1606769 main.go:141] libmachine: (old-k8s-version-836310) <source file='/home/jenkins/minikube-integration/20991-1550299/.minikube/machines/old-k8s-version-836310/boot2docker.iso'/>
I0630 15:43:07.069166 1606769 main.go:141] libmachine: (old-k8s-version-836310) <target dev='hdc' bus='scsi'/>
I0630 15:43:07.069171 1606769 main.go:141] libmachine: (old-k8s-version-836310) <readonly/>
I0630 15:43:07.069178 1606769 main.go:141] libmachine: (old-k8s-version-836310) </disk>
I0630 15:43:07.069183 1606769 main.go:141] libmachine: (old-k8s-version-836310) <disk type='file' device='disk'>
I0630 15:43:07.069189 1606769 main.go:141] libmachine: (old-k8s-version-836310) <driver name='qemu' type='raw' cache='default' io='threads' />
I0630 15:43:07.069199 1606769 main.go:141] libmachine: (old-k8s-version-836310) <source file='/home/jenkins/minikube-integration/20991-1550299/.minikube/machines/old-k8s-version-836310/old-k8s-version-836310.rawdisk'/>
I0630 15:43:07.069210 1606769 main.go:141] libmachine: (old-k8s-version-836310) <target dev='hda' bus='virtio'/>
I0630 15:43:07.069222 1606769 main.go:141] libmachine: (old-k8s-version-836310) </disk>
I0630 15:43:07.069230 1606769 main.go:141] libmachine: (old-k8s-version-836310) <interface type='network'>
I0630 15:43:07.069241 1606769 main.go:141] libmachine: (old-k8s-version-836310) <source network='mk-old-k8s-version-836310'/>
I0630 15:43:07.069252 1606769 main.go:141] libmachine: (old-k8s-version-836310) <model type='virtio'/>
I0630 15:43:07.069272 1606769 main.go:141] libmachine: (old-k8s-version-836310) </interface>
I0630 15:43:07.069287 1606769 main.go:141] libmachine: (old-k8s-version-836310) <interface type='network'>
I0630 15:43:07.069293 1606769 main.go:141] libmachine: (old-k8s-version-836310) <source network='default'/>
I0630 15:43:07.069300 1606769 main.go:141] libmachine: (old-k8s-version-836310) <model type='virtio'/>
I0630 15:43:07.069305 1606769 main.go:141] libmachine: (old-k8s-version-836310) </interface>
I0630 15:43:07.069311 1606769 main.go:141] libmachine: (old-k8s-version-836310) <serial type='pty'>
I0630 15:43:07.069320 1606769 main.go:141] libmachine: (old-k8s-version-836310) <target port='0'/>
I0630 15:43:07.069331 1606769 main.go:141] libmachine: (old-k8s-version-836310) </serial>
I0630 15:43:07.069339 1606769 main.go:141] libmachine: (old-k8s-version-836310) <console type='pty'>
I0630 15:43:07.069351 1606769 main.go:141] libmachine: (old-k8s-version-836310) <target type='serial' port='0'/>
I0630 15:43:07.069383 1606769 main.go:141] libmachine: (old-k8s-version-836310) </console>
I0630 15:43:07.069425 1606769 main.go:141] libmachine: (old-k8s-version-836310) <rng model='virtio'>
I0630 15:43:07.069438 1606769 main.go:141] libmachine: (old-k8s-version-836310) <backend model='random'>/dev/random</backend>
I0630 15:43:07.069466 1606769 main.go:141] libmachine: (old-k8s-version-836310) </rng>
I0630 15:43:07.069477 1606769 main.go:141] libmachine: (old-k8s-version-836310)
I0630 15:43:07.069490 1606769 main.go:141] libmachine: (old-k8s-version-836310)
I0630 15:43:07.069501 1606769 main.go:141] libmachine: (old-k8s-version-836310) </devices>
I0630 15:43:07.069508 1606769 main.go:141] libmachine: (old-k8s-version-836310) </domain>
I0630 15:43:07.069521 1606769 main.go:141] libmachine: (old-k8s-version-836310)
I0630 15:43:07.073950 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:6b:ef:87 in network default
I0630 15:43:07.074530 1606769 main.go:141] libmachine: (old-k8s-version-836310) starting domain...
I0630 15:43:07.074550 1606769 main.go:141] libmachine: (old-k8s-version-836310) ensuring networks are active...
I0630 15:43:07.074558 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:07.075277 1606769 main.go:141] libmachine: (old-k8s-version-836310) Ensuring network default is active
I0630 15:43:07.075694 1606769 main.go:141] libmachine: (old-k8s-version-836310) Ensuring network mk-old-k8s-version-836310 is active
I0630 15:43:07.076294 1606769 main.go:141] libmachine: (old-k8s-version-836310) getting domain XML...
I0630 15:43:07.077257 1606769 main.go:141] libmachine: (old-k8s-version-836310) creating domain...
I0630 15:43:08.494823 1606769 main.go:141] libmachine: (old-k8s-version-836310) waiting for IP...
I0630 15:43:08.495763 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:08.496368 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | unable to find current IP address of domain old-k8s-version-836310 in network mk-old-k8s-version-836310
I0630 15:43:08.496424 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:08.496349 1606791 retry.go:31] will retry after 198.333347ms: waiting for domain to come up
I0630 15:43:08.696875 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:08.697474 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | unable to find current IP address of domain old-k8s-version-836310 in network mk-old-k8s-version-836310
I0630 15:43:08.697532 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:08.697463 1606791 retry.go:31] will retry after 362.910081ms: waiting for domain to come up
I0630 15:43:09.062249 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:09.062843 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | unable to find current IP address of domain old-k8s-version-836310 in network mk-old-k8s-version-836310
I0630 15:43:09.062903 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:09.062807 1606791 retry.go:31] will retry after 395.24864ms: waiting for domain to come up
I0630 15:43:09.459462 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:09.460099 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | unable to find current IP address of domain old-k8s-version-836310 in network mk-old-k8s-version-836310
I0630 15:43:09.460128 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:09.460041 1606791 retry.go:31] will retry after 500.939994ms: waiting for domain to come up
I0630 15:43:09.963317 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:09.963945 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | unable to find current IP address of domain old-k8s-version-836310 in network mk-old-k8s-version-836310
I0630 15:43:09.963985 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:09.963879 1606791 retry.go:31] will retry after 629.979979ms: waiting for domain to come up
I0630 15:43:10.595604 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:10.596047 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | unable to find current IP address of domain old-k8s-version-836310 in network mk-old-k8s-version-836310
I0630 15:43:10.596076 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:10.596008 1606791 retry.go:31] will retry after 776.908347ms: waiting for domain to come up
I0630 15:43:11.374818 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:11.375406 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | unable to find current IP address of domain old-k8s-version-836310 in network mk-old-k8s-version-836310
I0630 15:43:11.375433 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:11.375381 1606791 retry.go:31] will retry after 1.062262318s: waiting for domain to come up
I0630 15:43:12.439890 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:12.440837 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | unable to find current IP address of domain old-k8s-version-836310 in network mk-old-k8s-version-836310
I0630 15:43:12.440868 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:12.440809 1606791 retry.go:31] will retry after 934.442012ms: waiting for domain to come up
I0630 15:43:13.377218 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:13.377833 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | unable to find current IP address of domain old-k8s-version-836310 in network mk-old-k8s-version-836310
I0630 15:43:13.377926 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:13.377841 1606791 retry.go:31] will retry after 1.383485531s: waiting for domain to come up
I0630 15:43:14.762724 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:14.763428 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | unable to find current IP address of domain old-k8s-version-836310 in network mk-old-k8s-version-836310
I0630 15:43:14.763472 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:14.763400 1606791 retry.go:31] will retry after 2.063726231s: waiting for domain to come up
I0630 15:43:16.829672 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:16.830349 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | unable to find current IP address of domain old-k8s-version-836310 in network mk-old-k8s-version-836310
I0630 15:43:16.830372 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:16.830258 1606791 retry.go:31] will retry after 1.939367083s: waiting for domain to come up
I0630 15:43:18.772504 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:18.773128 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | unable to find current IP address of domain old-k8s-version-836310 in network mk-old-k8s-version-836310
I0630 15:43:18.773158 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:18.773077 1606791 retry.go:31] will retry after 2.327621357s: waiting for domain to come up
I0630 15:43:21.102553 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:21.103146 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | unable to find current IP address of domain old-k8s-version-836310 in network mk-old-k8s-version-836310
I0630 15:43:21.103171 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:21.103110 1606791 retry.go:31] will retry after 3.90700663s: waiting for domain to come up
I0630 15:43:25.014358 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:25.014841 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | unable to find current IP address of domain old-k8s-version-836310 in network mk-old-k8s-version-836310
I0630 15:43:25.014901 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | I0630 15:43:25.014822 1606791 retry.go:31] will retry after 4.834626086s: waiting for domain to come up
I0630 15:43:29.853849 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:29.882451 1606769 main.go:141] libmachine: (old-k8s-version-836310) found domain IP: 192.168.61.88
I0630 15:43:29.882492 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has current primary IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:29.882501 1606769 main.go:141] libmachine: (old-k8s-version-836310) reserving static IP address...
I0630 15:43:29.883040 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-836310", mac: "52:54:00:5d:f3:de", ip: "192.168.61.88"} in network mk-old-k8s-version-836310
I0630 15:43:30.257307 1606769 main.go:141] libmachine: (old-k8s-version-836310) reserved static IP address 192.168.61.88 for domain old-k8s-version-836310
I0630 15:43:30.257344 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | Getting to WaitForSSH function...
I0630 15:43:30.257353 1606769 main.go:141] libmachine: (old-k8s-version-836310) waiting for SSH...
I0630 15:43:30.260446 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:30.260862 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:30.260897 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:30.261071 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | Using SSH client type: external
I0630 15:43:30.261098 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | Using SSH private key: /home/jenkins/minikube-integration/20991-1550299/.minikube/machines/old-k8s-version-836310/id_rsa (-rw-------)
I0630 15:43:30.261148 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.88 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20991-1550299/.minikube/machines/old-k8s-version-836310/id_rsa -p 22] /usr/bin/ssh <nil>}
I0630 15:43:30.261160 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | About to run SSH command:
I0630 15:43:30.261174 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | exit 0
I0630 15:43:30.393785 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | SSH cmd err, output: <nil>:
I0630 15:43:30.394114 1606769 main.go:141] libmachine: (old-k8s-version-836310) KVM machine creation complete
I0630 15:43:30.394425 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetConfigRaw
I0630 15:43:30.394995 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .DriverName
I0630 15:43:30.395277 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .DriverName
I0630 15:43:30.395468 1606769 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0630 15:43:30.395482 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetState
I0630 15:43:30.396897 1606769 main.go:141] libmachine: Detecting operating system of created instance...
I0630 15:43:30.396916 1606769 main.go:141] libmachine: Waiting for SSH to be available...
I0630 15:43:30.396923 1606769 main.go:141] libmachine: Getting to WaitForSSH function...
I0630 15:43:30.396933 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHHostname
I0630 15:43:30.399845 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:30.400256 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:30.400296 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:30.400560 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHPort
I0630 15:43:30.400779 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHKeyPath
I0630 15:43:30.400982 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHKeyPath
I0630 15:43:30.401290 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHUsername
I0630 15:43:30.401612 1606769 main.go:141] libmachine: Using SSH client type: native
I0630 15:43:30.401884 1606769 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83bb20] 0x83e820 <nil> [] 0s} 192.168.61.88 22 <nil> <nil>}
I0630 15:43:30.401900 1606769 main.go:141] libmachine: About to run SSH command:
exit 0
I0630 15:43:30.516801 1606769 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0630 15:43:30.516831 1606769 main.go:141] libmachine: Detecting the provisioner...
I0630 15:43:30.516843 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHHostname
I0630 15:43:30.520484 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:30.520801 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:30.520834 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:30.521060 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHPort
I0630 15:43:30.521326 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHKeyPath
I0630 15:43:30.521527 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHKeyPath
I0630 15:43:30.521684 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHUsername
I0630 15:43:30.521839 1606769 main.go:141] libmachine: Using SSH client type: native
I0630 15:43:30.522094 1606769 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83bb20] 0x83e820 <nil> [] 0s} 192.168.61.88 22 <nil> <nil>}
I0630 15:43:30.522113 1606769 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0630 15:43:30.638535 1606769 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2025.02-dirty
ID=buildroot
VERSION_ID=2025.02
PRETTY_NAME="Buildroot 2025.02"
I0630 15:43:30.638644 1606769 main.go:141] libmachine: found compatible host: buildroot
I0630 15:43:30.638658 1606769 main.go:141] libmachine: Provisioning with buildroot...
I0630 15:43:30.638669 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetMachineName
I0630 15:43:30.638973 1606769 buildroot.go:166] provisioning hostname "old-k8s-version-836310"
I0630 15:43:30.639014 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetMachineName
I0630 15:43:30.639256 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHHostname
I0630 15:43:30.642108 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:30.642521 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:30.642548 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:30.642840 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHPort
I0630 15:43:30.643046 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHKeyPath
I0630 15:43:30.643300 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHKeyPath
I0630 15:43:30.643449 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHUsername
I0630 15:43:30.643640 1606769 main.go:141] libmachine: Using SSH client type: native
I0630 15:43:30.643964 1606769 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83bb20] 0x83e820 <nil> [] 0s} 192.168.61.88 22 <nil> <nil>}
I0630 15:43:30.643983 1606769 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-836310 && echo "old-k8s-version-836310" | sudo tee /etc/hostname
I0630 15:43:30.774729 1606769 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-836310
I0630 15:43:30.774761 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHHostname
I0630 15:43:30.778697 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:30.779150 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:30.779177 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:30.779313 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHPort
I0630 15:43:30.779524 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHKeyPath
I0630 15:43:30.779742 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHKeyPath
I0630 15:43:30.779945 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHUsername
I0630 15:43:30.780132 1606769 main.go:141] libmachine: Using SSH client type: native
I0630 15:43:30.780345 1606769 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83bb20] 0x83e820 <nil> [] 0s} 192.168.61.88 22 <nil> <nil>}
I0630 15:43:30.780360 1606769 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-836310' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-836310/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-836310' | sudo tee -a /etc/hosts;
fi
fi
I0630 15:43:30.904031 1606769 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0630 15:43:30.904263 1606769 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20991-1550299/.minikube CaCertPath:/home/jenkins/minikube-integration/20991-1550299/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20991-1550299/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20991-1550299/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20991-1550299/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20991-1550299/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20991-1550299/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20991-1550299/.minikube}
I0630 15:43:30.904299 1606769 buildroot.go:174] setting up certificates
I0630 15:43:30.904316 1606769 provision.go:84] configureAuth start
I0630 15:43:30.904353 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetMachineName
I0630 15:43:30.904675 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetIP
I0630 15:43:30.908113 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:30.908539 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:30.908569 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:30.908835 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHHostname
I0630 15:43:30.912143 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:30.912534 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:30.912555 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:30.912801 1606769 provision.go:143] copyHostCerts
I0630 15:43:30.912870 1606769 exec_runner.go:144] found /home/jenkins/minikube-integration/20991-1550299/.minikube/key.pem, removing ...
I0630 15:43:30.912893 1606769 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20991-1550299/.minikube/key.pem
I0630 15:43:30.912984 1606769 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20991-1550299/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20991-1550299/.minikube/key.pem (1675 bytes)
I0630 15:43:30.913107 1606769 exec_runner.go:144] found /home/jenkins/minikube-integration/20991-1550299/.minikube/ca.pem, removing ...
I0630 15:43:30.913123 1606769 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20991-1550299/.minikube/ca.pem
I0630 15:43:30.913169 1606769 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20991-1550299/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20991-1550299/.minikube/ca.pem (1078 bytes)
I0630 15:43:30.913277 1606769 exec_runner.go:144] found /home/jenkins/minikube-integration/20991-1550299/.minikube/cert.pem, removing ...
I0630 15:43:30.913288 1606769 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20991-1550299/.minikube/cert.pem
I0630 15:43:30.913337 1606769 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20991-1550299/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20991-1550299/.minikube/cert.pem (1123 bytes)
I0630 15:43:30.913434 1606769 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20991-1550299/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20991-1550299/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20991-1550299/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-836310 san=[127.0.0.1 192.168.61.88 localhost minikube old-k8s-version-836310]
I0630 15:43:31.467570 1606769 provision.go:177] copyRemoteCerts
I0630 15:43:31.467634 1606769 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0630 15:43:31.467669 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHHostname
I0630 15:43:31.470892 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:31.471465 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:31.471500 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:31.471676 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHPort
I0630 15:43:31.471915 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHKeyPath
I0630 15:43:31.472252 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHUsername
I0630 15:43:31.472471 1606769 sshutil.go:53] new ssh client: &{IP:192.168.61.88 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20991-1550299/.minikube/machines/old-k8s-version-836310/id_rsa Username:docker}
I0630 15:43:31.561634 1606769 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20991-1550299/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0630 15:43:31.594489 1606769 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20991-1550299/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0630 15:43:31.627547 1606769 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20991-1550299/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0630 15:43:31.659888 1606769 provision.go:87] duration metric: took 755.549776ms to configureAuth
I0630 15:43:31.659946 1606769 buildroot.go:189] setting minikube options for container-runtime
I0630 15:43:31.660243 1606769 config.go:182] Loaded profile config "old-k8s-version-836310": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0630 15:43:31.660347 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHHostname
I0630 15:43:31.663824 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:31.664242 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:31.664277 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:31.664463 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHPort
I0630 15:43:31.664688 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHKeyPath
I0630 15:43:31.664881 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHKeyPath
I0630 15:43:31.665039 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHUsername
I0630 15:43:31.665389 1606769 main.go:141] libmachine: Using SSH client type: native
I0630 15:43:31.665722 1606769 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83bb20] 0x83e820 <nil> [] 0s} 192.168.61.88 22 <nil> <nil>}
I0630 15:43:31.665748 1606769 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0630 15:43:31.901642 1606769 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0630 15:43:31.901681 1606769 main.go:141] libmachine: Checking connection to Docker...
I0630 15:43:31.901691 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetURL
I0630 15:43:31.903200 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | using libvirt version 6000000
I0630 15:43:31.906629 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:31.907016 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:31.907077 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:31.907349 1606769 main.go:141] libmachine: Docker is up and running!
I0630 15:43:31.907370 1606769 main.go:141] libmachine: Reticulating splines...
I0630 15:43:31.907391 1606769 client.go:171] duration metric: took 25.945253817s to LocalClient.Create
I0630 15:43:31.907418 1606769 start.go:167] duration metric: took 25.94534242s to libmachine.API.Create "old-k8s-version-836310"
I0630 15:43:31.907430 1606769 start.go:293] postStartSetup for "old-k8s-version-836310" (driver="kvm2")
I0630 15:43:31.907463 1606769 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0630 15:43:31.907486 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .DriverName
I0630 15:43:31.907796 1606769 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0630 15:43:31.907901 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHHostname
I0630 15:43:31.911734 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:31.912180 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:31.912211 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:31.912362 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHPort
I0630 15:43:31.912548 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHKeyPath
I0630 15:43:31.912783 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHUsername
I0630 15:43:31.912982 1606769 sshutil.go:53] new ssh client: &{IP:192.168.61.88 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20991-1550299/.minikube/machines/old-k8s-version-836310/id_rsa Username:docker}
I0630 15:43:32.001821 1606769 ssh_runner.go:195] Run: cat /etc/os-release
I0630 15:43:32.006618 1606769 info.go:137] Remote host: Buildroot 2025.02
I0630 15:43:32.006648 1606769 filesync.go:126] Scanning /home/jenkins/minikube-integration/20991-1550299/.minikube/addons for local assets ...
I0630 15:43:32.006720 1606769 filesync.go:126] Scanning /home/jenkins/minikube-integration/20991-1550299/.minikube/files for local assets ...
I0630 15:43:32.006798 1606769 filesync.go:149] local asset: /home/jenkins/minikube-integration/20991-1550299/.minikube/files/etc/ssl/certs/15577322.pem -> 15577322.pem in /etc/ssl/certs
I0630 15:43:32.006901 1606769 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0630 15:43:32.018643 1606769 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20991-1550299/.minikube/files/etc/ssl/certs/15577322.pem --> /etc/ssl/certs/15577322.pem (1708 bytes)
I0630 15:43:32.046455 1606769 start.go:296] duration metric: took 138.987145ms for postStartSetup
I0630 15:43:32.046521 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetConfigRaw
I0630 15:43:32.047176 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetIP
I0630 15:43:32.050141 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:32.050473 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:32.050500 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:32.050772 1606769 profile.go:143] Saving config to /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/config.json ...
I0630 15:43:32.050962 1606769 start.go:128] duration metric: took 26.110630131s to createHost
I0630 15:43:32.050987 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHHostname
I0630 15:43:32.053081 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:32.053458 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:32.053482 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:32.053665 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHPort
I0630 15:43:32.053913 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHKeyPath
I0630 15:43:32.054124 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHKeyPath
I0630 15:43:32.054395 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHUsername
I0630 15:43:32.054693 1606769 main.go:141] libmachine: Using SSH client type: native
I0630 15:43:32.054909 1606769 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x83bb20] 0x83e820 <nil> [] 0s} 192.168.61.88 22 <nil> <nil>}
I0630 15:43:32.054919 1606769 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0630 15:43:32.172667 1606769 main.go:141] libmachine: SSH cmd err, output: <nil>: 1751298212.148035227
I0630 15:43:32.172693 1606769 fix.go:216] guest clock: 1751298212.148035227
I0630 15:43:32.172703 1606769 fix.go:229] Guest: 2025-06-30 15:43:32.148035227 +0000 UTC Remote: 2025-06-30 15:43:32.050975529 +0000 UTC m=+26.242236458 (delta=97.059698ms)
I0630 15:43:32.172731 1606769 fix.go:200] guest clock delta is within tolerance: 97.059698ms
I0630 15:43:32.172737 1606769 start.go:83] releasing machines lock for "old-k8s-version-836310", held for 26.232520659s
I0630 15:43:32.172772 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .DriverName
I0630 15:43:32.173179 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetIP
I0630 15:43:32.176375 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:32.176732 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:32.176761 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:32.176987 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .DriverName
I0630 15:43:32.177673 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .DriverName
I0630 15:43:32.177920 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .DriverName
I0630 15:43:32.178015 1606769 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0630 15:43:32.178064 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHHostname
I0630 15:43:32.178164 1606769 ssh_runner.go:195] Run: cat /version.json
I0630 15:43:32.178183 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHHostname
I0630 15:43:32.181002 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:32.181511 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:32.181535 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:32.181957 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHPort
I0630 15:43:32.182485 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHKeyPath
I0630 15:43:32.182719 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHUsername
I0630 15:43:32.182913 1606769 sshutil.go:53] new ssh client: &{IP:192.168.61.88 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20991-1550299/.minikube/machines/old-k8s-version-836310/id_rsa Username:docker}
I0630 15:43:32.184326 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:32.184798 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:32.184828 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:32.185063 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHPort
I0630 15:43:32.185242 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHKeyPath
I0630 15:43:32.185477 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetSSHUsername
I0630 15:43:32.185648 1606769 sshutil.go:53] new ssh client: &{IP:192.168.61.88 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20991-1550299/.minikube/machines/old-k8s-version-836310/id_rsa Username:docker}
I0630 15:43:32.302765 1606769 ssh_runner.go:195] Run: systemctl --version
I0630 15:43:32.309356 1606769 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0630 15:43:32.474070 1606769 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0630 15:43:32.480541 1606769 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0630 15:43:32.480608 1606769 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0630 15:43:32.499842 1606769 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0630 15:43:32.499875 1606769 start.go:495] detecting cgroup driver to use...
I0630 15:43:32.499973 1606769 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0630 15:43:32.518984 1606769 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0630 15:43:32.535833 1606769 docker.go:230] disabling cri-docker service (if available) ...
I0630 15:43:32.535912 1606769 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0630 15:43:32.551757 1606769 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0630 15:43:32.568087 1606769 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0630 15:43:32.709741 1606769 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0630 15:43:32.865344 1606769 docker.go:246] disabling docker service ...
I0630 15:43:32.865465 1606769 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0630 15:43:32.881555 1606769 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0630 15:43:32.897659 1606769 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0630 15:43:33.099297 1606769 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0630 15:43:33.239031 1606769 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0630 15:43:33.254240 1606769 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0630 15:43:33.278180 1606769 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0630 15:43:33.278246 1606769 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0630 15:43:33.290026 1606769 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0630 15:43:33.290105 1606769 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0630 15:43:33.303601 1606769 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0630 15:43:33.315971 1606769 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0630 15:43:33.328394 1606769 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0630 15:43:33.341128 1606769 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0630 15:43:33.353461 1606769 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 1
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0630 15:43:33.353548 1606769 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0630 15:43:33.368213 1606769 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0630 15:43:33.379369 1606769 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0630 15:43:33.535823 1606769 ssh_runner.go:195] Run: sudo systemctl restart crio
I0630 15:43:33.654671 1606769 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0630 15:43:33.654754 1606769 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0630 15:43:33.660436 1606769 start.go:563] Will wait 60s for crictl version
I0630 15:43:33.660498 1606769 ssh_runner.go:195] Run: which crictl
I0630 15:43:33.666154 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0630 15:43:33.714470 1606769 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0630 15:43:33.714556 1606769 ssh_runner.go:195] Run: crio --version
I0630 15:43:33.747822 1606769 ssh_runner.go:195] Run: crio --version
I0630 15:43:33.784005 1606769 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0630 15:43:33.785451 1606769 main.go:141] libmachine: (old-k8s-version-836310) Calling .GetIP
I0630 15:43:33.789320 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:33.789706 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:5d:f3:de", ip: ""} in network mk-old-k8s-version-836310: {Iface:virbr3 ExpiryTime:2025-06-30 16:43:22 +0000 UTC Type:0 Mac:52:54:00:5d:f3:de Iaid: IPaddr:192.168.61.88 Prefix:24 Hostname:old-k8s-version-836310 Clientid:01:52:54:00:5d:f3:de}
I0630 15:43:33.789737 1606769 main.go:141] libmachine: (old-k8s-version-836310) DBG | domain old-k8s-version-836310 has defined IP address 192.168.61.88 and MAC address 52:54:00:5d:f3:de in network mk-old-k8s-version-836310
I0630 15:43:33.789993 1606769 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0630 15:43:33.794519 1606769 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0630 15:43:33.809019 1606769 kubeadm.go:875] updating cluster {Name:old-k8s-version-836310 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/20991/minikube-v1.36.0-1751221996-20991-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.47@sha256:6ed579c9292b4370177b7ef3c42cc4b4a6dcd0735a1814916cbc22c8bf38412b Memory:3072 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:ol
d-k8s-version-836310 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.88 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p M
ountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0630 15:43:33.809145 1606769 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0630 15:43:33.809206 1606769 ssh_runner.go:195] Run: sudo crictl images --output json
I0630 15:43:33.844604 1606769 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0630 15:43:33.844672 1606769 ssh_runner.go:195] Run: which lz4
I0630 15:43:33.850511 1606769 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0630 15:43:33.856193 1606769 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0630 15:43:33.856238 1606769 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20991-1550299/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0630 15:43:35.649534 1606769 crio.go:462] duration metric: took 1.799067288s to copy over tarball
I0630 15:43:35.649619 1606769 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0630 15:43:37.871919 1606769 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.222267116s)
I0630 15:43:37.871949 1606769 crio.go:469] duration metric: took 2.222381334s to extract the tarball
I0630 15:43:37.871959 1606769 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0630 15:43:37.914121 1606769 ssh_runner.go:195] Run: sudo crictl images --output json
I0630 15:43:37.958392 1606769 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0630 15:43:37.958424 1606769 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0630 15:43:37.958532 1606769 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0630 15:43:37.958579 1606769 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0630 15:43:37.958594 1606769 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0630 15:43:37.958517 1606769 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0630 15:43:37.958628 1606769 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0630 15:43:37.958532 1606769 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0630 15:43:37.958556 1606769 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0630 15:43:37.958770 1606769 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0630 15:43:37.960423 1606769 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0630 15:43:37.960444 1606769 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0630 15:43:37.960452 1606769 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0630 15:43:37.960459 1606769 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0630 15:43:37.960426 1606769 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0630 15:43:37.960525 1606769 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0630 15:43:37.960530 1606769 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0630 15:43:37.960840 1606769 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0630 15:43:38.189531 1606769 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0630 15:43:38.224070 1606769 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0630 15:43:38.226478 1606769 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0630 15:43:38.231161 1606769 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0630 15:43:38.238984 1606769 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0630 15:43:38.251032 1606769 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0630 15:43:38.251078 1606769 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0630 15:43:38.251131 1606769 ssh_runner.go:195] Run: which crictl
I0630 15:43:38.252277 1606769 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0630 15:43:38.275392 1606769 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0630 15:43:38.361554 1606769 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0630 15:43:38.361610 1606769 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0630 15:43:38.361663 1606769 ssh_runner.go:195] Run: which crictl
I0630 15:43:38.379800 1606769 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0630 15:43:38.379854 1606769 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0630 15:43:38.379913 1606769 ssh_runner.go:195] Run: which crictl
I0630 15:43:38.388445 1606769 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0630 15:43:38.388529 1606769 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0630 15:43:38.388614 1606769 ssh_runner.go:195] Run: which crictl
I0630 15:43:38.405851 1606769 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0630 15:43:38.405907 1606769 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0630 15:43:38.405956 1606769 ssh_runner.go:195] Run: which crictl
I0630 15:43:38.405964 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0630 15:43:38.428101 1606769 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0630 15:43:38.428150 1606769 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0630 15:43:38.428200 1606769 ssh_runner.go:195] Run: which crictl
I0630 15:43:38.432653 1606769 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0630 15:43:38.432709 1606769 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0630 15:43:38.432733 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0630 15:43:38.432757 1606769 ssh_runner.go:195] Run: which crictl
I0630 15:43:38.432790 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0630 15:43:38.432905 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0630 15:43:38.468414 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0630 15:43:38.468471 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0630 15:43:38.468527 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0630 15:43:38.468588 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0630 15:43:38.542529 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0630 15:43:38.554867 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0630 15:43:38.554948 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0630 15:43:38.686834 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0630 15:43:38.686880 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0630 15:43:38.686834 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0630 15:43:38.686919 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0630 15:43:38.708387 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0630 15:43:38.708459 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0630 15:43:38.722736 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0630 15:43:38.855199 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0630 15:43:38.855239 1606769 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20991-1550299/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0630 15:43:38.855309 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0630 15:43:38.855335 1606769 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0630 15:43:38.868169 1606769 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20991-1550299/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0630 15:43:38.880473 1606769 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20991-1550299/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0630 15:43:38.892459 1606769 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20991-1550299/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0630 15:43:38.956024 1606769 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20991-1550299/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0630 15:43:38.956098 1606769 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20991-1550299/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0630 15:43:38.956110 1606769 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20991-1550299/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0630 15:43:39.275711 1606769 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0630 15:43:39.425843 1606769 cache_images.go:92] duration metric: took 1.467392045s to LoadCachedImages
W0630 15:43:39.425979 1606769 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20991-1550299/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20991-1550299/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0630 15:43:39.426003 1606769 kubeadm.go:926] updating node { 192.168.61.88 8443 v1.20.0 crio true true} ...
I0630 15:43:39.426210 1606769 kubeadm.go:938] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-836310 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.88
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-836310 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0630 15:43:39.426304 1606769 ssh_runner.go:195] Run: crio config
I0630 15:43:39.488387 1606769 cni.go:84] Creating CNI manager for ""
I0630 15:43:39.488419 1606769 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0630 15:43:39.488428 1606769 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0630 15:43:39.488448 1606769 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.88 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-836310 NodeName:old-k8s-version-836310 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.88"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.88 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0630 15:43:39.488648 1606769 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.88
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-836310"
kubeletExtraArgs:
node-ip: 192.168.61.88
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.88"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0630 15:43:39.488737 1606769 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0630 15:43:39.500827 1606769 binaries.go:44] Found k8s binaries, skipping transfer
I0630 15:43:39.500912 1606769 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0630 15:43:39.512946 1606769 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0630 15:43:39.535390 1606769 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0630 15:43:39.557997 1606769 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0630 15:43:39.580582 1606769 ssh_runner.go:195] Run: grep 192.168.61.88 control-plane.minikube.internal$ /etc/hosts
I0630 15:43:39.584959 1606769 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.88 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0630 15:43:39.599578 1606769 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0630 15:43:39.756567 1606769 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0630 15:43:39.787752 1606769 certs.go:68] Setting up /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310 for IP: 192.168.61.88
I0630 15:43:39.787788 1606769 certs.go:194] generating shared ca certs ...
I0630 15:43:39.787814 1606769 certs.go:226] acquiring lock for ca certs: {Name:mk773029d2b53ceb6ec3c9684abd5c02b7891701 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0630 15:43:39.788048 1606769 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20991-1550299/.minikube/ca.key
I0630 15:43:39.788111 1606769 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20991-1550299/.minikube/proxy-client-ca.key
I0630 15:43:39.788125 1606769 certs.go:256] generating profile certs ...
I0630 15:43:39.788212 1606769 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/client.key
I0630 15:43:39.788249 1606769 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/client.crt with IP's: []
I0630 15:43:40.312951 1606769 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/client.crt ...
I0630 15:43:40.312989 1606769 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/client.crt: {Name:mk1aefc3e6c30ddf6b6303202ef5e78380cd8d9e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0630 15:43:40.313209 1606769 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/client.key ...
I0630 15:43:40.313232 1606769 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/client.key: {Name:mk1ce7a3569c6b3226fa90571413a9cd0e62e54a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0630 15:43:40.313322 1606769 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/apiserver.key.326a3c9b
I0630 15:43:40.313341 1606769 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/apiserver.crt.326a3c9b with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.88]
I0630 15:43:40.334323 1606769 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/apiserver.crt.326a3c9b ...
I0630 15:43:40.334365 1606769 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/apiserver.crt.326a3c9b: {Name:mk9b8af628c8a51b1c1549191a80be3dcbc79a6c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0630 15:43:40.334567 1606769 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/apiserver.key.326a3c9b ...
I0630 15:43:40.334584 1606769 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/apiserver.key.326a3c9b: {Name:mke52a101ceb08fd2b2478ffe61ee4c49b6a6117 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0630 15:43:40.334663 1606769 certs.go:381] copying /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/apiserver.crt.326a3c9b -> /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/apiserver.crt
I0630 15:43:40.334777 1606769 certs.go:385] copying /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/apiserver.key.326a3c9b -> /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/apiserver.key
I0630 15:43:40.334864 1606769 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/proxy-client.key
I0630 15:43:40.334884 1606769 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/proxy-client.crt with IP's: []
I0630 15:43:40.574941 1606769 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/proxy-client.crt ...
I0630 15:43:40.574975 1606769 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/proxy-client.crt: {Name:mkf6f7be7b17f15ed61c3907aa2dd7f66fddd7d3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0630 15:43:40.575154 1606769 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/proxy-client.key ...
I0630 15:43:40.575168 1606769 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/proxy-client.key: {Name:mk21df5070fa2ef1a28a6e31e6caf0b6e214630d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0630 15:43:40.575494 1606769 certs.go:484] found cert: /home/jenkins/minikube-integration/20991-1550299/.minikube/certs/1557732.pem (1338 bytes)
W0630 15:43:40.575552 1606769 certs.go:480] ignoring /home/jenkins/minikube-integration/20991-1550299/.minikube/certs/1557732_empty.pem, impossibly tiny 0 bytes
I0630 15:43:40.575567 1606769 certs.go:484] found cert: /home/jenkins/minikube-integration/20991-1550299/.minikube/certs/ca-key.pem (1679 bytes)
I0630 15:43:40.575604 1606769 certs.go:484] found cert: /home/jenkins/minikube-integration/20991-1550299/.minikube/certs/ca.pem (1078 bytes)
I0630 15:43:40.575630 1606769 certs.go:484] found cert: /home/jenkins/minikube-integration/20991-1550299/.minikube/certs/cert.pem (1123 bytes)
I0630 15:43:40.575655 1606769 certs.go:484] found cert: /home/jenkins/minikube-integration/20991-1550299/.minikube/certs/key.pem (1675 bytes)
I0630 15:43:40.575697 1606769 certs.go:484] found cert: /home/jenkins/minikube-integration/20991-1550299/.minikube/files/etc/ssl/certs/15577322.pem (1708 bytes)
I0630 15:43:40.576432 1606769 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20991-1550299/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0630 15:43:40.611272 1606769 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20991-1550299/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0630 15:43:40.651690 1606769 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20991-1550299/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0630 15:43:40.686623 1606769 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20991-1550299/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0630 15:43:40.729867 1606769 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0630 15:43:40.765344 1606769 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0630 15:43:40.796511 1606769 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0630 15:43:40.828648 1606769 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20991-1550299/.minikube/profiles/old-k8s-version-836310/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0630 15:43:40.860003 1606769 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20991-1550299/.minikube/files/etc/ssl/certs/15577322.pem --> /usr/share/ca-certificates/15577322.pem (1708 bytes)
I0630 15:43:40.888402 1606769 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20991-1550299/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0630 15:43:40.924915 1606769 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20991-1550299/.minikube/certs/1557732.pem --> /usr/share/ca-certificates/1557732.pem (1338 bytes)
I0630 15:43:40.958021 1606769 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0630 15:43:40.979706 1606769 ssh_runner.go:195] Run: openssl version
I0630 15:43:40.986311 1606769 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0630 15:43:40.999668 1606769 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0630 15:43:41.005305 1606769 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 30 14:18 /usr/share/ca-certificates/minikubeCA.pem
I0630 15:43:41.005385 1606769 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0630 15:43:41.013674 1606769 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0630 15:43:41.027066 1606769 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1557732.pem && ln -fs /usr/share/ca-certificates/1557732.pem /etc/ssl/certs/1557732.pem"
I0630 15:43:41.041857 1606769 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1557732.pem
I0630 15:43:41.047230 1606769 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 30 14:38 /usr/share/ca-certificates/1557732.pem
I0630 15:43:41.047381 1606769 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1557732.pem
I0630 15:43:41.054642 1606769 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1557732.pem /etc/ssl/certs/51391683.0"
I0630 15:43:41.068323 1606769 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15577322.pem && ln -fs /usr/share/ca-certificates/15577322.pem /etc/ssl/certs/15577322.pem"
I0630 15:43:41.082367 1606769 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15577322.pem
I0630 15:43:41.087853 1606769 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 30 14:38 /usr/share/ca-certificates/15577322.pem
I0630 15:43:41.087925 1606769 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15577322.pem
I0630 15:43:41.095376 1606769 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/15577322.pem /etc/ssl/certs/3ec20f2e.0"
I0630 15:43:41.108438 1606769 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0630 15:43:41.113165 1606769 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0630 15:43:41.113240 1606769 kubeadm.go:392] StartCluster: {Name:old-k8s-version-836310 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/20991/minikube-v1.36.0-1751221996-20991-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.47@sha256:6ed579c9292b4370177b7ef3c42cc4b4a6dcd0735a1814916cbc22c8bf38412b Memory:3072 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k
8s-version-836310 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.88 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p Moun
tUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0630 15:43:41.113338 1606769 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0630 15:43:41.113451 1606769 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0630 15:43:41.154388 1606769 cri.go:89] found id: ""
I0630 15:43:41.154467 1606769 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0630 15:43:41.167204 1606769 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0630 15:43:41.179807 1606769 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0630 15:43:41.191273 1606769 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0630 15:43:41.191303 1606769 kubeadm.go:157] found existing configuration files:
I0630 15:43:41.191367 1606769 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0630 15:43:41.202451 1606769 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0630 15:43:41.202536 1606769 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0630 15:43:41.213833 1606769 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0630 15:43:41.228804 1606769 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0630 15:43:41.228888 1606769 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0630 15:43:41.241569 1606769 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0630 15:43:41.253805 1606769 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0630 15:43:41.253881 1606769 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0630 15:43:41.265137 1606769 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0630 15:43:41.275696 1606769 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0630 15:43:41.275770 1606769 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0630 15:43:41.287731 1606769 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0630 15:43:41.551126 1606769 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0630 15:45:39.792121 1606769 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0630 15:45:39.792260 1606769 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0630 15:45:39.795087 1606769 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0630 15:45:39.795197 1606769 kubeadm.go:310] [preflight] Running pre-flight checks
I0630 15:45:39.795313 1606769 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0630 15:45:39.795462 1606769 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0630 15:45:39.795608 1606769 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0630 15:45:39.795702 1606769 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0630 15:45:39.797704 1606769 out.go:235] - Generating certificates and keys ...
I0630 15:45:39.797793 1606769 kubeadm.go:310] [certs] Using existing ca certificate authority
I0630 15:45:39.797855 1606769 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0630 15:45:39.797947 1606769 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0630 15:45:39.798031 1606769 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0630 15:45:39.798117 1606769 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0630 15:45:39.798190 1606769 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0630 15:45:39.798267 1606769 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0630 15:45:39.798438 1606769 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-836310] and IPs [192.168.61.88 127.0.0.1 ::1]
I0630 15:45:39.798525 1606769 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0630 15:45:39.798669 1606769 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-836310] and IPs [192.168.61.88 127.0.0.1 ::1]
I0630 15:45:39.798763 1606769 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0630 15:45:39.798847 1606769 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0630 15:45:39.798915 1606769 kubeadm.go:310] [certs] Generating "sa" key and public key
I0630 15:45:39.798992 1606769 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0630 15:45:39.799067 1606769 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0630 15:45:39.799143 1606769 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0630 15:45:39.799240 1606769 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0630 15:45:39.799328 1606769 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0630 15:45:39.799447 1606769 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0630 15:45:39.799582 1606769 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0630 15:45:39.799637 1606769 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0630 15:45:39.799723 1606769 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0630 15:45:39.801537 1606769 out.go:235] - Booting up control plane ...
I0630 15:45:39.801660 1606769 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0630 15:45:39.801772 1606769 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0630 15:45:39.801849 1606769 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0630 15:45:39.801940 1606769 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0630 15:45:39.802190 1606769 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0630 15:45:39.802259 1606769 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0630 15:45:39.802348 1606769 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0630 15:45:39.802542 1606769 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0630 15:45:39.802662 1606769 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0630 15:45:39.802959 1606769 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0630 15:45:39.803048 1606769 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0630 15:45:39.803220 1606769 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0630 15:45:39.803301 1606769 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0630 15:45:39.803503 1606769 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0630 15:45:39.803616 1606769 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0630 15:45:39.803903 1606769 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0630 15:45:39.803918 1606769 kubeadm.go:310]
I0630 15:45:39.803961 1606769 kubeadm.go:310] Unfortunately, an error has occurred:
I0630 15:45:39.804016 1606769 kubeadm.go:310] timed out waiting for the condition
I0630 15:45:39.804024 1606769 kubeadm.go:310]
I0630 15:45:39.804068 1606769 kubeadm.go:310] This error is likely caused by:
I0630 15:45:39.804127 1606769 kubeadm.go:310] - The kubelet is not running
I0630 15:45:39.804278 1606769 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0630 15:45:39.804293 1606769 kubeadm.go:310]
I0630 15:45:39.804445 1606769 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0630 15:45:39.804493 1606769 kubeadm.go:310] - 'systemctl status kubelet'
I0630 15:45:39.804537 1606769 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0630 15:45:39.804545 1606769 kubeadm.go:310]
I0630 15:45:39.804748 1606769 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0630 15:45:39.804862 1606769 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0630 15:45:39.804872 1606769 kubeadm.go:310]
I0630 15:45:39.805001 1606769 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0630 15:45:39.805143 1606769 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0630 15:45:39.805260 1606769 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0630 15:45:39.805382 1606769 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0630 15:45:39.805420 1606769 kubeadm.go:310]
W0630 15:45:39.805589 1606769 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-836310] and IPs [192.168.61.88 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-836310] and IPs [192.168.61.88 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-836310] and IPs [192.168.61.88 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-836310] and IPs [192.168.61.88 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0630 15:45:39.805648 1606769 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0630 15:45:41.310767 1606769 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.50507331s)
I0630 15:45:41.310866 1606769 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0630 15:45:41.330754 1606769 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0630 15:45:41.344307 1606769 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0630 15:45:41.344336 1606769 kubeadm.go:157] found existing configuration files:
I0630 15:45:41.344479 1606769 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0630 15:45:41.356249 1606769 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0630 15:45:41.356339 1606769 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0630 15:45:41.369621 1606769 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0630 15:45:41.381458 1606769 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0630 15:45:41.381525 1606769 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0630 15:45:41.394133 1606769 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0630 15:45:41.405990 1606769 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0630 15:45:41.406059 1606769 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0630 15:45:41.418340 1606769 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0630 15:45:41.429264 1606769 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0630 15:45:41.429336 1606769 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0630 15:45:41.441487 1606769 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0630 15:45:41.660594 1606769 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0630 15:47:37.876526 1606769 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0630 15:47:37.876658 1606769 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0630 15:47:37.879798 1606769 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0630 15:47:37.879940 1606769 kubeadm.go:310] [preflight] Running pre-flight checks
I0630 15:47:37.880049 1606769 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0630 15:47:37.880176 1606769 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0630 15:47:37.880315 1606769 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0630 15:47:37.880469 1606769 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0630 15:47:37.882821 1606769 out.go:235] - Generating certificates and keys ...
I0630 15:47:37.882947 1606769 kubeadm.go:310] [certs] Using existing ca certificate authority
I0630 15:47:37.883070 1606769 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0630 15:47:37.883192 1606769 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0630 15:47:37.883261 1606769 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0630 15:47:37.883348 1606769 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0630 15:47:37.883404 1606769 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0630 15:47:37.883478 1606769 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0630 15:47:37.883549 1606769 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0630 15:47:37.883636 1606769 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0630 15:47:37.883726 1606769 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0630 15:47:37.883775 1606769 kubeadm.go:310] [certs] Using the existing "sa" key
I0630 15:47:37.883837 1606769 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0630 15:47:37.883897 1606769 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0630 15:47:37.883957 1606769 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0630 15:47:37.884035 1606769 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0630 15:47:37.884102 1606769 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0630 15:47:37.884220 1606769 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0630 15:47:37.884329 1606769 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0630 15:47:37.884377 1606769 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0630 15:47:37.884454 1606769 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0630 15:47:37.886550 1606769 out.go:235] - Booting up control plane ...
I0630 15:47:37.886707 1606769 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0630 15:47:37.886846 1606769 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0630 15:47:37.886917 1606769 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0630 15:47:37.886992 1606769 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0630 15:47:37.887207 1606769 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0630 15:47:37.887280 1606769 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0630 15:47:37.887382 1606769 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0630 15:47:37.887580 1606769 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0630 15:47:37.887685 1606769 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0630 15:47:37.887854 1606769 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0630 15:47:37.887932 1606769 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0630 15:47:37.888221 1606769 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0630 15:47:37.888323 1606769 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0630 15:47:37.888547 1606769 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0630 15:47:37.888622 1606769 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0630 15:47:37.888849 1606769 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0630 15:47:37.888868 1606769 kubeadm.go:310]
I0630 15:47:37.888900 1606769 kubeadm.go:310] Unfortunately, an error has occurred:
I0630 15:47:37.888942 1606769 kubeadm.go:310] timed out waiting for the condition
I0630 15:47:37.888948 1606769 kubeadm.go:310]
I0630 15:47:37.888976 1606769 kubeadm.go:310] This error is likely caused by:
I0630 15:47:37.889024 1606769 kubeadm.go:310] - The kubelet is not running
I0630 15:47:37.889113 1606769 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0630 15:47:37.889122 1606769 kubeadm.go:310]
I0630 15:47:37.889208 1606769 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0630 15:47:37.889268 1606769 kubeadm.go:310] - 'systemctl status kubelet'
I0630 15:47:37.889347 1606769 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0630 15:47:37.889364 1606769 kubeadm.go:310]
I0630 15:47:37.889541 1606769 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0630 15:47:37.889616 1606769 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0630 15:47:37.889623 1606769 kubeadm.go:310]
I0630 15:47:37.889757 1606769 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0630 15:47:37.889833 1606769 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0630 15:47:37.889894 1606769 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0630 15:47:37.889989 1606769 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0630 15:47:37.890079 1606769 kubeadm.go:310]
I0630 15:47:37.890095 1606769 kubeadm.go:394] duration metric: took 3m56.776862472s to StartCluster
I0630 15:47:37.890151 1606769 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0630 15:47:37.890227 1606769 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0630 15:47:37.941820 1606769 cri.go:89] found id: ""
I0630 15:47:37.941856 1606769 logs.go:282] 0 containers: []
W0630 15:47:37.941864 1606769 logs.go:284] No container was found matching "kube-apiserver"
I0630 15:47:37.941871 1606769 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0630 15:47:37.941977 1606769 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0630 15:47:37.982091 1606769 cri.go:89] found id: ""
I0630 15:47:37.982132 1606769 logs.go:282] 0 containers: []
W0630 15:47:37.982144 1606769 logs.go:284] No container was found matching "etcd"
I0630 15:47:37.982153 1606769 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0630 15:47:37.982233 1606769 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0630 15:47:38.023936 1606769 cri.go:89] found id: ""
I0630 15:47:38.023993 1606769 logs.go:282] 0 containers: []
W0630 15:47:38.024006 1606769 logs.go:284] No container was found matching "coredns"
I0630 15:47:38.024016 1606769 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0630 15:47:38.024129 1606769 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0630 15:47:38.065252 1606769 cri.go:89] found id: ""
I0630 15:47:38.065289 1606769 logs.go:282] 0 containers: []
W0630 15:47:38.065299 1606769 logs.go:284] No container was found matching "kube-scheduler"
I0630 15:47:38.065306 1606769 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0630 15:47:38.065377 1606769 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0630 15:47:38.110803 1606769 cri.go:89] found id: ""
I0630 15:47:38.110855 1606769 logs.go:282] 0 containers: []
W0630 15:47:38.110869 1606769 logs.go:284] No container was found matching "kube-proxy"
I0630 15:47:38.110879 1606769 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0630 15:47:38.110962 1606769 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0630 15:47:38.151349 1606769 cri.go:89] found id: ""
I0630 15:47:38.151387 1606769 logs.go:282] 0 containers: []
W0630 15:47:38.151399 1606769 logs.go:284] No container was found matching "kube-controller-manager"
I0630 15:47:38.151409 1606769 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0630 15:47:38.151490 1606769 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0630 15:47:38.199992 1606769 cri.go:89] found id: ""
I0630 15:47:38.200028 1606769 logs.go:282] 0 containers: []
W0630 15:47:38.200040 1606769 logs.go:284] No container was found matching "kindnet"
I0630 15:47:38.200055 1606769 logs.go:123] Gathering logs for CRI-O ...
I0630 15:47:38.200071 1606769 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0630 15:47:38.332163 1606769 logs.go:123] Gathering logs for container status ...
I0630 15:47:38.332222 1606769 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0630 15:47:38.392420 1606769 logs.go:123] Gathering logs for kubelet ...
I0630 15:47:38.392456 1606769 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0630 15:47:38.475680 1606769 logs.go:123] Gathering logs for dmesg ...
I0630 15:47:38.475757 1606769 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0630 15:47:38.498087 1606769 logs.go:123] Gathering logs for describe nodes ...
I0630 15:47:38.498130 1606769 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0630 15:47:38.601850 1606769 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
W0630 15:47:38.601947 1606769 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0630 15:47:38.602044 1606769 out.go:270] *
*
W0630 15:47:38.602143 1606769 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0630 15:47:38.602167 1606769 out.go:270] *
*
W0630 15:47:38.603957 1606769 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0630 15:47:38.607922 1606769 out.go:201]
W0630 15:47:38.609377 1606769 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0630 15:47:38.609475 1606769 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0630 15:47:38.609510 1606769 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0630 15:47:38.611401 1606769 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-836310 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-836310 -n old-k8s-version-836310
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-836310 -n old-k8s-version-836310: exit status 6 (318.057337ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0630 15:47:38.980046 1610129 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-836310" does not appear in /home/jenkins/minikube-integration/20991-1550299/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-836310" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (273.22s)