=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-966509 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-966509 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m52.69704722s)
-- stdout --
* [old-k8s-version-966509] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20384
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20384-1167927/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20384-1167927/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-966509" primary control-plane node in "old-k8s-version-966509" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0414 13:36:00.139254 1219144 out.go:345] Setting OutFile to fd 1 ...
I0414 13:36:00.139584 1219144 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 13:36:00.139597 1219144 out.go:358] Setting ErrFile to fd 2...
I0414 13:36:00.139602 1219144 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 13:36:00.139846 1219144 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20384-1167927/.minikube/bin
I0414 13:36:00.140643 1219144 out.go:352] Setting JSON to false
I0414 13:36:00.141956 1219144 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-2","uptime":19107,"bootTime":1744618653,"procs":225,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1078-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0414 13:36:00.142138 1219144 start.go:139] virtualization: kvm guest
I0414 13:36:00.145263 1219144 out.go:177] * [old-k8s-version-966509] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0414 13:36:00.147627 1219144 out.go:177] - MINIKUBE_LOCATION=20384
I0414 13:36:00.147638 1219144 notify.go:220] Checking for updates...
I0414 13:36:00.150894 1219144 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0414 13:36:00.152812 1219144 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20384-1167927/kubeconfig
I0414 13:36:00.154339 1219144 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20384-1167927/.minikube
I0414 13:36:00.155957 1219144 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0414 13:36:00.157939 1219144 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0414 13:36:00.160114 1219144 config.go:182] Loaded profile config "cert-expiration-737652": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0414 13:36:00.160256 1219144 config.go:182] Loaded profile config "kubernetes-upgrade-225418": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0414 13:36:00.160401 1219144 config.go:182] Loaded profile config "pause-527439": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0414 13:36:00.160527 1219144 driver.go:394] Setting default libvirt URI to qemu:///system
I0414 13:36:00.204907 1219144 out.go:177] * Using the kvm2 driver based on user configuration
I0414 13:36:00.206916 1219144 start.go:297] selected driver: kvm2
I0414 13:36:00.206986 1219144 start.go:901] validating driver "kvm2" against <nil>
I0414 13:36:00.207036 1219144 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0414 13:36:00.208705 1219144 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0414 13:36:00.208817 1219144 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20384-1167927/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0414 13:36:00.228676 1219144 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0414 13:36:00.228788 1219144 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0414 13:36:00.229168 1219144 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0414 13:36:00.229233 1219144 cni.go:84] Creating CNI manager for ""
I0414 13:36:00.229308 1219144 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0414 13:36:00.229321 1219144 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0414 13:36:00.229420 1219144 start.go:340] cluster config:
{Name:old-k8s-version-966509 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-966509 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0414 13:36:00.229595 1219144 iso.go:125] acquiring lock: {Name:mk8f809cb461c81c5ffa481f4cedc4ad92252720 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0414 13:36:00.231859 1219144 out.go:177] * Starting "old-k8s-version-966509" primary control-plane node in "old-k8s-version-966509" cluster
I0414 13:36:00.233252 1219144 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0414 13:36:00.233337 1219144 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20384-1167927/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0414 13:36:00.233353 1219144 cache.go:56] Caching tarball of preloaded images
I0414 13:36:00.233514 1219144 preload.go:172] Found /home/jenkins/minikube-integration/20384-1167927/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0414 13:36:00.233533 1219144 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0414 13:36:00.233682 1219144 profile.go:143] Saving config to /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/config.json ...
I0414 13:36:00.233713 1219144 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/config.json: {Name:mk6d5cf9c8ef340843328dd134e2afa2160223c6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 13:36:00.233936 1219144 start.go:360] acquireMachinesLock for old-k8s-version-966509: {Name:mk1c744e856a4885e6214d755048926590b4b12b Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0414 13:36:17.209722 1219144 start.go:364] duration metric: took 16.975744775s to acquireMachinesLock for "old-k8s-version-966509"
I0414 13:36:17.209816 1219144 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-966509 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 C
lusterName:old-k8s-version-966509 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p M
ountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0414 13:36:17.209934 1219144 start.go:125] createHost starting for "" (driver="kvm2")
I0414 13:36:17.212303 1219144 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0414 13:36:17.212504 1219144 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0414 13:36:17.212556 1219144 main.go:141] libmachine: Launching plugin server for driver kvm2
I0414 13:36:17.231036 1219144 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45161
I0414 13:36:17.231705 1219144 main.go:141] libmachine: () Calling .GetVersion
I0414 13:36:17.232304 1219144 main.go:141] libmachine: Using API Version 1
I0414 13:36:17.232326 1219144 main.go:141] libmachine: () Calling .SetConfigRaw
I0414 13:36:17.232741 1219144 main.go:141] libmachine: () Calling .GetMachineName
I0414 13:36:17.232974 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetMachineName
I0414 13:36:17.233157 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .DriverName
I0414 13:36:17.233347 1219144 start.go:159] libmachine.API.Create for "old-k8s-version-966509" (driver="kvm2")
I0414 13:36:17.233395 1219144 client.go:168] LocalClient.Create starting
I0414 13:36:17.233439 1219144 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20384-1167927/.minikube/certs/ca.pem
I0414 13:36:17.233488 1219144 main.go:141] libmachine: Decoding PEM data...
I0414 13:36:17.233510 1219144 main.go:141] libmachine: Parsing certificate...
I0414 13:36:17.233593 1219144 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20384-1167927/.minikube/certs/cert.pem
I0414 13:36:17.233634 1219144 main.go:141] libmachine: Decoding PEM data...
I0414 13:36:17.233653 1219144 main.go:141] libmachine: Parsing certificate...
I0414 13:36:17.233685 1219144 main.go:141] libmachine: Running pre-create checks...
I0414 13:36:17.233700 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .PreCreateCheck
I0414 13:36:17.234160 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetConfigRaw
I0414 13:36:17.234643 1219144 main.go:141] libmachine: Creating machine...
I0414 13:36:17.234658 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .Create
I0414 13:36:17.234847 1219144 main.go:141] libmachine: (old-k8s-version-966509) creating KVM machine...
I0414 13:36:17.234868 1219144 main.go:141] libmachine: (old-k8s-version-966509) creating network...
I0414 13:36:17.236881 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found existing default KVM network
I0414 13:36:17.238507 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:17.238242 1219249 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:b3:27:af} reservation:<nil>}
I0414 13:36:17.239463 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:17.239346 1219249 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:75:d0:0f} reservation:<nil>}
I0414 13:36:17.241026 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:17.240804 1219249 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000370550}
I0414 13:36:17.241060 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | created network xml:
I0414 13:36:17.241073 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | <network>
I0414 13:36:17.241083 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | <name>mk-old-k8s-version-966509</name>
I0414 13:36:17.241093 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | <dns enable='no'/>
I0414 13:36:17.241099 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG |
I0414 13:36:17.241108 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0414 13:36:17.241123 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | <dhcp>
I0414 13:36:17.241132 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0414 13:36:17.241149 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | </dhcp>
I0414 13:36:17.241196 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | </ip>
I0414 13:36:17.241224 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG |
I0414 13:36:17.241239 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | </network>
I0414 13:36:17.241251 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG |
I0414 13:36:17.247715 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | trying to create private KVM network mk-old-k8s-version-966509 192.168.61.0/24...
I0414 13:36:17.346500 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | private KVM network mk-old-k8s-version-966509 192.168.61.0/24 created
I0414 13:36:17.346537 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:17.346421 1219249 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20384-1167927/.minikube
I0414 13:36:17.346572 1219144 main.go:141] libmachine: (old-k8s-version-966509) setting up store path in /home/jenkins/minikube-integration/20384-1167927/.minikube/machines/old-k8s-version-966509 ...
I0414 13:36:17.346585 1219144 main.go:141] libmachine: (old-k8s-version-966509) building disk image from file:///home/jenkins/minikube-integration/20384-1167927/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0414 13:36:17.346605 1219144 main.go:141] libmachine: (old-k8s-version-966509) Downloading /home/jenkins/minikube-integration/20384-1167927/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20384-1167927/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0414 13:36:17.661917 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:17.661717 1219249 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20384-1167927/.minikube/machines/old-k8s-version-966509/id_rsa...
I0414 13:36:17.921220 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:17.921081 1219249 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20384-1167927/.minikube/machines/old-k8s-version-966509/old-k8s-version-966509.rawdisk...
I0414 13:36:17.921253 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | Writing magic tar header
I0414 13:36:17.921266 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | Writing SSH key tar header
I0414 13:36:17.921392 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:17.921257 1219249 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20384-1167927/.minikube/machines/old-k8s-version-966509 ...
I0414 13:36:17.921430 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20384-1167927/.minikube/machines/old-k8s-version-966509
I0414 13:36:17.921453 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20384-1167927/.minikube/machines
I0414 13:36:17.921466 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20384-1167927/.minikube
I0414 13:36:17.921475 1219144 main.go:141] libmachine: (old-k8s-version-966509) setting executable bit set on /home/jenkins/minikube-integration/20384-1167927/.minikube/machines/old-k8s-version-966509 (perms=drwx------)
I0414 13:36:17.921498 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20384-1167927
I0414 13:36:17.921526 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0414 13:36:17.921539 1219144 main.go:141] libmachine: (old-k8s-version-966509) setting executable bit set on /home/jenkins/minikube-integration/20384-1167927/.minikube/machines (perms=drwxr-xr-x)
I0414 13:36:17.921553 1219144 main.go:141] libmachine: (old-k8s-version-966509) setting executable bit set on /home/jenkins/minikube-integration/20384-1167927/.minikube (perms=drwxr-xr-x)
I0414 13:36:17.921569 1219144 main.go:141] libmachine: (old-k8s-version-966509) setting executable bit set on /home/jenkins/minikube-integration/20384-1167927 (perms=drwxrwxr-x)
I0414 13:36:17.921577 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | checking permissions on dir: /home/jenkins
I0414 13:36:17.921592 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | checking permissions on dir: /home
I0414 13:36:17.921603 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | skipping /home - not owner
I0414 13:36:17.921614 1219144 main.go:141] libmachine: (old-k8s-version-966509) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0414 13:36:17.921623 1219144 main.go:141] libmachine: (old-k8s-version-966509) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0414 13:36:17.921629 1219144 main.go:141] libmachine: (old-k8s-version-966509) creating domain...
I0414 13:36:17.922969 1219144 main.go:141] libmachine: (old-k8s-version-966509) define libvirt domain using xml:
I0414 13:36:17.922999 1219144 main.go:141] libmachine: (old-k8s-version-966509) <domain type='kvm'>
I0414 13:36:17.923009 1219144 main.go:141] libmachine: (old-k8s-version-966509) <name>old-k8s-version-966509</name>
I0414 13:36:17.923018 1219144 main.go:141] libmachine: (old-k8s-version-966509) <memory unit='MiB'>2200</memory>
I0414 13:36:17.923027 1219144 main.go:141] libmachine: (old-k8s-version-966509) <vcpu>2</vcpu>
I0414 13:36:17.923034 1219144 main.go:141] libmachine: (old-k8s-version-966509) <features>
I0414 13:36:17.923049 1219144 main.go:141] libmachine: (old-k8s-version-966509) <acpi/>
I0414 13:36:17.923060 1219144 main.go:141] libmachine: (old-k8s-version-966509) <apic/>
I0414 13:36:17.923072 1219144 main.go:141] libmachine: (old-k8s-version-966509) <pae/>
I0414 13:36:17.923079 1219144 main.go:141] libmachine: (old-k8s-version-966509)
I0414 13:36:17.923087 1219144 main.go:141] libmachine: (old-k8s-version-966509) </features>
I0414 13:36:17.923095 1219144 main.go:141] libmachine: (old-k8s-version-966509) <cpu mode='host-passthrough'>
I0414 13:36:17.923111 1219144 main.go:141] libmachine: (old-k8s-version-966509)
I0414 13:36:17.923118 1219144 main.go:141] libmachine: (old-k8s-version-966509) </cpu>
I0414 13:36:17.923126 1219144 main.go:141] libmachine: (old-k8s-version-966509) <os>
I0414 13:36:17.923139 1219144 main.go:141] libmachine: (old-k8s-version-966509) <type>hvm</type>
I0414 13:36:17.923150 1219144 main.go:141] libmachine: (old-k8s-version-966509) <boot dev='cdrom'/>
I0414 13:36:17.923158 1219144 main.go:141] libmachine: (old-k8s-version-966509) <boot dev='hd'/>
I0414 13:36:17.923169 1219144 main.go:141] libmachine: (old-k8s-version-966509) <bootmenu enable='no'/>
I0414 13:36:17.923173 1219144 main.go:141] libmachine: (old-k8s-version-966509) </os>
I0414 13:36:17.923178 1219144 main.go:141] libmachine: (old-k8s-version-966509) <devices>
I0414 13:36:17.923185 1219144 main.go:141] libmachine: (old-k8s-version-966509) <disk type='file' device='cdrom'>
I0414 13:36:17.923206 1219144 main.go:141] libmachine: (old-k8s-version-966509) <source file='/home/jenkins/minikube-integration/20384-1167927/.minikube/machines/old-k8s-version-966509/boot2docker.iso'/>
I0414 13:36:17.923222 1219144 main.go:141] libmachine: (old-k8s-version-966509) <target dev='hdc' bus='scsi'/>
I0414 13:36:17.923234 1219144 main.go:141] libmachine: (old-k8s-version-966509) <readonly/>
I0414 13:36:17.923240 1219144 main.go:141] libmachine: (old-k8s-version-966509) </disk>
I0414 13:36:17.923272 1219144 main.go:141] libmachine: (old-k8s-version-966509) <disk type='file' device='disk'>
I0414 13:36:17.923286 1219144 main.go:141] libmachine: (old-k8s-version-966509) <driver name='qemu' type='raw' cache='default' io='threads' />
I0414 13:36:17.923332 1219144 main.go:141] libmachine: (old-k8s-version-966509) <source file='/home/jenkins/minikube-integration/20384-1167927/.minikube/machines/old-k8s-version-966509/old-k8s-version-966509.rawdisk'/>
I0414 13:36:17.923356 1219144 main.go:141] libmachine: (old-k8s-version-966509) <target dev='hda' bus='virtio'/>
I0414 13:36:17.923362 1219144 main.go:141] libmachine: (old-k8s-version-966509) </disk>
I0414 13:36:17.923370 1219144 main.go:141] libmachine: (old-k8s-version-966509) <interface type='network'>
I0414 13:36:17.923396 1219144 main.go:141] libmachine: (old-k8s-version-966509) <source network='mk-old-k8s-version-966509'/>
I0414 13:36:17.923417 1219144 main.go:141] libmachine: (old-k8s-version-966509) <model type='virtio'/>
I0414 13:36:17.923427 1219144 main.go:141] libmachine: (old-k8s-version-966509) </interface>
I0414 13:36:17.923438 1219144 main.go:141] libmachine: (old-k8s-version-966509) <interface type='network'>
I0414 13:36:17.923448 1219144 main.go:141] libmachine: (old-k8s-version-966509) <source network='default'/>
I0414 13:36:17.923458 1219144 main.go:141] libmachine: (old-k8s-version-966509) <model type='virtio'/>
I0414 13:36:17.923524 1219144 main.go:141] libmachine: (old-k8s-version-966509) </interface>
I0414 13:36:17.923560 1219144 main.go:141] libmachine: (old-k8s-version-966509) <serial type='pty'>
I0414 13:36:17.923575 1219144 main.go:141] libmachine: (old-k8s-version-966509) <target port='0'/>
I0414 13:36:17.923588 1219144 main.go:141] libmachine: (old-k8s-version-966509) </serial>
I0414 13:36:17.923598 1219144 main.go:141] libmachine: (old-k8s-version-966509) <console type='pty'>
I0414 13:36:17.923610 1219144 main.go:141] libmachine: (old-k8s-version-966509) <target type='serial' port='0'/>
I0414 13:36:17.923620 1219144 main.go:141] libmachine: (old-k8s-version-966509) </console>
I0414 13:36:17.923648 1219144 main.go:141] libmachine: (old-k8s-version-966509) <rng model='virtio'>
I0414 13:36:17.923689 1219144 main.go:141] libmachine: (old-k8s-version-966509) <backend model='random'>/dev/random</backend>
I0414 13:36:17.923705 1219144 main.go:141] libmachine: (old-k8s-version-966509) </rng>
I0414 13:36:17.923715 1219144 main.go:141] libmachine: (old-k8s-version-966509)
I0414 13:36:17.923727 1219144 main.go:141] libmachine: (old-k8s-version-966509)
I0414 13:36:17.923736 1219144 main.go:141] libmachine: (old-k8s-version-966509) </devices>
I0414 13:36:17.923757 1219144 main.go:141] libmachine: (old-k8s-version-966509) </domain>
I0414 13:36:17.923789 1219144 main.go:141] libmachine: (old-k8s-version-966509)
I0414 13:36:17.928686 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:f0:58:df in network default
I0414 13:36:17.929719 1219144 main.go:141] libmachine: (old-k8s-version-966509) starting domain...
I0414 13:36:17.929757 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:17.929766 1219144 main.go:141] libmachine: (old-k8s-version-966509) ensuring networks are active...
I0414 13:36:17.930843 1219144 main.go:141] libmachine: (old-k8s-version-966509) Ensuring network default is active
I0414 13:36:17.931359 1219144 main.go:141] libmachine: (old-k8s-version-966509) Ensuring network mk-old-k8s-version-966509 is active
I0414 13:36:17.932354 1219144 main.go:141] libmachine: (old-k8s-version-966509) getting domain XML...
I0414 13:36:17.933334 1219144 main.go:141] libmachine: (old-k8s-version-966509) creating domain...
I0414 13:36:19.473439 1219144 main.go:141] libmachine: (old-k8s-version-966509) waiting for IP...
I0414 13:36:19.474635 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:19.475144 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | unable to find current IP address of domain old-k8s-version-966509 in network mk-old-k8s-version-966509
I0414 13:36:19.475207 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:19.475144 1219249 retry.go:31] will retry after 195.318369ms: waiting for domain to come up
I0414 13:36:19.673092 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:19.674176 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | unable to find current IP address of domain old-k8s-version-966509 in network mk-old-k8s-version-966509
I0414 13:36:19.674203 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:19.674052 1219249 retry.go:31] will retry after 382.756079ms: waiting for domain to come up
I0414 13:36:20.059029 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:20.059994 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | unable to find current IP address of domain old-k8s-version-966509 in network mk-old-k8s-version-966509
I0414 13:36:20.060021 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:20.059871 1219249 retry.go:31] will retry after 466.739415ms: waiting for domain to come up
I0414 13:36:20.528720 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:20.529766 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | unable to find current IP address of domain old-k8s-version-966509 in network mk-old-k8s-version-966509
I0414 13:36:20.529792 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:20.529651 1219249 retry.go:31] will retry after 494.450507ms: waiting for domain to come up
I0414 13:36:21.026799 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:21.027513 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | unable to find current IP address of domain old-k8s-version-966509 in network mk-old-k8s-version-966509
I0414 13:36:21.027540 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:21.027503 1219249 retry.go:31] will retry after 591.922694ms: waiting for domain to come up
I0414 13:36:21.621805 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:21.622437 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | unable to find current IP address of domain old-k8s-version-966509 in network mk-old-k8s-version-966509
I0414 13:36:21.622470 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:21.622389 1219249 retry.go:31] will retry after 779.120314ms: waiting for domain to come up
I0414 13:36:22.403017 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:22.403781 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | unable to find current IP address of domain old-k8s-version-966509 in network mk-old-k8s-version-966509
I0414 13:36:22.403837 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:22.403743 1219249 retry.go:31] will retry after 876.200798ms: waiting for domain to come up
I0414 13:36:23.281271 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:23.281888 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | unable to find current IP address of domain old-k8s-version-966509 in network mk-old-k8s-version-966509
I0414 13:36:23.281918 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:23.281844 1219249 retry.go:31] will retry after 997.606309ms: waiting for domain to come up
I0414 13:36:24.281065 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:24.281622 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | unable to find current IP address of domain old-k8s-version-966509 in network mk-old-k8s-version-966509
I0414 13:36:24.281670 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:24.281580 1219249 retry.go:31] will retry after 1.290691803s: waiting for domain to come up
I0414 13:36:25.573658 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:25.574260 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | unable to find current IP address of domain old-k8s-version-966509 in network mk-old-k8s-version-966509
I0414 13:36:25.574287 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:25.574218 1219249 retry.go:31] will retry after 2.126351442s: waiting for domain to come up
I0414 13:36:27.702447 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:27.703163 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | unable to find current IP address of domain old-k8s-version-966509 in network mk-old-k8s-version-966509
I0414 13:36:27.703196 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:27.703129 1219249 retry.go:31] will retry after 2.120286187s: waiting for domain to come up
I0414 13:36:29.826027 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:29.826717 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | unable to find current IP address of domain old-k8s-version-966509 in network mk-old-k8s-version-966509
I0414 13:36:29.826752 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:29.826641 1219249 retry.go:31] will retry after 3.284505283s: waiting for domain to come up
I0414 13:36:33.113297 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:33.114131 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | unable to find current IP address of domain old-k8s-version-966509 in network mk-old-k8s-version-966509
I0414 13:36:33.114164 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:33.114013 1219249 retry.go:31] will retry after 3.692465087s: waiting for domain to come up
I0414 13:36:36.809018 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:36.809726 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | unable to find current IP address of domain old-k8s-version-966509 in network mk-old-k8s-version-966509
I0414 13:36:36.809758 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | I0414 13:36:36.809657 1219249 retry.go:31] will retry after 5.343638536s: waiting for domain to come up
I0414 13:36:42.156808 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:42.157412 1219144 main.go:141] libmachine: (old-k8s-version-966509) found domain IP: 192.168.61.227
I0414 13:36:42.157441 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has current primary IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:42.157451 1219144 main.go:141] libmachine: (old-k8s-version-966509) reserving static IP address...
I0414 13:36:42.157937 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-966509", mac: "52:54:00:3e:6b:50", ip: "192.168.61.227"} in network mk-old-k8s-version-966509
I0414 13:36:42.269166 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | Getting to WaitForSSH function...
I0414 13:36:42.269217 1219144 main.go:141] libmachine: (old-k8s-version-966509) reserved static IP address 192.168.61.227 for domain old-k8s-version-966509
I0414 13:36:42.269232 1219144 main.go:141] libmachine: (old-k8s-version-966509) waiting for SSH...
I0414 13:36:42.272222 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:42.272914 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:minikube Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:42.272953 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:42.273150 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | Using SSH client type: external
I0414 13:36:42.273186 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | Using SSH private key: /home/jenkins/minikube-integration/20384-1167927/.minikube/machines/old-k8s-version-966509/id_rsa (-rw-------)
I0414 13:36:42.273222 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.227 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20384-1167927/.minikube/machines/old-k8s-version-966509/id_rsa -p 22] /usr/bin/ssh <nil>}
I0414 13:36:42.273236 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | About to run SSH command:
I0414 13:36:42.273251 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | exit 0
I0414 13:36:42.408034 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | SSH cmd err, output: <nil>:
I0414 13:36:42.408403 1219144 main.go:141] libmachine: (old-k8s-version-966509) KVM machine creation complete
I0414 13:36:42.408728 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetConfigRaw
I0414 13:36:42.409445 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .DriverName
I0414 13:36:42.409726 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .DriverName
I0414 13:36:42.409953 1219144 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0414 13:36:42.409971 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetState
I0414 13:36:42.411446 1219144 main.go:141] libmachine: Detecting operating system of created instance...
I0414 13:36:42.411461 1219144 main.go:141] libmachine: Waiting for SSH to be available...
I0414 13:36:42.411467 1219144 main.go:141] libmachine: Getting to WaitForSSH function...
I0414 13:36:42.411473 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHHostname
I0414 13:36:42.414601 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:42.415033 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:old-k8s-version-966509 Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:42.415066 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:42.415286 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHPort
I0414 13:36:42.415533 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHKeyPath
I0414 13:36:42.415740 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHKeyPath
I0414 13:36:42.415907 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHUsername
I0414 13:36:42.416158 1219144 main.go:141] libmachine: Using SSH client type: native
I0414 13:36:42.416457 1219144 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.227 22 <nil> <nil>}
I0414 13:36:42.416479 1219144 main.go:141] libmachine: About to run SSH command:
exit 0
I0414 13:36:42.531742 1219144 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0414 13:36:42.531788 1219144 main.go:141] libmachine: Detecting the provisioner...
I0414 13:36:42.531801 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHHostname
I0414 13:36:42.535965 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:42.536599 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:old-k8s-version-966509 Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:42.536646 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:42.536865 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHPort
I0414 13:36:42.537103 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHKeyPath
I0414 13:36:42.537305 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHKeyPath
I0414 13:36:42.537512 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHUsername
I0414 13:36:42.537853 1219144 main.go:141] libmachine: Using SSH client type: native
I0414 13:36:42.538159 1219144 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.227 22 <nil> <nil>}
I0414 13:36:42.538174 1219144 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0414 13:36:42.657120 1219144 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0414 13:36:42.657241 1219144 main.go:141] libmachine: found compatible host: buildroot
I0414 13:36:42.657250 1219144 main.go:141] libmachine: Provisioning with buildroot...
I0414 13:36:42.657285 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetMachineName
I0414 13:36:42.657657 1219144 buildroot.go:166] provisioning hostname "old-k8s-version-966509"
I0414 13:36:42.657682 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetMachineName
I0414 13:36:42.657930 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHHostname
I0414 13:36:42.661572 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:42.662002 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:old-k8s-version-966509 Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:42.662029 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:42.662324 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHPort
I0414 13:36:42.662593 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHKeyPath
I0414 13:36:42.662791 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHKeyPath
I0414 13:36:42.662996 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHUsername
I0414 13:36:42.663154 1219144 main.go:141] libmachine: Using SSH client type: native
I0414 13:36:42.663469 1219144 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.227 22 <nil> <nil>}
I0414 13:36:42.663492 1219144 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-966509 && echo "old-k8s-version-966509" | sudo tee /etc/hostname
I0414 13:36:42.803676 1219144 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-966509
I0414 13:36:42.803705 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHHostname
I0414 13:36:42.807618 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:42.808250 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:old-k8s-version-966509 Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:42.808293 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:42.808593 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHPort
I0414 13:36:42.808883 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHKeyPath
I0414 13:36:42.809111 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHKeyPath
I0414 13:36:42.809320 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHUsername
I0414 13:36:42.809564 1219144 main.go:141] libmachine: Using SSH client type: native
I0414 13:36:42.809816 1219144 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.227 22 <nil> <nil>}
I0414 13:36:42.809839 1219144 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-966509' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-966509/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-966509' | sudo tee -a /etc/hosts;
fi
fi
I0414 13:36:42.944533 1219144 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0414 13:36:42.944576 1219144 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20384-1167927/.minikube CaCertPath:/home/jenkins/minikube-integration/20384-1167927/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20384-1167927/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20384-1167927/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20384-1167927/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20384-1167927/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20384-1167927/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20384-1167927/.minikube}
I0414 13:36:42.944614 1219144 buildroot.go:174] setting up certificates
I0414 13:36:42.944630 1219144 provision.go:84] configureAuth start
I0414 13:36:42.944646 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetMachineName
I0414 13:36:42.945052 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetIP
I0414 13:36:42.948705 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:42.949105 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:old-k8s-version-966509 Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:42.949152 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:42.949296 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHHostname
I0414 13:36:42.952684 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:42.953130 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:old-k8s-version-966509 Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:42.953153 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:42.953375 1219144 provision.go:143] copyHostCerts
I0414 13:36:42.953443 1219144 exec_runner.go:144] found /home/jenkins/minikube-integration/20384-1167927/.minikube/cert.pem, removing ...
I0414 13:36:42.953458 1219144 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20384-1167927/.minikube/cert.pem
I0414 13:36:42.953520 1219144 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20384-1167927/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20384-1167927/.minikube/cert.pem (1123 bytes)
I0414 13:36:42.953636 1219144 exec_runner.go:144] found /home/jenkins/minikube-integration/20384-1167927/.minikube/key.pem, removing ...
I0414 13:36:42.953650 1219144 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20384-1167927/.minikube/key.pem
I0414 13:36:42.953675 1219144 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20384-1167927/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20384-1167927/.minikube/key.pem (1675 bytes)
I0414 13:36:42.953748 1219144 exec_runner.go:144] found /home/jenkins/minikube-integration/20384-1167927/.minikube/ca.pem, removing ...
I0414 13:36:42.953759 1219144 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20384-1167927/.minikube/ca.pem
I0414 13:36:42.953785 1219144 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20384-1167927/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20384-1167927/.minikube/ca.pem (1078 bytes)
I0414 13:36:42.953850 1219144 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20384-1167927/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20384-1167927/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20384-1167927/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-966509 san=[127.0.0.1 192.168.61.227 localhost minikube old-k8s-version-966509]
I0414 13:36:43.091536 1219144 provision.go:177] copyRemoteCerts
I0414 13:36:43.091605 1219144 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0414 13:36:43.091637 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHHostname
I0414 13:36:43.095319 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.095711 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:old-k8s-version-966509 Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:43.095738 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.095980 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHPort
I0414 13:36:43.096210 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHKeyPath
I0414 13:36:43.096447 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHUsername
I0414 13:36:43.096592 1219144 sshutil.go:53] new ssh client: &{IP:192.168.61.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20384-1167927/.minikube/machines/old-k8s-version-966509/id_rsa Username:docker}
I0414 13:36:43.216124 1219144 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20384-1167927/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0414 13:36:43.253785 1219144 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20384-1167927/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0414 13:36:43.291623 1219144 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20384-1167927/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0414 13:36:43.325815 1219144 provision.go:87] duration metric: took 381.165584ms to configureAuth
I0414 13:36:43.325854 1219144 buildroot.go:189] setting minikube options for container-runtime
I0414 13:36:43.326111 1219144 config.go:182] Loaded profile config "old-k8s-version-966509": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0414 13:36:43.326218 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHHostname
I0414 13:36:43.329856 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.330339 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:old-k8s-version-966509 Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:43.330377 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.330812 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHPort
I0414 13:36:43.331145 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHKeyPath
I0414 13:36:43.331389 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHKeyPath
I0414 13:36:43.331643 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHUsername
I0414 13:36:43.331928 1219144 main.go:141] libmachine: Using SSH client type: native
I0414 13:36:43.332248 1219144 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.227 22 <nil> <nil>}
I0414 13:36:43.332276 1219144 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0414 13:36:43.615347 1219144 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0414 13:36:43.615377 1219144 main.go:141] libmachine: Checking connection to Docker...
I0414 13:36:43.615389 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetURL
I0414 13:36:43.617034 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | using libvirt version 6000000
I0414 13:36:43.620409 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.620925 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:old-k8s-version-966509 Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:43.620958 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.621170 1219144 main.go:141] libmachine: Docker is up and running!
I0414 13:36:43.621191 1219144 main.go:141] libmachine: Reticulating splines...
I0414 13:36:43.621201 1219144 client.go:171] duration metric: took 26.387793744s to LocalClient.Create
I0414 13:36:43.621233 1219144 start.go:167] duration metric: took 26.387890065s to libmachine.API.Create "old-k8s-version-966509"
I0414 13:36:43.621246 1219144 start.go:293] postStartSetup for "old-k8s-version-966509" (driver="kvm2")
I0414 13:36:43.621259 1219144 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0414 13:36:43.621286 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .DriverName
I0414 13:36:43.621582 1219144 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0414 13:36:43.621622 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHHostname
I0414 13:36:43.624548 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.625094 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:old-k8s-version-966509 Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:43.625125 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.625417 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHPort
I0414 13:36:43.625658 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHKeyPath
I0414 13:36:43.625852 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHUsername
I0414 13:36:43.626031 1219144 sshutil.go:53] new ssh client: &{IP:192.168.61.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20384-1167927/.minikube/machines/old-k8s-version-966509/id_rsa Username:docker}
I0414 13:36:43.724096 1219144 ssh_runner.go:195] Run: cat /etc/os-release
I0414 13:36:43.736063 1219144 info.go:137] Remote host: Buildroot 2023.02.9
I0414 13:36:43.736104 1219144 filesync.go:126] Scanning /home/jenkins/minikube-integration/20384-1167927/.minikube/addons for local assets ...
I0414 13:36:43.736182 1219144 filesync.go:126] Scanning /home/jenkins/minikube-integration/20384-1167927/.minikube/files for local assets ...
I0414 13:36:43.736322 1219144 filesync.go:149] local asset: /home/jenkins/minikube-integration/20384-1167927/.minikube/files/etc/ssl/certs/11757462.pem -> 11757462.pem in /etc/ssl/certs
I0414 13:36:43.736468 1219144 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0414 13:36:43.751738 1219144 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20384-1167927/.minikube/files/etc/ssl/certs/11757462.pem --> /etc/ssl/certs/11757462.pem (1708 bytes)
I0414 13:36:43.789086 1219144 start.go:296] duration metric: took 167.822507ms for postStartSetup
I0414 13:36:43.789151 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetConfigRaw
I0414 13:36:43.792739 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetIP
I0414 13:36:43.799464 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.800264 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:old-k8s-version-966509 Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:43.800334 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.800878 1219144 profile.go:143] Saving config to /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/config.json ...
I0414 13:36:43.801251 1219144 start.go:128] duration metric: took 26.591292999s to createHost
I0414 13:36:43.801298 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHHostname
I0414 13:36:43.805758 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.808231 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:old-k8s-version-966509 Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:43.808270 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.808451 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHPort
I0414 13:36:43.808994 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHKeyPath
I0414 13:36:43.809322 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHKeyPath
I0414 13:36:43.809565 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHUsername
I0414 13:36:43.809821 1219144 main.go:141] libmachine: Using SSH client type: native
I0414 13:36:43.810143 1219144 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.227 22 <nil> <nil>}
I0414 13:36:43.810158 1219144 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0414 13:36:43.934378 1219144 main.go:141] libmachine: SSH cmd err, output: <nil>: 1744637803.918160069
I0414 13:36:43.934411 1219144 fix.go:216] guest clock: 1744637803.918160069
I0414 13:36:43.934425 1219144 fix.go:229] Guest: 2025-04-14 13:36:43.918160069 +0000 UTC Remote: 2025-04-14 13:36:43.801274174 +0000 UTC m=+43.706392311 (delta=116.885895ms)
I0414 13:36:43.934488 1219144 fix.go:200] guest clock delta is within tolerance: 116.885895ms
I0414 13:36:43.934496 1219144 start.go:83] releasing machines lock for "old-k8s-version-966509", held for 26.724727502s
I0414 13:36:43.934541 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .DriverName
I0414 13:36:43.934895 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetIP
I0414 13:36:43.938671 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.939160 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:old-k8s-version-966509 Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:43.939196 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.939494 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .DriverName
I0414 13:36:43.940254 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .DriverName
I0414 13:36:43.940533 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .DriverName
I0414 13:36:43.940671 1219144 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0414 13:36:43.940767 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHHostname
I0414 13:36:43.940868 1219144 ssh_runner.go:195] Run: cat /version.json
I0414 13:36:43.940901 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHHostname
I0414 13:36:43.948033 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.948067 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.948745 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:old-k8s-version-966509 Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:43.948787 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.948937 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:old-k8s-version-966509 Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:43.948970 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:43.949035 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHPort
I0414 13:36:43.949333 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHKeyPath
I0414 13:36:43.949413 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHPort
I0414 13:36:43.949536 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHUsername
I0414 13:36:43.949828 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHKeyPath
I0414 13:36:43.949730 1219144 sshutil.go:53] new ssh client: &{IP:192.168.61.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20384-1167927/.minikube/machines/old-k8s-version-966509/id_rsa Username:docker}
I0414 13:36:43.950029 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetSSHUsername
I0414 13:36:43.950266 1219144 sshutil.go:53] new ssh client: &{IP:192.168.61.227 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20384-1167927/.minikube/machines/old-k8s-version-966509/id_rsa Username:docker}
I0414 13:36:44.042574 1219144 ssh_runner.go:195] Run: systemctl --version
I0414 13:36:44.065592 1219144 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0414 13:36:44.245331 1219144 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0414 13:36:44.258195 1219144 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0414 13:36:44.258305 1219144 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0414 13:36:44.276954 1219144 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0414 13:36:44.276987 1219144 start.go:495] detecting cgroup driver to use...
I0414 13:36:44.277079 1219144 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0414 13:36:44.308092 1219144 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0414 13:36:44.329156 1219144 docker.go:217] disabling cri-docker service (if available) ...
I0414 13:36:44.329233 1219144 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0414 13:36:44.351793 1219144 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0414 13:36:44.373409 1219144 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0414 13:36:44.532735 1219144 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0414 13:36:44.751084 1219144 docker.go:233] disabling docker service ...
I0414 13:36:44.751169 1219144 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0414 13:36:44.772639 1219144 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0414 13:36:44.792519 1219144 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0414 13:36:45.030190 1219144 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0414 13:36:45.226994 1219144 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0414 13:36:45.254582 1219144 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0414 13:36:45.280680 1219144 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0414 13:36:45.280752 1219144 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0414 13:36:45.297958 1219144 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0414 13:36:45.298054 1219144 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0414 13:36:45.330986 1219144 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0414 13:36:45.353479 1219144 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0414 13:36:45.373383 1219144 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0414 13:36:45.392458 1219144 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0414 13:36:45.411607 1219144 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0414 13:36:45.411728 1219144 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0414 13:36:45.435105 1219144 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0414 13:36:45.452718 1219144 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0414 13:36:45.601597 1219144 ssh_runner.go:195] Run: sudo systemctl restart crio
I0414 13:36:45.704903 1219144 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0414 13:36:45.704994 1219144 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0414 13:36:45.710555 1219144 start.go:563] Will wait 60s for crictl version
I0414 13:36:45.710656 1219144 ssh_runner.go:195] Run: which crictl
I0414 13:36:45.715950 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0414 13:36:45.764319 1219144 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0414 13:36:45.764424 1219144 ssh_runner.go:195] Run: crio --version
I0414 13:36:45.799041 1219144 ssh_runner.go:195] Run: crio --version
I0414 13:36:45.832921 1219144 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0414 13:36:45.834632 1219144 main.go:141] libmachine: (old-k8s-version-966509) Calling .GetIP
I0414 13:36:45.838350 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:45.838893 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3e:6b:50", ip: ""} in network mk-old-k8s-version-966509: {Iface:virbr3 ExpiryTime:2025-04-14 14:36:33 +0000 UTC Type:0 Mac:52:54:00:3e:6b:50 Iaid: IPaddr:192.168.61.227 Prefix:24 Hostname:old-k8s-version-966509 Clientid:01:52:54:00:3e:6b:50}
I0414 13:36:45.838933 1219144 main.go:141] libmachine: (old-k8s-version-966509) DBG | domain old-k8s-version-966509 has defined IP address 192.168.61.227 and MAC address 52:54:00:3e:6b:50 in network mk-old-k8s-version-966509
I0414 13:36:45.839180 1219144 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0414 13:36:45.843466 1219144 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0414 13:36:45.857568 1219144 kubeadm.go:883] updating cluster {Name:old-k8s-version-966509 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-
version-966509 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.227 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountU
ID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0414 13:36:45.857712 1219144 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0414 13:36:45.857774 1219144 ssh_runner.go:195] Run: sudo crictl images --output json
I0414 13:36:45.901114 1219144 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0414 13:36:45.901204 1219144 ssh_runner.go:195] Run: which lz4
I0414 13:36:45.906068 1219144 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0414 13:36:45.911106 1219144 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0414 13:36:45.911137 1219144 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20384-1167927/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0414 13:36:47.705817 1219144 crio.go:462] duration metric: took 1.799793737s to copy over tarball
I0414 13:36:47.705903 1219144 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0414 13:36:50.724160 1219144 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.018229212s)
I0414 13:36:50.724190 1219144 crio.go:469] duration metric: took 3.018337559s to extract the tarball
I0414 13:36:50.724210 1219144 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0414 13:36:50.771017 1219144 ssh_runner.go:195] Run: sudo crictl images --output json
I0414 13:36:50.818714 1219144 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0414 13:36:50.818746 1219144 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0414 13:36:50.818836 1219144 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0414 13:36:50.818861 1219144 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0414 13:36:50.818894 1219144 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0414 13:36:50.818922 1219144 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0414 13:36:50.818931 1219144 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0414 13:36:50.818958 1219144 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0414 13:36:50.818995 1219144 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0414 13:36:50.819036 1219144 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0414 13:36:50.820619 1219144 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0414 13:36:50.820647 1219144 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0414 13:36:50.820689 1219144 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0414 13:36:50.820658 1219144 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0414 13:36:50.821205 1219144 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0414 13:36:50.821221 1219144 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0414 13:36:50.821232 1219144 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0414 13:36:50.821235 1219144 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0414 13:36:50.970900 1219144 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0414 13:36:50.985819 1219144 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0414 13:36:50.985967 1219144 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0414 13:36:50.992645 1219144 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0414 13:36:50.993132 1219144 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0414 13:36:50.997076 1219144 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0414 13:36:51.030948 1219144 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0414 13:36:51.085970 1219144 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0414 13:36:51.086059 1219144 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0414 13:36:51.086120 1219144 ssh_runner.go:195] Run: which crictl
I0414 13:36:51.146664 1219144 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0414 13:36:51.146725 1219144 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0414 13:36:51.146793 1219144 ssh_runner.go:195] Run: which crictl
I0414 13:36:51.147926 1219144 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0414 13:36:51.147981 1219144 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0414 13:36:51.148049 1219144 ssh_runner.go:195] Run: which crictl
I0414 13:36:51.178493 1219144 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0414 13:36:51.178557 1219144 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0414 13:36:51.178496 1219144 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0414 13:36:51.178610 1219144 ssh_runner.go:195] Run: which crictl
I0414 13:36:51.178625 1219144 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0414 13:36:51.178693 1219144 ssh_runner.go:195] Run: which crictl
I0414 13:36:51.182325 1219144 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0414 13:36:51.182382 1219144 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0414 13:36:51.182433 1219144 ssh_runner.go:195] Run: which crictl
I0414 13:36:51.186121 1219144 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0414 13:36:51.186179 1219144 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0414 13:36:51.186217 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0414 13:36:51.186227 1219144 ssh_runner.go:195] Run: which crictl
I0414 13:36:51.186408 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0414 13:36:51.186415 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0414 13:36:51.190207 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0414 13:36:51.190305 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0414 13:36:51.198572 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0414 13:36:51.313867 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0414 13:36:51.313878 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0414 13:36:51.330571 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0414 13:36:51.336437 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0414 13:36:51.348184 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0414 13:36:51.348223 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0414 13:36:51.348282 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0414 13:36:51.508370 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0414 13:36:51.508420 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0414 13:36:51.508388 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0414 13:36:51.508482 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0414 13:36:51.524594 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0414 13:36:51.524673 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0414 13:36:51.524690 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0414 13:36:51.668769 1219144 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20384-1167927/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0414 13:36:51.668840 1219144 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0414 13:36:51.686575 1219144 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20384-1167927/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0414 13:36:51.686645 1219144 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20384-1167927/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0414 13:36:51.686688 1219144 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20384-1167927/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0414 13:36:51.695209 1219144 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20384-1167927/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0414 13:36:51.695258 1219144 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20384-1167927/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0414 13:36:51.716304 1219144 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20384-1167927/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0414 13:36:52.738660 1219144 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0414 13:36:52.883689 1219144 cache_images.go:92] duration metric: took 2.064921628s to LoadCachedImages
W0414 13:36:52.883800 1219144 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20384-1167927/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20384-1167927/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I0414 13:36:52.883818 1219144 kubeadm.go:934] updating node { 192.168.61.227 8443 v1.20.0 crio true true} ...
I0414 13:36:52.883931 1219144 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-966509 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.227
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-966509 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0414 13:36:52.884022 1219144 ssh_runner.go:195] Run: crio config
I0414 13:36:52.936981 1219144 cni.go:84] Creating CNI manager for ""
I0414 13:36:52.937016 1219144 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0414 13:36:52.937032 1219144 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0414 13:36:52.937063 1219144 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.227 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-966509 NodeName:old-k8s-version-966509 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.227"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.227 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0414 13:36:52.937242 1219144 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.227
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-966509"
kubeletExtraArgs:
node-ip: 192.168.61.227
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.227"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0414 13:36:52.937349 1219144 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0414 13:36:52.948058 1219144 binaries.go:44] Found k8s binaries, skipping transfer
I0414 13:36:52.948152 1219144 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0414 13:36:52.958374 1219144 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0414 13:36:52.977198 1219144 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0414 13:36:52.996256 1219144 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0414 13:36:53.019522 1219144 ssh_runner.go:195] Run: grep 192.168.61.227 control-plane.minikube.internal$ /etc/hosts
I0414 13:36:53.024544 1219144 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.227 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0414 13:36:53.039316 1219144 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0414 13:36:53.161921 1219144 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0414 13:36:53.180557 1219144 certs.go:68] Setting up /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509 for IP: 192.168.61.227
I0414 13:36:53.180584 1219144 certs.go:194] generating shared ca certs ...
I0414 13:36:53.180615 1219144 certs.go:226] acquiring lock for ca certs: {Name:mkf843fc5ec8174e0b98797f754d5d9eb6327b5a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 13:36:53.180797 1219144 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20384-1167927/.minikube/ca.key
I0414 13:36:53.180835 1219144 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20384-1167927/.minikube/proxy-client-ca.key
I0414 13:36:53.180846 1219144 certs.go:256] generating profile certs ...
I0414 13:36:53.180903 1219144 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/client.key
I0414 13:36:53.180916 1219144 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/client.crt with IP's: []
I0414 13:36:53.338412 1219144 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/client.crt ...
I0414 13:36:53.338447 1219144 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/client.crt: {Name:mk7b24a388c6ee9adbc0642aae7bc1daf3ab8786 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 13:36:53.338672 1219144 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/client.key ...
I0414 13:36:53.338696 1219144 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/client.key: {Name:mk8647deffad8dec1bd3919a89d9a17086df5abe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 13:36:53.338806 1219144 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/apiserver.key.c3cdf645
I0414 13:36:53.338831 1219144 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/apiserver.crt.c3cdf645 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.227]
I0414 13:36:53.586142 1219144 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/apiserver.crt.c3cdf645 ...
I0414 13:36:53.586184 1219144 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/apiserver.crt.c3cdf645: {Name:mk043f45a7c3125abf9a19446894d9548a4ae0a6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 13:36:53.595916 1219144 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/apiserver.key.c3cdf645 ...
I0414 13:36:53.595965 1219144 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/apiserver.key.c3cdf645: {Name:mke70fbb4c1194bab5d0b89416f347c6874d9bce Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 13:36:53.596117 1219144 certs.go:381] copying /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/apiserver.crt.c3cdf645 -> /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/apiserver.crt
I0414 13:36:53.596234 1219144 certs.go:385] copying /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/apiserver.key.c3cdf645 -> /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/apiserver.key
I0414 13:36:53.596319 1219144 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/proxy-client.key
I0414 13:36:53.596349 1219144 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/proxy-client.crt with IP's: []
I0414 13:36:53.752655 1219144 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/proxy-client.crt ...
I0414 13:36:53.752691 1219144 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/proxy-client.crt: {Name:mk598716f9ad4ef551c2a36e028320375e528cc3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 13:36:53.766007 1219144 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/proxy-client.key ...
I0414 13:36:53.766052 1219144 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/proxy-client.key: {Name:mka6774a43395a2ea38d7bfe258f08f4a4f5a394 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0414 13:36:53.766358 1219144 certs.go:484] found cert: /home/jenkins/minikube-integration/20384-1167927/.minikube/certs/1175746.pem (1338 bytes)
W0414 13:36:53.766413 1219144 certs.go:480] ignoring /home/jenkins/minikube-integration/20384-1167927/.minikube/certs/1175746_empty.pem, impossibly tiny 0 bytes
I0414 13:36:53.766426 1219144 certs.go:484] found cert: /home/jenkins/minikube-integration/20384-1167927/.minikube/certs/ca-key.pem (1675 bytes)
I0414 13:36:53.766458 1219144 certs.go:484] found cert: /home/jenkins/minikube-integration/20384-1167927/.minikube/certs/ca.pem (1078 bytes)
I0414 13:36:53.766487 1219144 certs.go:484] found cert: /home/jenkins/minikube-integration/20384-1167927/.minikube/certs/cert.pem (1123 bytes)
I0414 13:36:53.766520 1219144 certs.go:484] found cert: /home/jenkins/minikube-integration/20384-1167927/.minikube/certs/key.pem (1675 bytes)
I0414 13:36:53.766585 1219144 certs.go:484] found cert: /home/jenkins/minikube-integration/20384-1167927/.minikube/files/etc/ssl/certs/11757462.pem (1708 bytes)
I0414 13:36:53.767520 1219144 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20384-1167927/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0414 13:36:53.796003 1219144 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20384-1167927/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0414 13:36:53.824604 1219144 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20384-1167927/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0414 13:36:53.853438 1219144 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20384-1167927/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0414 13:36:53.882034 1219144 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0414 13:36:53.910641 1219144 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0414 13:36:53.940189 1219144 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0414 13:36:53.966542 1219144 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20384-1167927/.minikube/profiles/old-k8s-version-966509/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0414 13:36:53.994424 1219144 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20384-1167927/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0414 13:36:54.030193 1219144 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20384-1167927/.minikube/certs/1175746.pem --> /usr/share/ca-certificates/1175746.pem (1338 bytes)
I0414 13:36:54.063017 1219144 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20384-1167927/.minikube/files/etc/ssl/certs/11757462.pem --> /usr/share/ca-certificates/11757462.pem (1708 bytes)
I0414 13:36:54.096810 1219144 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0414 13:36:54.125560 1219144 ssh_runner.go:195] Run: openssl version
I0414 13:36:54.135129 1219144 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0414 13:36:54.149872 1219144 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0414 13:36:54.154881 1219144 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 14 12:20 /usr/share/ca-certificates/minikubeCA.pem
I0414 13:36:54.154976 1219144 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0414 13:36:54.161441 1219144 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0414 13:36:54.173596 1219144 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1175746.pem && ln -fs /usr/share/ca-certificates/1175746.pem /etc/ssl/certs/1175746.pem"
I0414 13:36:54.186345 1219144 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1175746.pem
I0414 13:36:54.191959 1219144 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 14 12:27 /usr/share/ca-certificates/1175746.pem
I0414 13:36:54.192053 1219144 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1175746.pem
I0414 13:36:54.198844 1219144 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1175746.pem /etc/ssl/certs/51391683.0"
I0414 13:36:54.213143 1219144 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11757462.pem && ln -fs /usr/share/ca-certificates/11757462.pem /etc/ssl/certs/11757462.pem"
I0414 13:36:54.226906 1219144 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11757462.pem
I0414 13:36:54.231891 1219144 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 14 12:27 /usr/share/ca-certificates/11757462.pem
I0414 13:36:54.231974 1219144 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11757462.pem
I0414 13:36:54.238607 1219144 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/11757462.pem /etc/ssl/certs/3ec20f2e.0"
I0414 13:36:54.251081 1219144 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0414 13:36:54.255749 1219144 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0414 13:36:54.256213 1219144 kubeadm.go:392] StartCluster: {Name:old-k8s-version-966509 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-ver
sion-966509 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.227 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:
docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0414 13:36:54.258650 1219144 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0414 13:36:54.258730 1219144 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0414 13:36:54.297324 1219144 cri.go:89] found id: ""
I0414 13:36:54.297445 1219144 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0414 13:36:54.311781 1219144 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0414 13:36:54.323135 1219144 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0414 13:36:54.333661 1219144 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0414 13:36:54.333691 1219144 kubeadm.go:157] found existing configuration files:
I0414 13:36:54.333740 1219144 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0414 13:36:54.343740 1219144 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0414 13:36:54.343822 1219144 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0414 13:36:54.355368 1219144 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0414 13:36:54.371034 1219144 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0414 13:36:54.371114 1219144 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0414 13:36:54.383265 1219144 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0414 13:36:54.397316 1219144 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0414 13:36:54.397382 1219144 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0414 13:36:54.408217 1219144 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0414 13:36:54.419226 1219144 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0414 13:36:54.419326 1219144 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0414 13:36:54.430574 1219144 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0414 13:36:54.575605 1219144 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0414 13:36:54.575700 1219144 kubeadm.go:310] [preflight] Running pre-flight checks
I0414 13:36:54.730808 1219144 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0414 13:36:54.730982 1219144 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0414 13:36:54.731162 1219144 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0414 13:36:54.973894 1219144 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0414 13:36:54.976187 1219144 out.go:235] - Generating certificates and keys ...
I0414 13:36:54.976325 1219144 kubeadm.go:310] [certs] Using existing ca certificate authority
I0414 13:36:54.976431 1219144 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0414 13:36:55.271931 1219144 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0414 13:36:55.563713 1219144 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0414 13:36:55.700416 1219144 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0414 13:36:55.889666 1219144 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0414 13:36:56.039956 1219144 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0414 13:36:56.040256 1219144 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-966509] and IPs [192.168.61.227 127.0.0.1 ::1]
I0414 13:36:56.272184 1219144 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0414 13:36:56.272445 1219144 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-966509] and IPs [192.168.61.227 127.0.0.1 ::1]
I0414 13:36:56.474255 1219144 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0414 13:36:56.754040 1219144 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0414 13:36:56.920664 1219144 kubeadm.go:310] [certs] Generating "sa" key and public key
I0414 13:36:56.921017 1219144 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0414 13:36:57.007139 1219144 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0414 13:36:57.278871 1219144 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0414 13:36:57.528177 1219144 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0414 13:36:57.950090 1219144 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0414 13:36:57.977755 1219144 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0414 13:36:57.979471 1219144 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0414 13:36:57.979568 1219144 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0414 13:36:58.150839 1219144 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0414 13:36:58.153461 1219144 out.go:235] - Booting up control plane ...
I0414 13:36:58.153624 1219144 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0414 13:36:58.167983 1219144 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0414 13:36:58.169501 1219144 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0414 13:36:58.170951 1219144 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0414 13:36:58.177917 1219144 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0414 13:37:38.177579 1219144 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0414 13:37:38.177713 1219144 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 13:37:38.178044 1219144 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 13:37:43.178771 1219144 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 13:37:43.179069 1219144 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 13:37:53.179743 1219144 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 13:37:53.180032 1219144 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 13:38:13.180854 1219144 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 13:38:13.181156 1219144 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 13:38:53.180704 1219144 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 13:38:53.181001 1219144 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 13:38:53.181094 1219144 kubeadm.go:310]
I0414 13:38:53.181170 1219144 kubeadm.go:310] Unfortunately, an error has occurred:
I0414 13:38:53.181229 1219144 kubeadm.go:310] timed out waiting for the condition
I0414 13:38:53.181254 1219144 kubeadm.go:310]
I0414 13:38:53.181315 1219144 kubeadm.go:310] This error is likely caused by:
I0414 13:38:53.181366 1219144 kubeadm.go:310] - The kubelet is not running
I0414 13:38:53.181511 1219144 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0414 13:38:53.181522 1219144 kubeadm.go:310]
I0414 13:38:53.181670 1219144 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0414 13:38:53.181737 1219144 kubeadm.go:310] - 'systemctl status kubelet'
I0414 13:38:53.181783 1219144 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0414 13:38:53.181795 1219144 kubeadm.go:310]
I0414 13:38:53.181929 1219144 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0414 13:38:53.182074 1219144 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0414 13:38:53.182099 1219144 kubeadm.go:310]
I0414 13:38:53.182230 1219144 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0414 13:38:53.182351 1219144 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0414 13:38:53.182475 1219144 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0414 13:38:53.182582 1219144 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0414 13:38:53.182591 1219144 kubeadm.go:310]
I0414 13:38:53.182744 1219144 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0414 13:38:53.182879 1219144 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0414 13:38:53.182971 1219144 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0414 13:38:53.183162 1219144 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-966509] and IPs [192.168.61.227 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-966509] and IPs [192.168.61.227 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-966509] and IPs [192.168.61.227 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-966509] and IPs [192.168.61.227 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0414 13:38:53.183214 1219144 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0414 13:38:55.474794 1219144 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.291548781s)
I0414 13:38:55.474876 1219144 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0414 13:38:55.490427 1219144 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0414 13:38:55.501122 1219144 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0414 13:38:55.501145 1219144 kubeadm.go:157] found existing configuration files:
I0414 13:38:55.501194 1219144 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0414 13:38:55.511426 1219144 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0414 13:38:55.511491 1219144 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0414 13:38:55.522381 1219144 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0414 13:38:55.532424 1219144 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0414 13:38:55.532495 1219144 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0414 13:38:55.542331 1219144 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0414 13:38:55.552220 1219144 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0414 13:38:55.552299 1219144 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0414 13:38:55.562818 1219144 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0414 13:38:55.573159 1219144 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0414 13:38:55.573225 1219144 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0414 13:38:55.584213 1219144 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0414 13:38:55.657642 1219144 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0414 13:38:55.657731 1219144 kubeadm.go:310] [preflight] Running pre-flight checks
I0414 13:38:55.801190 1219144 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0414 13:38:55.801353 1219144 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0414 13:38:55.801530 1219144 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0414 13:38:55.999203 1219144 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0414 13:38:56.002653 1219144 out.go:235] - Generating certificates and keys ...
I0414 13:38:56.002785 1219144 kubeadm.go:310] [certs] Using existing ca certificate authority
I0414 13:38:56.002865 1219144 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0414 13:38:56.003020 1219144 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0414 13:38:56.003141 1219144 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0414 13:38:56.003253 1219144 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0414 13:38:56.003348 1219144 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0414 13:38:56.003431 1219144 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0414 13:38:56.003524 1219144 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0414 13:38:56.003642 1219144 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0414 13:38:56.003773 1219144 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0414 13:38:56.003850 1219144 kubeadm.go:310] [certs] Using the existing "sa" key
I0414 13:38:56.003916 1219144 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0414 13:38:56.390544 1219144 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0414 13:38:56.617343 1219144 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0414 13:38:56.828025 1219144 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0414 13:38:56.943333 1219144 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0414 13:38:56.960215 1219144 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0414 13:38:56.961425 1219144 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0414 13:38:56.961505 1219144 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0414 13:38:57.121377 1219144 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0414 13:38:57.124264 1219144 out.go:235] - Booting up control plane ...
I0414 13:38:57.124418 1219144 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0414 13:38:57.131617 1219144 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0414 13:38:57.133015 1219144 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0414 13:38:57.133829 1219144 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0414 13:38:57.143425 1219144 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0414 13:39:37.144786 1219144 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0414 13:39:37.145156 1219144 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 13:39:37.145381 1219144 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 13:39:42.146257 1219144 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 13:39:42.146505 1219144 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 13:39:52.147045 1219144 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 13:39:52.147224 1219144 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 13:40:12.148359 1219144 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 13:40:12.148600 1219144 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 13:40:52.148136 1219144 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0414 13:40:52.148410 1219144 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0414 13:40:52.148429 1219144 kubeadm.go:310]
I0414 13:40:52.148495 1219144 kubeadm.go:310] Unfortunately, an error has occurred:
I0414 13:40:52.148546 1219144 kubeadm.go:310] timed out waiting for the condition
I0414 13:40:52.148558 1219144 kubeadm.go:310]
I0414 13:40:52.148600 1219144 kubeadm.go:310] This error is likely caused by:
I0414 13:40:52.148641 1219144 kubeadm.go:310] - The kubelet is not running
I0414 13:40:52.148780 1219144 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0414 13:40:52.148790 1219144 kubeadm.go:310]
I0414 13:40:52.148974 1219144 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0414 13:40:52.149033 1219144 kubeadm.go:310] - 'systemctl status kubelet'
I0414 13:40:52.149073 1219144 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0414 13:40:52.149081 1219144 kubeadm.go:310]
I0414 13:40:52.149201 1219144 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0414 13:40:52.149333 1219144 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0414 13:40:52.149343 1219144 kubeadm.go:310]
I0414 13:40:52.149511 1219144 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0414 13:40:52.149590 1219144 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0414 13:40:52.149693 1219144 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0414 13:40:52.149808 1219144 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0414 13:40:52.149826 1219144 kubeadm.go:310]
I0414 13:40:52.150131 1219144 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0414 13:40:52.150280 1219144 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0414 13:40:52.150404 1219144 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0414 13:40:52.150489 1219144 kubeadm.go:394] duration metric: took 3m57.894675447s to StartCluster
I0414 13:40:52.150559 1219144 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0414 13:40:52.150618 1219144 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0414 13:40:52.187812 1219144 cri.go:89] found id: ""
I0414 13:40:52.187849 1219144 logs.go:282] 0 containers: []
W0414 13:40:52.187861 1219144 logs.go:284] No container was found matching "kube-apiserver"
I0414 13:40:52.187870 1219144 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0414 13:40:52.187932 1219144 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0414 13:40:52.223693 1219144 cri.go:89] found id: ""
I0414 13:40:52.223727 1219144 logs.go:282] 0 containers: []
W0414 13:40:52.223736 1219144 logs.go:284] No container was found matching "etcd"
I0414 13:40:52.223742 1219144 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0414 13:40:52.223797 1219144 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0414 13:40:52.257735 1219144 cri.go:89] found id: ""
I0414 13:40:52.257769 1219144 logs.go:282] 0 containers: []
W0414 13:40:52.257779 1219144 logs.go:284] No container was found matching "coredns"
I0414 13:40:52.257785 1219144 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0414 13:40:52.257845 1219144 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0414 13:40:52.296712 1219144 cri.go:89] found id: ""
I0414 13:40:52.296742 1219144 logs.go:282] 0 containers: []
W0414 13:40:52.296750 1219144 logs.go:284] No container was found matching "kube-scheduler"
I0414 13:40:52.296757 1219144 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0414 13:40:52.296825 1219144 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0414 13:40:52.333394 1219144 cri.go:89] found id: ""
I0414 13:40:52.333433 1219144 logs.go:282] 0 containers: []
W0414 13:40:52.333446 1219144 logs.go:284] No container was found matching "kube-proxy"
I0414 13:40:52.333465 1219144 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0414 13:40:52.333536 1219144 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0414 13:40:52.371502 1219144 cri.go:89] found id: ""
I0414 13:40:52.371539 1219144 logs.go:282] 0 containers: []
W0414 13:40:52.371548 1219144 logs.go:284] No container was found matching "kube-controller-manager"
I0414 13:40:52.371554 1219144 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0414 13:40:52.371611 1219144 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0414 13:40:52.409666 1219144 cri.go:89] found id: ""
I0414 13:40:52.409706 1219144 logs.go:282] 0 containers: []
W0414 13:40:52.409718 1219144 logs.go:284] No container was found matching "kindnet"
I0414 13:40:52.409733 1219144 logs.go:123] Gathering logs for describe nodes ...
I0414 13:40:52.409747 1219144 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0414 13:40:52.533551 1219144 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0414 13:40:52.533582 1219144 logs.go:123] Gathering logs for CRI-O ...
I0414 13:40:52.533599 1219144 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0414 13:40:52.638677 1219144 logs.go:123] Gathering logs for container status ...
I0414 13:40:52.638733 1219144 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0414 13:40:52.682532 1219144 logs.go:123] Gathering logs for kubelet ...
I0414 13:40:52.682569 1219144 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0414 13:40:52.755405 1219144 logs.go:123] Gathering logs for dmesg ...
I0414 13:40:52.755457 1219144 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
W0414 13:40:52.770801 1219144 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0414 13:40:52.770921 1219144 out.go:270] *
*
W0414 13:40:52.771021 1219144 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0414 13:40:52.771046 1219144 out.go:270] *
*
W0414 13:40:52.772218 1219144 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0414 13:40:52.776191 1219144 out.go:201]
W0414 13:40:52.777832 1219144 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0414 13:40:52.777907 1219144 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0414 13:40:52.777955 1219144 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0414 13:40:52.779543 1219144 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-966509 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-966509 -n old-k8s-version-966509
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-966509 -n old-k8s-version-966509: exit status 6 (267.216709ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0414 13:40:53.097853 1222673 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-966509" does not appear in /home/jenkins/minikube-integration/20384-1167927/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-966509" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (293.03s)