=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-467349 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-467349 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m43.059454472s)
-- stdout --
* [old-k8s-version-467349] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19531
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19531-13056/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19531-13056/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-467349" primary control-plane node in "old-k8s-version-467349" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0829 19:25:25.473814 72476 out.go:345] Setting OutFile to fd 1 ...
I0829 19:25:25.473932 72476 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0829 19:25:25.473941 72476 out.go:358] Setting ErrFile to fd 2...
I0829 19:25:25.473945 72476 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0829 19:25:25.474120 72476 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19531-13056/.minikube/bin
I0829 19:25:25.474664 72476 out.go:352] Setting JSON to false
I0829 19:25:25.475718 72476 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":7672,"bootTime":1724951853,"procs":304,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1067-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0829 19:25:25.475773 72476 start.go:139] virtualization: kvm guest
I0829 19:25:25.477851 72476 out.go:177] * [old-k8s-version-467349] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0829 19:25:25.479013 72476 out.go:177] - MINIKUBE_LOCATION=19531
I0829 19:25:25.479033 72476 notify.go:220] Checking for updates...
I0829 19:25:25.481179 72476 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0829 19:25:25.482174 72476 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19531-13056/kubeconfig
I0829 19:25:25.483248 72476 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19531-13056/.minikube
I0829 19:25:25.484325 72476 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0829 19:25:25.485263 72476 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0829 19:25:25.486637 72476 config.go:182] Loaded profile config "bridge-633326": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0829 19:25:25.486742 72476 config.go:182] Loaded profile config "enable-default-cni-633326": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0829 19:25:25.486848 72476 config.go:182] Loaded profile config "flannel-633326": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0829 19:25:25.486955 72476 driver.go:392] Setting default libvirt URI to qemu:///system
I0829 19:25:25.523175 72476 out.go:177] * Using the kvm2 driver based on user configuration
I0829 19:25:25.524293 72476 start.go:297] selected driver: kvm2
I0829 19:25:25.524305 72476 start.go:901] validating driver "kvm2" against <nil>
I0829 19:25:25.524323 72476 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0829 19:25:25.524962 72476 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0829 19:25:25.525024 72476 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19531-13056/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0829 19:25:25.540470 72476 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0829 19:25:25.540520 72476 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0829 19:25:25.540796 72476 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0829 19:25:25.540834 72476 cni.go:84] Creating CNI manager for ""
I0829 19:25:25.540845 72476 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0829 19:25:25.540860 72476 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0829 19:25:25.540921 72476 start.go:340] cluster config:
{Name:old-k8s-version-467349 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-467349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0829 19:25:25.541063 72476 iso.go:125] acquiring lock: {Name:mk2cdea98b92f02678fa274ca90f4ac4deebad66 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0829 19:25:25.542774 72476 out.go:177] * Starting "old-k8s-version-467349" primary control-plane node in "old-k8s-version-467349" cluster
I0829 19:25:25.543836 72476 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0829 19:25:25.543872 72476 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19531-13056/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0829 19:25:25.543881 72476 cache.go:56] Caching tarball of preloaded images
I0829 19:25:25.543949 72476 preload.go:172] Found /home/jenkins/minikube-integration/19531-13056/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0829 19:25:25.543959 72476 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0829 19:25:25.544041 72476 profile.go:143] Saving config to /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/config.json ...
I0829 19:25:25.544063 72476 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/config.json: {Name:mk1a8603f6895464bc50ee43f2d31972c78e60ee Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 19:25:25.544208 72476 start.go:360] acquireMachinesLock for old-k8s-version-467349: {Name:mk38acfe6f3224efe5d1f4856bd0bbbbc001f8f7 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0829 19:25:36.946969 72476 start.go:364] duration metric: took 11.40273002s to acquireMachinesLock for "old-k8s-version-467349"
I0829 19:25:36.947035 72476 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-467349 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-467349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0829 19:25:36.947160 72476 start.go:125] createHost starting for "" (driver="kvm2")
I0829 19:25:36.949166 72476 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0829 19:25:36.949386 72476 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0829 19:25:36.949443 72476 main.go:141] libmachine: Launching plugin server for driver kvm2
I0829 19:25:36.966686 72476 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46621
I0829 19:25:36.967141 72476 main.go:141] libmachine: () Calling .GetVersion
I0829 19:25:36.967812 72476 main.go:141] libmachine: Using API Version 1
I0829 19:25:36.967848 72476 main.go:141] libmachine: () Calling .SetConfigRaw
I0829 19:25:36.968255 72476 main.go:141] libmachine: () Calling .GetMachineName
I0829 19:25:36.968464 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetMachineName
I0829 19:25:36.968628 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .DriverName
I0829 19:25:36.968774 72476 start.go:159] libmachine.API.Create for "old-k8s-version-467349" (driver="kvm2")
I0829 19:25:36.968806 72476 client.go:168] LocalClient.Create starting
I0829 19:25:36.968845 72476 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19531-13056/.minikube/certs/ca.pem
I0829 19:25:36.968877 72476 main.go:141] libmachine: Decoding PEM data...
I0829 19:25:36.968907 72476 main.go:141] libmachine: Parsing certificate...
I0829 19:25:36.968973 72476 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19531-13056/.minikube/certs/cert.pem
I0829 19:25:36.968997 72476 main.go:141] libmachine: Decoding PEM data...
I0829 19:25:36.969008 72476 main.go:141] libmachine: Parsing certificate...
I0829 19:25:36.969030 72476 main.go:141] libmachine: Running pre-create checks...
I0829 19:25:36.969039 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .PreCreateCheck
I0829 19:25:36.969421 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetConfigRaw
I0829 19:25:36.969819 72476 main.go:141] libmachine: Creating machine...
I0829 19:25:36.969833 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .Create
I0829 19:25:36.970041 72476 main.go:141] libmachine: (old-k8s-version-467349) Creating KVM machine...
I0829 19:25:36.971496 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found existing default KVM network
I0829 19:25:36.972784 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:36.972609 73485 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:1c:4e:ba} reservation:<nil>}
I0829 19:25:36.973833 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:36.973734 73485 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:27:29:78} reservation:<nil>}
I0829 19:25:36.974783 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:36.974683 73485 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:0e:7b:af} reservation:<nil>}
I0829 19:25:36.976039 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:36.975918 73485 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00037f170}
I0829 19:25:36.976099 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | created network xml:
I0829 19:25:36.976120 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | <network>
I0829 19:25:36.976140 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | <name>mk-old-k8s-version-467349</name>
I0829 19:25:36.976155 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | <dns enable='no'/>
I0829 19:25:36.976168 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG |
I0829 19:25:36.976186 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0829 19:25:36.976200 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | <dhcp>
I0829 19:25:36.976212 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0829 19:25:36.976230 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | </dhcp>
I0829 19:25:36.976245 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | </ip>
I0829 19:25:36.976256 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG |
I0829 19:25:36.976272 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | </network>
I0829 19:25:36.976317 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG |
I0829 19:25:36.981242 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | trying to create private KVM network mk-old-k8s-version-467349 192.168.72.0/24...
I0829 19:25:37.066247 72476 main.go:141] libmachine: (old-k8s-version-467349) Setting up store path in /home/jenkins/minikube-integration/19531-13056/.minikube/machines/old-k8s-version-467349 ...
I0829 19:25:37.066366 72476 main.go:141] libmachine: (old-k8s-version-467349) Building disk image from file:///home/jenkins/minikube-integration/19531-13056/.minikube/cache/iso/amd64/minikube-v1.33.1-1724775098-19521-amd64.iso
I0829 19:25:37.066379 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | private KVM network mk-old-k8s-version-467349 192.168.72.0/24 created
I0829 19:25:37.066398 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:37.064896 73485 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19531-13056/.minikube
I0829 19:25:37.066417 72476 main.go:141] libmachine: (old-k8s-version-467349) Downloading /home/jenkins/minikube-integration/19531-13056/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19531-13056/.minikube/cache/iso/amd64/minikube-v1.33.1-1724775098-19521-amd64.iso...
I0829 19:25:37.354496 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:37.354256 73485 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19531-13056/.minikube/machines/old-k8s-version-467349/id_rsa...
I0829 19:25:37.399265 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:37.399126 73485 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19531-13056/.minikube/machines/old-k8s-version-467349/old-k8s-version-467349.rawdisk...
I0829 19:25:37.399320 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | Writing magic tar header
I0829 19:25:37.399366 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | Writing SSH key tar header
I0829 19:25:37.399403 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:37.399251 73485 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19531-13056/.minikube/machines/old-k8s-version-467349 ...
I0829 19:25:37.399422 72476 main.go:141] libmachine: (old-k8s-version-467349) Setting executable bit set on /home/jenkins/minikube-integration/19531-13056/.minikube/machines/old-k8s-version-467349 (perms=drwx------)
I0829 19:25:37.399453 72476 main.go:141] libmachine: (old-k8s-version-467349) Setting executable bit set on /home/jenkins/minikube-integration/19531-13056/.minikube/machines (perms=drwxr-xr-x)
I0829 19:25:37.399469 72476 main.go:141] libmachine: (old-k8s-version-467349) Setting executable bit set on /home/jenkins/minikube-integration/19531-13056/.minikube (perms=drwxr-xr-x)
I0829 19:25:37.399493 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19531-13056/.minikube/machines/old-k8s-version-467349
I0829 19:25:37.399524 72476 main.go:141] libmachine: (old-k8s-version-467349) Setting executable bit set on /home/jenkins/minikube-integration/19531-13056 (perms=drwxrwxr-x)
I0829 19:25:37.399539 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19531-13056/.minikube/machines
I0829 19:25:37.399552 72476 main.go:141] libmachine: (old-k8s-version-467349) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0829 19:25:37.399567 72476 main.go:141] libmachine: (old-k8s-version-467349) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0829 19:25:37.399583 72476 main.go:141] libmachine: (old-k8s-version-467349) Creating domain...
I0829 19:25:37.399608 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19531-13056/.minikube
I0829 19:25:37.399626 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19531-13056
I0829 19:25:37.399643 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0829 19:25:37.399657 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | Checking permissions on dir: /home/jenkins
I0829 19:25:37.399667 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | Checking permissions on dir: /home
I0829 19:25:37.399680 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | Skipping /home - not owner
I0829 19:25:37.400641 72476 main.go:141] libmachine: (old-k8s-version-467349) define libvirt domain using xml:
I0829 19:25:37.400666 72476 main.go:141] libmachine: (old-k8s-version-467349) <domain type='kvm'>
I0829 19:25:37.400677 72476 main.go:141] libmachine: (old-k8s-version-467349) <name>old-k8s-version-467349</name>
I0829 19:25:37.400685 72476 main.go:141] libmachine: (old-k8s-version-467349) <memory unit='MiB'>2200</memory>
I0829 19:25:37.400707 72476 main.go:141] libmachine: (old-k8s-version-467349) <vcpu>2</vcpu>
I0829 19:25:37.400718 72476 main.go:141] libmachine: (old-k8s-version-467349) <features>
I0829 19:25:37.400728 72476 main.go:141] libmachine: (old-k8s-version-467349) <acpi/>
I0829 19:25:37.400738 72476 main.go:141] libmachine: (old-k8s-version-467349) <apic/>
I0829 19:25:37.400746 72476 main.go:141] libmachine: (old-k8s-version-467349) <pae/>
I0829 19:25:37.400753 72476 main.go:141] libmachine: (old-k8s-version-467349)
I0829 19:25:37.400762 72476 main.go:141] libmachine: (old-k8s-version-467349) </features>
I0829 19:25:37.400768 72476 main.go:141] libmachine: (old-k8s-version-467349) <cpu mode='host-passthrough'>
I0829 19:25:37.400776 72476 main.go:141] libmachine: (old-k8s-version-467349)
I0829 19:25:37.400785 72476 main.go:141] libmachine: (old-k8s-version-467349) </cpu>
I0829 19:25:37.400793 72476 main.go:141] libmachine: (old-k8s-version-467349) <os>
I0829 19:25:37.400812 72476 main.go:141] libmachine: (old-k8s-version-467349) <type>hvm</type>
I0829 19:25:37.400823 72476 main.go:141] libmachine: (old-k8s-version-467349) <boot dev='cdrom'/>
I0829 19:25:37.400831 72476 main.go:141] libmachine: (old-k8s-version-467349) <boot dev='hd'/>
I0829 19:25:37.400847 72476 main.go:141] libmachine: (old-k8s-version-467349) <bootmenu enable='no'/>
I0829 19:25:37.400857 72476 main.go:141] libmachine: (old-k8s-version-467349) </os>
I0829 19:25:37.400869 72476 main.go:141] libmachine: (old-k8s-version-467349) <devices>
I0829 19:25:37.400880 72476 main.go:141] libmachine: (old-k8s-version-467349) <disk type='file' device='cdrom'>
I0829 19:25:37.400894 72476 main.go:141] libmachine: (old-k8s-version-467349) <source file='/home/jenkins/minikube-integration/19531-13056/.minikube/machines/old-k8s-version-467349/boot2docker.iso'/>
I0829 19:25:37.400906 72476 main.go:141] libmachine: (old-k8s-version-467349) <target dev='hdc' bus='scsi'/>
I0829 19:25:37.400923 72476 main.go:141] libmachine: (old-k8s-version-467349) <readonly/>
I0829 19:25:37.400933 72476 main.go:141] libmachine: (old-k8s-version-467349) </disk>
I0829 19:25:37.400946 72476 main.go:141] libmachine: (old-k8s-version-467349) <disk type='file' device='disk'>
I0829 19:25:37.400958 72476 main.go:141] libmachine: (old-k8s-version-467349) <driver name='qemu' type='raw' cache='default' io='threads' />
I0829 19:25:37.400971 72476 main.go:141] libmachine: (old-k8s-version-467349) <source file='/home/jenkins/minikube-integration/19531-13056/.minikube/machines/old-k8s-version-467349/old-k8s-version-467349.rawdisk'/>
I0829 19:25:37.400987 72476 main.go:141] libmachine: (old-k8s-version-467349) <target dev='hda' bus='virtio'/>
I0829 19:25:37.400999 72476 main.go:141] libmachine: (old-k8s-version-467349) </disk>
I0829 19:25:37.401006 72476 main.go:141] libmachine: (old-k8s-version-467349) <interface type='network'>
I0829 19:25:37.401019 72476 main.go:141] libmachine: (old-k8s-version-467349) <source network='mk-old-k8s-version-467349'/>
I0829 19:25:37.401027 72476 main.go:141] libmachine: (old-k8s-version-467349) <model type='virtio'/>
I0829 19:25:37.401054 72476 main.go:141] libmachine: (old-k8s-version-467349) </interface>
I0829 19:25:37.401072 72476 main.go:141] libmachine: (old-k8s-version-467349) <interface type='network'>
I0829 19:25:37.401085 72476 main.go:141] libmachine: (old-k8s-version-467349) <source network='default'/>
I0829 19:25:37.401095 72476 main.go:141] libmachine: (old-k8s-version-467349) <model type='virtio'/>
I0829 19:25:37.401102 72476 main.go:141] libmachine: (old-k8s-version-467349) </interface>
I0829 19:25:37.401108 72476 main.go:141] libmachine: (old-k8s-version-467349) <serial type='pty'>
I0829 19:25:37.401116 72476 main.go:141] libmachine: (old-k8s-version-467349) <target port='0'/>
I0829 19:25:37.401126 72476 main.go:141] libmachine: (old-k8s-version-467349) </serial>
I0829 19:25:37.401135 72476 main.go:141] libmachine: (old-k8s-version-467349) <console type='pty'>
I0829 19:25:37.401150 72476 main.go:141] libmachine: (old-k8s-version-467349) <target type='serial' port='0'/>
I0829 19:25:37.401162 72476 main.go:141] libmachine: (old-k8s-version-467349) </console>
I0829 19:25:37.401174 72476 main.go:141] libmachine: (old-k8s-version-467349) <rng model='virtio'>
I0829 19:25:37.401189 72476 main.go:141] libmachine: (old-k8s-version-467349) <backend model='random'>/dev/random</backend>
I0829 19:25:37.401199 72476 main.go:141] libmachine: (old-k8s-version-467349) </rng>
I0829 19:25:37.401208 72476 main.go:141] libmachine: (old-k8s-version-467349)
I0829 19:25:37.401221 72476 main.go:141] libmachine: (old-k8s-version-467349)
I0829 19:25:37.401237 72476 main.go:141] libmachine: (old-k8s-version-467349) </devices>
I0829 19:25:37.401248 72476 main.go:141] libmachine: (old-k8s-version-467349) </domain>
I0829 19:25:37.401258 72476 main.go:141] libmachine: (old-k8s-version-467349)
I0829 19:25:37.406022 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:7b:b9:5d in network default
I0829 19:25:37.406557 72476 main.go:141] libmachine: (old-k8s-version-467349) Ensuring networks are active...
I0829 19:25:37.406584 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:25:37.407194 72476 main.go:141] libmachine: (old-k8s-version-467349) Ensuring network default is active
I0829 19:25:37.407502 72476 main.go:141] libmachine: (old-k8s-version-467349) Ensuring network mk-old-k8s-version-467349 is active
I0829 19:25:37.408007 72476 main.go:141] libmachine: (old-k8s-version-467349) Getting domain xml...
I0829 19:25:37.408644 72476 main.go:141] libmachine: (old-k8s-version-467349) Creating domain...
I0829 19:25:38.914162 72476 main.go:141] libmachine: (old-k8s-version-467349) Waiting to get IP...
I0829 19:25:38.916497 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:25:38.917155 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | unable to find current IP address of domain old-k8s-version-467349 in network mk-old-k8s-version-467349
I0829 19:25:38.917178 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:38.917057 73485 retry.go:31] will retry after 197.853407ms: waiting for machine to come up
I0829 19:25:39.116449 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:25:39.117118 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | unable to find current IP address of domain old-k8s-version-467349 in network mk-old-k8s-version-467349
I0829 19:25:39.117152 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:39.117059 73485 retry.go:31] will retry after 322.727055ms: waiting for machine to come up
I0829 19:25:39.443958 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:25:39.445684 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | unable to find current IP address of domain old-k8s-version-467349 in network mk-old-k8s-version-467349
I0829 19:25:39.445714 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:39.445651 73485 retry.go:31] will retry after 416.078639ms: waiting for machine to come up
I0829 19:25:40.088408 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:25:40.089030 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | unable to find current IP address of domain old-k8s-version-467349 in network mk-old-k8s-version-467349
I0829 19:25:40.089051 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:40.088997 73485 retry.go:31] will retry after 422.595949ms: waiting for machine to come up
I0829 19:25:40.513727 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:25:40.514296 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | unable to find current IP address of domain old-k8s-version-467349 in network mk-old-k8s-version-467349
I0829 19:25:40.514318 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:40.514253 73485 retry.go:31] will retry after 628.237531ms: waiting for machine to come up
I0829 19:25:41.143945 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:25:41.144568 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | unable to find current IP address of domain old-k8s-version-467349 in network mk-old-k8s-version-467349
I0829 19:25:41.144606 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:41.144534 73485 retry.go:31] will retry after 717.687857ms: waiting for machine to come up
I0829 19:25:41.864595 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:25:41.865127 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | unable to find current IP address of domain old-k8s-version-467349 in network mk-old-k8s-version-467349
I0829 19:25:41.865156 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:41.865072 73485 retry.go:31] will retry after 943.929905ms: waiting for machine to come up
I0829 19:25:42.810538 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:25:42.810975 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | unable to find current IP address of domain old-k8s-version-467349 in network mk-old-k8s-version-467349
I0829 19:25:42.811030 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:42.810954 73485 retry.go:31] will retry after 1.376094879s: waiting for machine to come up
I0829 19:25:44.188846 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:25:44.189473 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | unable to find current IP address of domain old-k8s-version-467349 in network mk-old-k8s-version-467349
I0829 19:25:44.189502 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:44.189430 73485 retry.go:31] will retry after 1.641087137s: waiting for machine to come up
I0829 19:25:45.831793 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:25:45.832319 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | unable to find current IP address of domain old-k8s-version-467349 in network mk-old-k8s-version-467349
I0829 19:25:45.832343 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:45.832240 73485 retry.go:31] will retry after 1.766410372s: waiting for machine to come up
I0829 19:25:47.600049 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:25:47.600586 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | unable to find current IP address of domain old-k8s-version-467349 in network mk-old-k8s-version-467349
I0829 19:25:47.600615 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:47.600543 73485 retry.go:31] will retry after 1.798722294s: waiting for machine to come up
I0829 19:25:49.401603 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:25:49.402023 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | unable to find current IP address of domain old-k8s-version-467349 in network mk-old-k8s-version-467349
I0829 19:25:49.402043 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:49.401985 73485 retry.go:31] will retry after 3.285295428s: waiting for machine to come up
I0829 19:25:52.689026 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:25:52.689521 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | unable to find current IP address of domain old-k8s-version-467349 in network mk-old-k8s-version-467349
I0829 19:25:52.689563 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:52.689497 73485 retry.go:31] will retry after 3.491021675s: waiting for machine to come up
I0829 19:25:56.183088 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:25:56.183494 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | unable to find current IP address of domain old-k8s-version-467349 in network mk-old-k8s-version-467349
I0829 19:25:56.183516 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | I0829 19:25:56.183451 73485 retry.go:31] will retry after 4.603586632s: waiting for machine to come up
I0829 19:26:00.791278 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:00.791841 72476 main.go:141] libmachine: (old-k8s-version-467349) Found IP for machine: 192.168.72.112
I0829 19:26:00.791869 72476 main.go:141] libmachine: (old-k8s-version-467349) Reserving static IP address...
I0829 19:26:00.791885 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has current primary IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:00.792271 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-467349", mac: "52:54:00:1e:26:7c", ip: "192.168.72.112"} in network mk-old-k8s-version-467349
I0829 19:26:00.871628 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | Getting to WaitForSSH function...
I0829 19:26:00.871655 72476 main.go:141] libmachine: (old-k8s-version-467349) Reserved static IP address: 192.168.72.112
I0829 19:26:00.871696 72476 main.go:141] libmachine: (old-k8s-version-467349) Waiting for SSH to be available...
I0829 19:26:00.874710 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:00.875214 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:minikube Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:00.875242 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:00.875404 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | Using SSH client type: external
I0829 19:26:00.875421 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | Using SSH private key: /home/jenkins/minikube-integration/19531-13056/.minikube/machines/old-k8s-version-467349/id_rsa (-rw-------)
I0829 19:26:00.875451 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.112 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19531-13056/.minikube/machines/old-k8s-version-467349/id_rsa -p 22] /usr/bin/ssh <nil>}
I0829 19:26:00.875461 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | About to run SSH command:
I0829 19:26:00.875471 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | exit 0
I0829 19:26:01.002249 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | SSH cmd err, output: <nil>:
I0829 19:26:01.002563 72476 main.go:141] libmachine: (old-k8s-version-467349) KVM machine creation complete!
I0829 19:26:01.002885 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetConfigRaw
I0829 19:26:01.003542 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .DriverName
I0829 19:26:01.003741 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .DriverName
I0829 19:26:01.003909 72476 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0829 19:26:01.003925 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetState
I0829 19:26:01.005207 72476 main.go:141] libmachine: Detecting operating system of created instance...
I0829 19:26:01.005223 72476 main.go:141] libmachine: Waiting for SSH to be available...
I0829 19:26:01.005229 72476 main.go:141] libmachine: Getting to WaitForSSH function...
I0829 19:26:01.005235 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHHostname
I0829 19:26:01.007617 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.007961 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:old-k8s-version-467349 Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:01.007999 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.008100 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHPort
I0829 19:26:01.008271 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHKeyPath
I0829 19:26:01.008433 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHKeyPath
I0829 19:26:01.008553 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHUsername
I0829 19:26:01.008709 72476 main.go:141] libmachine: Using SSH client type: native
I0829 19:26:01.008968 72476 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.112 22 <nil> <nil>}
I0829 19:26:01.008982 72476 main.go:141] libmachine: About to run SSH command:
exit 0
I0829 19:26:01.109699 72476 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0829 19:26:01.109731 72476 main.go:141] libmachine: Detecting the provisioner...
I0829 19:26:01.109739 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHHostname
I0829 19:26:01.112504 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.112853 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:old-k8s-version-467349 Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:01.112891 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.113016 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHPort
I0829 19:26:01.113212 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHKeyPath
I0829 19:26:01.113377 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHKeyPath
I0829 19:26:01.113504 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHUsername
I0829 19:26:01.113652 72476 main.go:141] libmachine: Using SSH client type: native
I0829 19:26:01.113845 72476 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.112 22 <nil> <nil>}
I0829 19:26:01.113860 72476 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0829 19:26:01.214580 72476 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0829 19:26:01.214661 72476 main.go:141] libmachine: found compatible host: buildroot
I0829 19:26:01.214672 72476 main.go:141] libmachine: Provisioning with buildroot...
I0829 19:26:01.214681 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetMachineName
I0829 19:26:01.214951 72476 buildroot.go:166] provisioning hostname "old-k8s-version-467349"
I0829 19:26:01.214973 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetMachineName
I0829 19:26:01.215180 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHHostname
I0829 19:26:01.217778 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.218126 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:old-k8s-version-467349 Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:01.218163 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.218375 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHPort
I0829 19:26:01.218602 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHKeyPath
I0829 19:26:01.218792 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHKeyPath
I0829 19:26:01.218988 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHUsername
I0829 19:26:01.219157 72476 main.go:141] libmachine: Using SSH client type: native
I0829 19:26:01.219365 72476 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.112 22 <nil> <nil>}
I0829 19:26:01.219383 72476 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-467349 && echo "old-k8s-version-467349" | sudo tee /etc/hostname
I0829 19:26:01.332537 72476 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-467349
I0829 19:26:01.332568 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHHostname
I0829 19:26:01.335813 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.336237 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:old-k8s-version-467349 Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:01.336269 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.336535 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHPort
I0829 19:26:01.336778 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHKeyPath
I0829 19:26:01.336962 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHKeyPath
I0829 19:26:01.337147 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHUsername
I0829 19:26:01.337310 72476 main.go:141] libmachine: Using SSH client type: native
I0829 19:26:01.337539 72476 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.112 22 <nil> <nil>}
I0829 19:26:01.337564 72476 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-467349' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-467349/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-467349' | sudo tee -a /etc/hosts;
fi
fi
I0829 19:26:01.446724 72476 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0829 19:26:01.446752 72476 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19531-13056/.minikube CaCertPath:/home/jenkins/minikube-integration/19531-13056/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19531-13056/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19531-13056/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19531-13056/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19531-13056/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19531-13056/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19531-13056/.minikube}
I0829 19:26:01.446790 72476 buildroot.go:174] setting up certificates
I0829 19:26:01.446798 72476 provision.go:84] configureAuth start
I0829 19:26:01.446815 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetMachineName
I0829 19:26:01.447136 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetIP
I0829 19:26:01.449459 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.449810 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:old-k8s-version-467349 Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:01.449837 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.449999 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHHostname
I0829 19:26:01.452344 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.452670 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:old-k8s-version-467349 Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:01.452698 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.452827 72476 provision.go:143] copyHostCerts
I0829 19:26:01.452916 72476 exec_runner.go:144] found /home/jenkins/minikube-integration/19531-13056/.minikube/ca.pem, removing ...
I0829 19:26:01.452937 72476 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19531-13056/.minikube/ca.pem
I0829 19:26:01.453016 72476 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19531-13056/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19531-13056/.minikube/ca.pem (1082 bytes)
I0829 19:26:01.453142 72476 exec_runner.go:144] found /home/jenkins/minikube-integration/19531-13056/.minikube/cert.pem, removing ...
I0829 19:26:01.453153 72476 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19531-13056/.minikube/cert.pem
I0829 19:26:01.453185 72476 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19531-13056/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19531-13056/.minikube/cert.pem (1123 bytes)
I0829 19:26:01.453260 72476 exec_runner.go:144] found /home/jenkins/minikube-integration/19531-13056/.minikube/key.pem, removing ...
I0829 19:26:01.453271 72476 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19531-13056/.minikube/key.pem
I0829 19:26:01.453307 72476 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19531-13056/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19531-13056/.minikube/key.pem (1675 bytes)
I0829 19:26:01.453366 72476 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19531-13056/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19531-13056/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19531-13056/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-467349 san=[127.0.0.1 192.168.72.112 localhost minikube old-k8s-version-467349]
I0829 19:26:01.600377 72476 provision.go:177] copyRemoteCerts
I0829 19:26:01.600437 72476 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0829 19:26:01.600460 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHHostname
I0829 19:26:01.603109 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.603433 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:old-k8s-version-467349 Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:01.603471 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.603626 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHPort
I0829 19:26:01.603818 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHKeyPath
I0829 19:26:01.604015 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHUsername
I0829 19:26:01.604179 72476 sshutil.go:53] new ssh client: &{IP:192.168.72.112 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19531-13056/.minikube/machines/old-k8s-version-467349/id_rsa Username:docker}
I0829 19:26:01.683772 72476 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-13056/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0829 19:26:01.709312 72476 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-13056/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0829 19:26:01.730664 72476 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-13056/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0829 19:26:01.752092 72476 provision.go:87] duration metric: took 305.284546ms to configureAuth
I0829 19:26:01.752121 72476 buildroot.go:189] setting minikube options for container-runtime
I0829 19:26:01.752300 72476 config.go:182] Loaded profile config "old-k8s-version-467349": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0829 19:26:01.752381 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHHostname
I0829 19:26:01.754975 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.755266 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:old-k8s-version-467349 Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:01.755285 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.755488 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHPort
I0829 19:26:01.755741 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHKeyPath
I0829 19:26:01.755899 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHKeyPath
I0829 19:26:01.756033 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHUsername
I0829 19:26:01.756154 72476 main.go:141] libmachine: Using SSH client type: native
I0829 19:26:01.756313 72476 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.112 22 <nil> <nil>}
I0829 19:26:01.756338 72476 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0829 19:26:01.982764 72476 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0829 19:26:01.982801 72476 main.go:141] libmachine: Checking connection to Docker...
I0829 19:26:01.982809 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetURL
I0829 19:26:01.984158 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | Using libvirt version 6000000
I0829 19:26:01.986932 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.987306 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:old-k8s-version-467349 Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:01.987348 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.987473 72476 main.go:141] libmachine: Docker is up and running!
I0829 19:26:01.987487 72476 main.go:141] libmachine: Reticulating splines...
I0829 19:26:01.987494 72476 client.go:171] duration metric: took 25.01868085s to LocalClient.Create
I0829 19:26:01.987517 72476 start.go:167] duration metric: took 25.018743269s to libmachine.API.Create "old-k8s-version-467349"
I0829 19:26:01.987531 72476 start.go:293] postStartSetup for "old-k8s-version-467349" (driver="kvm2")
I0829 19:26:01.987549 72476 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0829 19:26:01.987578 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .DriverName
I0829 19:26:01.987872 72476 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0829 19:26:01.987904 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHHostname
I0829 19:26:01.990068 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.990512 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:old-k8s-version-467349 Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:01.990558 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:01.990731 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHPort
I0829 19:26:01.990963 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHKeyPath
I0829 19:26:01.991119 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHUsername
I0829 19:26:01.991260 72476 sshutil.go:53] new ssh client: &{IP:192.168.72.112 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19531-13056/.minikube/machines/old-k8s-version-467349/id_rsa Username:docker}
I0829 19:26:02.072513 72476 ssh_runner.go:195] Run: cat /etc/os-release
I0829 19:26:02.076601 72476 info.go:137] Remote host: Buildroot 2023.02.9
I0829 19:26:02.076631 72476 filesync.go:126] Scanning /home/jenkins/minikube-integration/19531-13056/.minikube/addons for local assets ...
I0829 19:26:02.076691 72476 filesync.go:126] Scanning /home/jenkins/minikube-integration/19531-13056/.minikube/files for local assets ...
I0829 19:26:02.076772 72476 filesync.go:149] local asset: /home/jenkins/minikube-integration/19531-13056/.minikube/files/etc/ssl/certs/202592.pem -> 202592.pem in /etc/ssl/certs
I0829 19:26:02.076874 72476 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0829 19:26:02.085564 72476 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-13056/.minikube/files/etc/ssl/certs/202592.pem --> /etc/ssl/certs/202592.pem (1708 bytes)
I0829 19:26:02.109139 72476 start.go:296] duration metric: took 121.588549ms for postStartSetup
I0829 19:26:02.109194 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetConfigRaw
I0829 19:26:02.109752 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetIP
I0829 19:26:02.112406 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:02.112689 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:old-k8s-version-467349 Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:02.112717 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:02.112931 72476 profile.go:143] Saving config to /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/config.json ...
I0829 19:26:02.113103 72476 start.go:128] duration metric: took 25.165930793s to createHost
I0829 19:26:02.113124 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHHostname
I0829 19:26:02.115270 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:02.115644 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:old-k8s-version-467349 Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:02.115669 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:02.115812 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHPort
I0829 19:26:02.115961 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHKeyPath
I0829 19:26:02.116120 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHKeyPath
I0829 19:26:02.116259 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHUsername
I0829 19:26:02.116411 72476 main.go:141] libmachine: Using SSH client type: native
I0829 19:26:02.116613 72476 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.112 22 <nil> <nil>}
I0829 19:26:02.116633 72476 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0829 19:26:02.218533 72476 main.go:141] libmachine: SSH cmd err, output: <nil>: 1724959562.190829152
I0829 19:26:02.218561 72476 fix.go:216] guest clock: 1724959562.190829152
I0829 19:26:02.218569 72476 fix.go:229] Guest: 2024-08-29 19:26:02.190829152 +0000 UTC Remote: 2024-08-29 19:26:02.113112803 +0000 UTC m=+36.672631465 (delta=77.716349ms)
I0829 19:26:02.218587 72476 fix.go:200] guest clock delta is within tolerance: 77.716349ms
I0829 19:26:02.218592 72476 start.go:83] releasing machines lock for "old-k8s-version-467349", held for 25.271592507s
I0829 19:26:02.218619 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .DriverName
I0829 19:26:02.218958 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetIP
I0829 19:26:02.221816 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:02.222227 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:old-k8s-version-467349 Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:02.222251 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:02.222442 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .DriverName
I0829 19:26:02.222944 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .DriverName
I0829 19:26:02.223096 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .DriverName
I0829 19:26:02.223160 72476 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0829 19:26:02.223197 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHHostname
I0829 19:26:02.223338 72476 ssh_runner.go:195] Run: cat /version.json
I0829 19:26:02.223367 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHHostname
I0829 19:26:02.225944 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:02.226297 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:old-k8s-version-467349 Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:02.226324 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:02.226344 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:02.226516 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHPort
I0829 19:26:02.226702 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHKeyPath
I0829 19:26:02.226772 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:old-k8s-version-467349 Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:02.226797 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:02.226851 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHUsername
I0829 19:26:02.226947 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHPort
I0829 19:26:02.227018 72476 sshutil.go:53] new ssh client: &{IP:192.168.72.112 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19531-13056/.minikube/machines/old-k8s-version-467349/id_rsa Username:docker}
I0829 19:26:02.227071 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHKeyPath
I0829 19:26:02.227218 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetSSHUsername
I0829 19:26:02.227367 72476 sshutil.go:53] new ssh client: &{IP:192.168.72.112 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19531-13056/.minikube/machines/old-k8s-version-467349/id_rsa Username:docker}
I0829 19:26:02.343053 72476 ssh_runner.go:195] Run: systemctl --version
I0829 19:26:02.349381 72476 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0829 19:26:02.513537 72476 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0829 19:26:02.519520 72476 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0829 19:26:02.519590 72476 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0829 19:26:02.541097 72476 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0829 19:26:02.541120 72476 start.go:495] detecting cgroup driver to use...
I0829 19:26:02.541174 72476 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0829 19:26:02.560965 72476 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0829 19:26:02.575453 72476 docker.go:217] disabling cri-docker service (if available) ...
I0829 19:26:02.575520 72476 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0829 19:26:02.588123 72476 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0829 19:26:02.600822 72476 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0829 19:26:02.719514 72476 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0829 19:26:02.875803 72476 docker.go:233] disabling docker service ...
I0829 19:26:02.875871 72476 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0829 19:26:02.893341 72476 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0829 19:26:02.905698 72476 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0829 19:26:03.027186 72476 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0829 19:26:03.150181 72476 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0829 19:26:03.166346 72476 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0829 19:26:03.183767 72476 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0829 19:26:03.183834 72476 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0829 19:26:03.193450 72476 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0829 19:26:03.193520 72476 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0829 19:26:03.203490 72476 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0829 19:26:03.213375 72476 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0829 19:26:03.223490 72476 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0829 19:26:03.234150 72476 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0829 19:26:03.245846 72476 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0829 19:26:03.245903 72476 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0829 19:26:03.259123 72476 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0829 19:26:03.269037 72476 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0829 19:26:03.393272 72476 ssh_runner.go:195] Run: sudo systemctl restart crio
I0829 19:26:03.494809 72476 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0829 19:26:03.494878 72476 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0829 19:26:03.500345 72476 start.go:563] Will wait 60s for crictl version
I0829 19:26:03.500413 72476 ssh_runner.go:195] Run: which crictl
I0829 19:26:03.504421 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0829 19:26:03.544090 72476 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0829 19:26:03.544183 72476 ssh_runner.go:195] Run: crio --version
I0829 19:26:03.573516 72476 ssh_runner.go:195] Run: crio --version
I0829 19:26:03.604835 72476 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0829 19:26:03.606072 72476 main.go:141] libmachine: (old-k8s-version-467349) Calling .GetIP
I0829 19:26:03.609251 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:03.609695 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1e:26:7c", ip: ""} in network mk-old-k8s-version-467349: {Iface:virbr4 ExpiryTime:2024-08-29 20:25:52 +0000 UTC Type:0 Mac:52:54:00:1e:26:7c Iaid: IPaddr:192.168.72.112 Prefix:24 Hostname:old-k8s-version-467349 Clientid:01:52:54:00:1e:26:7c}
I0829 19:26:03.609726 72476 main.go:141] libmachine: (old-k8s-version-467349) DBG | domain old-k8s-version-467349 has defined IP address 192.168.72.112 and MAC address 52:54:00:1e:26:7c in network mk-old-k8s-version-467349
I0829 19:26:03.609945 72476 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0829 19:26:03.615094 72476 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0829 19:26:03.628112 72476 kubeadm.go:883] updating cluster {Name:old-k8s-version-467349 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-467349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.112 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0829 19:26:03.628221 72476 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0829 19:26:03.628259 72476 ssh_runner.go:195] Run: sudo crictl images --output json
I0829 19:26:03.662128 72476 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0829 19:26:03.662214 72476 ssh_runner.go:195] Run: which lz4
I0829 19:26:03.667057 72476 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0829 19:26:03.671248 72476 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0829 19:26:03.671285 72476 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-13056/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0829 19:26:05.178656 72476 crio.go:462] duration metric: took 1.511642738s to copy over tarball
I0829 19:26:05.178747 72476 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0829 19:26:07.889630 72476 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.710846323s)
I0829 19:26:07.889669 72476 crio.go:469] duration metric: took 2.71097667s to extract the tarball
I0829 19:26:07.889678 72476 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0829 19:26:07.932576 72476 ssh_runner.go:195] Run: sudo crictl images --output json
I0829 19:26:07.978344 72476 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0829 19:26:07.978379 72476 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0829 19:26:07.978469 72476 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0829 19:26:07.978472 72476 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0829 19:26:07.978481 72476 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0829 19:26:07.978536 72476 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0829 19:26:07.978574 72476 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0829 19:26:07.978571 72476 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0829 19:26:07.978550 72476 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0829 19:26:07.978798 72476 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0829 19:26:07.980032 72476 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0829 19:26:07.980195 72476 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0829 19:26:07.980206 72476 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0829 19:26:07.980196 72476 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0829 19:26:07.980195 72476 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0829 19:26:07.980252 72476 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0829 19:26:07.980287 72476 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0829 19:26:07.980197 72476 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0829 19:26:08.221580 72476 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0829 19:26:08.227787 72476 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0829 19:26:08.238898 72476 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0829 19:26:08.277414 72476 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0829 19:26:08.277471 72476 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0829 19:26:08.277519 72476 ssh_runner.go:195] Run: which crictl
I0829 19:26:08.286958 72476 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0829 19:26:08.287001 72476 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0829 19:26:08.287037 72476 ssh_runner.go:195] Run: which crictl
I0829 19:26:08.303913 72476 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0829 19:26:08.303953 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0829 19:26:08.303961 72476 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0829 19:26:08.303971 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0829 19:26:08.304001 72476 ssh_runner.go:195] Run: which crictl
I0829 19:26:08.324421 72476 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0829 19:26:08.324850 72476 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0829 19:26:08.351166 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0829 19:26:08.360329 72476 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0829 19:26:08.364918 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0829 19:26:08.364993 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0829 19:26:08.374521 72476 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0829 19:26:08.470714 72476 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0829 19:26:08.470756 72476 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0829 19:26:08.470794 72476 ssh_runner.go:195] Run: which crictl
I0829 19:26:08.473133 72476 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0829 19:26:08.473167 72476 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0829 19:26:08.473200 72476 ssh_runner.go:195] Run: which crictl
I0829 19:26:08.487957 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0829 19:26:08.533076 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0829 19:26:08.533107 72476 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0829 19:26:08.533139 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0829 19:26:08.533143 72476 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0829 19:26:08.533183 72476 ssh_runner.go:195] Run: which crictl
I0829 19:26:08.534480 72476 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0829 19:26:08.534517 72476 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0829 19:26:08.534524 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0829 19:26:08.534556 72476 ssh_runner.go:195] Run: which crictl
I0829 19:26:08.534566 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0829 19:26:08.573408 72476 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19531-13056/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0829 19:26:08.573482 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0829 19:26:08.644663 72476 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19531-13056/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0829 19:26:08.644799 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0829 19:26:08.644903 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0829 19:26:08.646551 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0829 19:26:08.646625 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0829 19:26:08.666266 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0829 19:26:08.754823 72476 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19531-13056/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0829 19:26:08.754943 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0829 19:26:08.757382 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0829 19:26:08.760490 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0829 19:26:08.778731 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0829 19:26:08.833230 72476 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19531-13056/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0829 19:26:08.864001 72476 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19531-13056/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0829 19:26:08.864029 72476 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0829 19:26:08.864001 72476 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19531-13056/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0829 19:26:08.899797 72476 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19531-13056/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0829 19:26:09.262717 72476 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0829 19:26:09.404620 72476 cache_images.go:92] duration metric: took 1.426219946s to LoadCachedImages
W0829 19:26:09.404688 72476 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19531-13056/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19531-13056/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
I0829 19:26:09.404702 72476 kubeadm.go:934] updating node { 192.168.72.112 8443 v1.20.0 crio true true} ...
I0829 19:26:09.404817 72476 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-467349 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.112
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-467349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0829 19:26:09.404906 72476 ssh_runner.go:195] Run: crio config
I0829 19:26:09.453863 72476 cni.go:84] Creating CNI manager for ""
I0829 19:26:09.453888 72476 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0829 19:26:09.453905 72476 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0829 19:26:09.453941 72476 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.112 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-467349 NodeName:old-k8s-version-467349 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.112"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.112 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0829 19:26:09.454154 72476 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.112
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-467349"
kubeletExtraArgs:
node-ip: 192.168.72.112
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.112"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0829 19:26:09.454237 72476 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0829 19:26:09.468924 72476 binaries.go:44] Found k8s binaries, skipping transfer
I0829 19:26:09.468998 72476 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0829 19:26:09.478812 72476 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0829 19:26:09.496873 72476 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0829 19:26:09.514064 72476 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0829 19:26:09.531230 72476 ssh_runner.go:195] Run: grep 192.168.72.112 control-plane.minikube.internal$ /etc/hosts
I0829 19:26:09.535024 72476 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.112 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0829 19:26:09.547210 72476 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0829 19:26:09.665622 72476 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0829 19:26:09.686366 72476 certs.go:68] Setting up /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349 for IP: 192.168.72.112
I0829 19:26:09.686392 72476 certs.go:194] generating shared ca certs ...
I0829 19:26:09.686412 72476 certs.go:226] acquiring lock for ca certs: {Name:mka8f241b30678b2c2cdb76b83a45ea5ea9026f6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 19:26:09.686578 72476 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19531-13056/.minikube/ca.key
I0829 19:26:09.686633 72476 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19531-13056/.minikube/proxy-client-ca.key
I0829 19:26:09.686647 72476 certs.go:256] generating profile certs ...
I0829 19:26:09.686713 72476 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/client.key
I0829 19:26:09.686730 72476 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/client.crt with IP's: []
I0829 19:26:10.028996 72476 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/client.crt ...
I0829 19:26:10.029028 72476 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/client.crt: {Name:mkdaabcd845df255ef35517f0571ba8c107e8bf1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 19:26:10.029194 72476 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/client.key ...
I0829 19:26:10.029226 72476 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/client.key: {Name:mk74be38345bff4e20e50de89719e34cacf357b1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 19:26:10.029319 72476 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/apiserver.key.b97fdb0f
I0829 19:26:10.029340 72476 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/apiserver.crt.b97fdb0f with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.112]
I0829 19:26:10.294963 72476 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/apiserver.crt.b97fdb0f ...
I0829 19:26:10.295003 72476 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/apiserver.crt.b97fdb0f: {Name:mk05072c555b3bb43bb1e9d26677001105861886 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 19:26:10.295214 72476 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/apiserver.key.b97fdb0f ...
I0829 19:26:10.295234 72476 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/apiserver.key.b97fdb0f: {Name:mkc42e0ef44cb95b7555506fe7eb86de37c4cf9f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 19:26:10.295338 72476 certs.go:381] copying /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/apiserver.crt.b97fdb0f -> /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/apiserver.crt
I0829 19:26:10.295454 72476 certs.go:385] copying /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/apiserver.key.b97fdb0f -> /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/apiserver.key
I0829 19:26:10.295536 72476 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/proxy-client.key
I0829 19:26:10.295559 72476 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/proxy-client.crt with IP's: []
I0829 19:26:10.452661 72476 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/proxy-client.crt ...
I0829 19:26:10.452688 72476 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/proxy-client.crt: {Name:mkc1d68071cdb4eb2d4cc1f27d80e8d445a1368a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 19:26:10.471951 72476 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/proxy-client.key ...
I0829 19:26:10.471984 72476 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/proxy-client.key: {Name:mk888c7ca1e51b20902148eb23dd8f0d68c1f71f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0829 19:26:10.472207 72476 certs.go:484] found cert: /home/jenkins/minikube-integration/19531-13056/.minikube/certs/20259.pem (1338 bytes)
W0829 19:26:10.472258 72476 certs.go:480] ignoring /home/jenkins/minikube-integration/19531-13056/.minikube/certs/20259_empty.pem, impossibly tiny 0 bytes
I0829 19:26:10.472274 72476 certs.go:484] found cert: /home/jenkins/minikube-integration/19531-13056/.minikube/certs/ca-key.pem (1679 bytes)
I0829 19:26:10.472309 72476 certs.go:484] found cert: /home/jenkins/minikube-integration/19531-13056/.minikube/certs/ca.pem (1082 bytes)
I0829 19:26:10.472360 72476 certs.go:484] found cert: /home/jenkins/minikube-integration/19531-13056/.minikube/certs/cert.pem (1123 bytes)
I0829 19:26:10.472391 72476 certs.go:484] found cert: /home/jenkins/minikube-integration/19531-13056/.minikube/certs/key.pem (1675 bytes)
I0829 19:26:10.472440 72476 certs.go:484] found cert: /home/jenkins/minikube-integration/19531-13056/.minikube/files/etc/ssl/certs/202592.pem (1708 bytes)
I0829 19:26:10.473034 72476 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-13056/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0829 19:26:10.498359 72476 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-13056/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0829 19:26:10.531987 72476 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-13056/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0829 19:26:10.556436 72476 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-13056/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0829 19:26:10.578859 72476 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0829 19:26:10.602203 72476 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0829 19:26:10.638543 72476 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0829 19:26:10.663581 72476 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-13056/.minikube/profiles/old-k8s-version-467349/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0829 19:26:10.690573 72476 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-13056/.minikube/files/etc/ssl/certs/202592.pem --> /usr/share/ca-certificates/202592.pem (1708 bytes)
I0829 19:26:10.716630 72476 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-13056/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0829 19:26:10.742073 72476 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19531-13056/.minikube/certs/20259.pem --> /usr/share/ca-certificates/20259.pem (1338 bytes)
I0829 19:26:10.768454 72476 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0829 19:26:10.785387 72476 ssh_runner.go:195] Run: openssl version
I0829 19:26:10.791668 72476 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/20259.pem && ln -fs /usr/share/ca-certificates/20259.pem /etc/ssl/certs/20259.pem"
I0829 19:26:10.802320 72476 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/20259.pem
I0829 19:26:10.806692 72476 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 29 18:22 /usr/share/ca-certificates/20259.pem
I0829 19:26:10.806760 72476 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/20259.pem
I0829 19:26:10.812929 72476 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/20259.pem /etc/ssl/certs/51391683.0"
I0829 19:26:10.823705 72476 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/202592.pem && ln -fs /usr/share/ca-certificates/202592.pem /etc/ssl/certs/202592.pem"
I0829 19:26:10.834683 72476 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/202592.pem
I0829 19:26:10.839197 72476 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 29 18:22 /usr/share/ca-certificates/202592.pem
I0829 19:26:10.839261 72476 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/202592.pem
I0829 19:26:10.844680 72476 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/202592.pem /etc/ssl/certs/3ec20f2e.0"
I0829 19:26:10.854748 72476 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0829 19:26:10.864734 72476 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0829 19:26:10.869188 72476 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 29 18:06 /usr/share/ca-certificates/minikubeCA.pem
I0829 19:26:10.869254 72476 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0829 19:26:10.874753 72476 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0829 19:26:10.884786 72476 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0829 19:26:10.888994 72476 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0829 19:26:10.889067 72476 kubeadm.go:392] StartCluster: {Name:old-k8s-version-467349 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19521/minikube-v1.33.1-1724775098-19521-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724775115-19521@sha256:5e61ebc6e68d69e31cadead040aa9b41aa36d281b29a7d562fa41077c99ed3ce Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-467349 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.112 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0829 19:26:10.889158 72476 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0829 19:26:10.889219 72476 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0829 19:26:10.933764 72476 cri.go:89] found id: ""
I0829 19:26:10.933845 72476 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0829 19:26:10.943605 72476 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0829 19:26:10.953629 72476 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0829 19:26:10.966007 72476 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0829 19:26:10.966025 72476 kubeadm.go:157] found existing configuration files:
I0829 19:26:10.966099 72476 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0829 19:26:10.974912 72476 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0829 19:26:10.974983 72476 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0829 19:26:10.984914 72476 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0829 19:26:10.994285 72476 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0829 19:26:10.994348 72476 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0829 19:26:11.004337 72476 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0829 19:26:11.013210 72476 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0829 19:26:11.013278 72476 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0829 19:26:11.022429 72476 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0829 19:26:11.031037 72476 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0829 19:26:11.031100 72476 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0829 19:26:11.041007 72476 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0829 19:26:11.311991 72476 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0829 19:28:10.041103 72476 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0829 19:28:10.041205 72476 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0829 19:28:10.042675 72476 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0829 19:28:10.042738 72476 kubeadm.go:310] [preflight] Running pre-flight checks
I0829 19:28:10.042842 72476 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0829 19:28:10.042978 72476 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0829 19:28:10.043100 72476 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0829 19:28:10.043190 72476 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0829 19:28:10.044898 72476 out.go:235] - Generating certificates and keys ...
I0829 19:28:10.044990 72476 kubeadm.go:310] [certs] Using existing ca certificate authority
I0829 19:28:10.045070 72476 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0829 19:28:10.045182 72476 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0829 19:28:10.045277 72476 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0829 19:28:10.045366 72476 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0829 19:28:10.045442 72476 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0829 19:28:10.045507 72476 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0829 19:28:10.045679 72476 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-467349] and IPs [192.168.72.112 127.0.0.1 ::1]
I0829 19:28:10.045757 72476 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0829 19:28:10.045885 72476 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-467349] and IPs [192.168.72.112 127.0.0.1 ::1]
I0829 19:28:10.045962 72476 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0829 19:28:10.046056 72476 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0829 19:28:10.046150 72476 kubeadm.go:310] [certs] Generating "sa" key and public key
I0829 19:28:10.046231 72476 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0829 19:28:10.046295 72476 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0829 19:28:10.046375 72476 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0829 19:28:10.046455 72476 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0829 19:28:10.046520 72476 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0829 19:28:10.046622 72476 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0829 19:28:10.046744 72476 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0829 19:28:10.046800 72476 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0829 19:28:10.046893 72476 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0829 19:28:10.048273 72476 out.go:235] - Booting up control plane ...
I0829 19:28:10.048365 72476 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0829 19:28:10.048449 72476 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0829 19:28:10.048539 72476 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0829 19:28:10.048645 72476 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0829 19:28:10.048814 72476 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0829 19:28:10.048876 72476 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0829 19:28:10.048954 72476 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 19:28:10.049123 72476 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 19:28:10.049259 72476 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 19:28:10.049448 72476 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 19:28:10.049555 72476 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 19:28:10.049710 72476 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 19:28:10.049773 72476 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 19:28:10.049930 72476 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 19:28:10.050024 72476 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 19:28:10.050313 72476 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 19:28:10.050332 72476 kubeadm.go:310]
I0829 19:28:10.050382 72476 kubeadm.go:310] Unfortunately, an error has occurred:
I0829 19:28:10.050417 72476 kubeadm.go:310] timed out waiting for the condition
I0829 19:28:10.050425 72476 kubeadm.go:310]
I0829 19:28:10.050451 72476 kubeadm.go:310] This error is likely caused by:
I0829 19:28:10.050479 72476 kubeadm.go:310] - The kubelet is not running
I0829 19:28:10.050596 72476 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0829 19:28:10.050616 72476 kubeadm.go:310]
I0829 19:28:10.050758 72476 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0829 19:28:10.050806 72476 kubeadm.go:310] - 'systemctl status kubelet'
I0829 19:28:10.050855 72476 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0829 19:28:10.050864 72476 kubeadm.go:310]
I0829 19:28:10.050990 72476 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0829 19:28:10.051078 72476 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0829 19:28:10.051089 72476 kubeadm.go:310]
I0829 19:28:10.051209 72476 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0829 19:28:10.051349 72476 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0829 19:28:10.051443 72476 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0829 19:28:10.051526 72476 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0829 19:28:10.051612 72476 kubeadm.go:310]
W0829 19:28:10.051674 72476 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-467349] and IPs [192.168.72.112 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-467349] and IPs [192.168.72.112 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-467349] and IPs [192.168.72.112 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-467349] and IPs [192.168.72.112 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0829 19:28:10.051714 72476 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0829 19:28:11.228861 72476 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.17711676s)
I0829 19:28:11.228948 72476 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0829 19:28:11.242402 72476 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0829 19:28:11.253243 72476 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0829 19:28:11.253268 72476 kubeadm.go:157] found existing configuration files:
I0829 19:28:11.253314 72476 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0829 19:28:11.262152 72476 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0829 19:28:11.262220 72476 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0829 19:28:11.271200 72476 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0829 19:28:11.279708 72476 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0829 19:28:11.279755 72476 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0829 19:28:11.288367 72476 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0829 19:28:11.296691 72476 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0829 19:28:11.296754 72476 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0829 19:28:11.305678 72476 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0829 19:28:11.314291 72476 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0829 19:28:11.314343 72476 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0829 19:28:11.324344 72476 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0829 19:28:11.535259 72476 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0829 19:30:07.919044 72476 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0829 19:30:07.919157 72476 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0829 19:30:07.920732 72476 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0829 19:30:07.920803 72476 kubeadm.go:310] [preflight] Running pre-flight checks
I0829 19:30:07.920890 72476 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0829 19:30:07.920991 72476 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0829 19:30:07.921084 72476 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0829 19:30:07.921148 72476 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0829 19:30:07.922964 72476 out.go:235] - Generating certificates and keys ...
I0829 19:30:07.923029 72476 kubeadm.go:310] [certs] Using existing ca certificate authority
I0829 19:30:07.923083 72476 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0829 19:30:07.923148 72476 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0829 19:30:07.923201 72476 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0829 19:30:07.923268 72476 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0829 19:30:07.923346 72476 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0829 19:30:07.923413 72476 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0829 19:30:07.923491 72476 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0829 19:30:07.923581 72476 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0829 19:30:07.923665 72476 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0829 19:30:07.923720 72476 kubeadm.go:310] [certs] Using the existing "sa" key
I0829 19:30:07.923777 72476 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0829 19:30:07.923842 72476 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0829 19:30:07.923913 72476 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0829 19:30:07.924000 72476 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0829 19:30:07.924087 72476 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0829 19:30:07.924193 72476 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0829 19:30:07.924265 72476 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0829 19:30:07.924319 72476 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0829 19:30:07.924375 72476 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0829 19:30:07.925721 72476 out.go:235] - Booting up control plane ...
I0829 19:30:07.925796 72476 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0829 19:30:07.925868 72476 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0829 19:30:07.925944 72476 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0829 19:30:07.926011 72476 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0829 19:30:07.926175 72476 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0829 19:30:07.926237 72476 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0829 19:30:07.926317 72476 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 19:30:07.926535 72476 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 19:30:07.926639 72476 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 19:30:07.926934 72476 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 19:30:07.927031 72476 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 19:30:07.927281 72476 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 19:30:07.927403 72476 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 19:30:07.927665 72476 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 19:30:07.927773 72476 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0829 19:30:07.928017 72476 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0829 19:30:07.928026 72476 kubeadm.go:310]
I0829 19:30:07.928065 72476 kubeadm.go:310] Unfortunately, an error has occurred:
I0829 19:30:07.928100 72476 kubeadm.go:310] timed out waiting for the condition
I0829 19:30:07.928106 72476 kubeadm.go:310]
I0829 19:30:07.928138 72476 kubeadm.go:310] This error is likely caused by:
I0829 19:30:07.928167 72476 kubeadm.go:310] - The kubelet is not running
I0829 19:30:07.928253 72476 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0829 19:30:07.928260 72476 kubeadm.go:310]
I0829 19:30:07.928370 72476 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0829 19:30:07.928405 72476 kubeadm.go:310] - 'systemctl status kubelet'
I0829 19:30:07.928451 72476 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0829 19:30:07.928464 72476 kubeadm.go:310]
I0829 19:30:07.928583 72476 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0829 19:30:07.928678 72476 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0829 19:30:07.928687 72476 kubeadm.go:310]
I0829 19:30:07.928839 72476 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0829 19:30:07.928961 72476 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0829 19:30:07.929073 72476 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0829 19:30:07.929135 72476 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0829 19:30:07.929190 72476 kubeadm.go:394] duration metric: took 3m57.040128964s to StartCluster
I0829 19:30:07.929203 72476 kubeadm.go:310]
I0829 19:30:07.929236 72476 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0829 19:30:07.929288 72476 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0829 19:30:07.978869 72476 cri.go:89] found id: ""
I0829 19:30:07.978901 72476 logs.go:276] 0 containers: []
W0829 19:30:07.978914 72476 logs.go:278] No container was found matching "kube-apiserver"
I0829 19:30:07.978922 72476 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0829 19:30:07.978986 72476 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0829 19:30:08.011942 72476 cri.go:89] found id: ""
I0829 19:30:08.011971 72476 logs.go:276] 0 containers: []
W0829 19:30:08.011980 72476 logs.go:278] No container was found matching "etcd"
I0829 19:30:08.011986 72476 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0829 19:30:08.012035 72476 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0829 19:30:08.048777 72476 cri.go:89] found id: ""
I0829 19:30:08.048809 72476 logs.go:276] 0 containers: []
W0829 19:30:08.048819 72476 logs.go:278] No container was found matching "coredns"
I0829 19:30:08.048826 72476 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0829 19:30:08.048889 72476 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0829 19:30:08.079347 72476 cri.go:89] found id: ""
I0829 19:30:08.079370 72476 logs.go:276] 0 containers: []
W0829 19:30:08.079377 72476 logs.go:278] No container was found matching "kube-scheduler"
I0829 19:30:08.079382 72476 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0829 19:30:08.079428 72476 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0829 19:30:08.112139 72476 cri.go:89] found id: ""
I0829 19:30:08.112170 72476 logs.go:276] 0 containers: []
W0829 19:30:08.112180 72476 logs.go:278] No container was found matching "kube-proxy"
I0829 19:30:08.112189 72476 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0829 19:30:08.112259 72476 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0829 19:30:08.144920 72476 cri.go:89] found id: ""
I0829 19:30:08.144951 72476 logs.go:276] 0 containers: []
W0829 19:30:08.144963 72476 logs.go:278] No container was found matching "kube-controller-manager"
I0829 19:30:08.144971 72476 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0829 19:30:08.145040 72476 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0829 19:30:08.176218 72476 cri.go:89] found id: ""
I0829 19:30:08.176247 72476 logs.go:276] 0 containers: []
W0829 19:30:08.176259 72476 logs.go:278] No container was found matching "kindnet"
I0829 19:30:08.176271 72476 logs.go:123] Gathering logs for kubelet ...
I0829 19:30:08.176290 72476 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0829 19:30:08.225527 72476 logs.go:123] Gathering logs for dmesg ...
I0829 19:30:08.225566 72476 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0829 19:30:08.238153 72476 logs.go:123] Gathering logs for describe nodes ...
I0829 19:30:08.238187 72476 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0829 19:30:08.346372 72476 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0829 19:30:08.346394 72476 logs.go:123] Gathering logs for CRI-O ...
I0829 19:30:08.346409 72476 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0829 19:30:08.449499 72476 logs.go:123] Gathering logs for container status ...
I0829 19:30:08.449535 72476 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0829 19:30:08.485867 72476 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0829 19:30:08.485924 72476 out.go:270] *
*
W0829 19:30:08.485992 72476 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0829 19:30:08.486010 72476 out.go:270] *
*
W0829 19:30:08.486843 72476 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0829 19:30:08.489379 72476 out.go:201]
W0829 19:30:08.490524 72476 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0829 19:30:08.490584 72476 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0829 19:30:08.490611 72476 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0829 19:30:08.491987 72476 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-467349 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-467349 -n old-k8s-version-467349
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-467349 -n old-k8s-version-467349: exit status 6 (220.602088ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0829 19:30:08.765042 79025 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-467349" does not appear in /home/jenkins/minikube-integration/19531-13056/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-467349" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (283.34s)