=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-620467 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-620467 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m56.252778047s)
-- stdout --
* [old-k8s-version-620467] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19479
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19479-2086935/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19479-2086935/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-620467" primary control-plane node in "old-k8s-version-620467" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0819 13:10:10.891118 2144521 out.go:345] Setting OutFile to fd 1 ...
I0819 13:10:10.891266 2144521 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0819 13:10:10.891279 2144521 out.go:358] Setting ErrFile to fd 2...
I0819 13:10:10.891286 2144521 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0819 13:10:10.891577 2144521 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19479-2086935/.minikube/bin
I0819 13:10:10.892698 2144521 out.go:352] Setting JSON to false
I0819 13:10:10.894456 2144521 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":165161,"bootTime":1723907850,"procs":341,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1066-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0819 13:10:10.894559 2144521 start.go:139] virtualization: kvm guest
I0819 13:10:10.896233 2144521 out.go:177] * [old-k8s-version-620467] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0819 13:10:10.897766 2144521 out.go:177] - MINIKUBE_LOCATION=19479
I0819 13:10:10.897786 2144521 notify.go:220] Checking for updates...
I0819 13:10:10.900139 2144521 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0819 13:10:10.901356 2144521 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19479-2086935/kubeconfig
I0819 13:10:10.902554 2144521 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19479-2086935/.minikube
I0819 13:10:10.903683 2144521 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0819 13:10:10.904943 2144521 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0819 13:10:10.906770 2144521 config.go:182] Loaded profile config "bridge-649777": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0819 13:10:10.906894 2144521 config.go:182] Loaded profile config "enable-default-cni-649777": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0819 13:10:10.907010 2144521 config.go:182] Loaded profile config "flannel-649777": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0819 13:10:10.907155 2144521 driver.go:392] Setting default libvirt URI to qemu:///system
I0819 13:10:10.953412 2144521 out.go:177] * Using the kvm2 driver based on user configuration
I0819 13:10:10.954774 2144521 start.go:297] selected driver: kvm2
I0819 13:10:10.954808 2144521 start.go:901] validating driver "kvm2" against <nil>
I0819 13:10:10.954826 2144521 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0819 13:10:10.955719 2144521 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 13:10:10.955830 2144521 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19479-2086935/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0819 13:10:10.975603 2144521 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0819 13:10:10.975653 2144521 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0819 13:10:10.975900 2144521 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0819 13:10:10.975945 2144521 cni.go:84] Creating CNI manager for ""
I0819 13:10:10.975956 2144521 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0819 13:10:10.975977 2144521 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0819 13:10:10.976069 2144521 start.go:340] cluster config:
{Name:old-k8s-version-620467 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-620467 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0819 13:10:10.976217 2144521 iso.go:125] acquiring lock: {Name:mk187c0515de2dd368378ad9b8b97e5033264f89 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0819 13:10:10.977671 2144521 out.go:177] * Starting "old-k8s-version-620467" primary control-plane node in "old-k8s-version-620467" cluster
I0819 13:10:10.978848 2144521 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0819 13:10:10.978902 2144521 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19479-2086935/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0819 13:10:10.978917 2144521 cache.go:56] Caching tarball of preloaded images
I0819 13:10:10.979042 2144521 preload.go:172] Found /home/jenkins/minikube-integration/19479-2086935/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0819 13:10:10.979069 2144521 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0819 13:10:10.979200 2144521 profile.go:143] Saving config to /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/config.json ...
I0819 13:10:10.979233 2144521 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/config.json: {Name:mk8ccec52eda9928ea19083da6c7f4f5ca2a9ac3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 13:10:10.979454 2144521 start.go:360] acquireMachinesLock for old-k8s-version-620467: {Name:mk47fa737025b7faea9c65348904d9195bf44df0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0819 13:10:36.369330 2144521 start.go:364] duration metric: took 25.389821096s to acquireMachinesLock for "old-k8s-version-620467"
I0819 13:10:36.369422 2144521 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-620467 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-620467 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0819 13:10:36.369541 2144521 start.go:125] createHost starting for "" (driver="kvm2")
I0819 13:10:36.371457 2144521 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0819 13:10:36.371644 2144521 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0819 13:10:36.371707 2144521 main.go:141] libmachine: Launching plugin server for driver kvm2
I0819 13:10:36.388994 2144521 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39045
I0819 13:10:36.389457 2144521 main.go:141] libmachine: () Calling .GetVersion
I0819 13:10:36.390083 2144521 main.go:141] libmachine: Using API Version 1
I0819 13:10:36.390108 2144521 main.go:141] libmachine: () Calling .SetConfigRaw
I0819 13:10:36.390463 2144521 main.go:141] libmachine: () Calling .GetMachineName
I0819 13:10:36.390676 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetMachineName
I0819 13:10:36.390835 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .DriverName
I0819 13:10:36.390997 2144521 start.go:159] libmachine.API.Create for "old-k8s-version-620467" (driver="kvm2")
I0819 13:10:36.391029 2144521 client.go:168] LocalClient.Create starting
I0819 13:10:36.391067 2144521 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19479-2086935/.minikube/certs/ca.pem
I0819 13:10:36.391104 2144521 main.go:141] libmachine: Decoding PEM data...
I0819 13:10:36.391125 2144521 main.go:141] libmachine: Parsing certificate...
I0819 13:10:36.391193 2144521 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19479-2086935/.minikube/certs/cert.pem
I0819 13:10:36.391220 2144521 main.go:141] libmachine: Decoding PEM data...
I0819 13:10:36.391237 2144521 main.go:141] libmachine: Parsing certificate...
I0819 13:10:36.391268 2144521 main.go:141] libmachine: Running pre-create checks...
I0819 13:10:36.391282 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .PreCreateCheck
I0819 13:10:36.391617 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetConfigRaw
I0819 13:10:36.392053 2144521 main.go:141] libmachine: Creating machine...
I0819 13:10:36.392069 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .Create
I0819 13:10:36.392245 2144521 main.go:141] libmachine: (old-k8s-version-620467) Creating KVM machine...
I0819 13:10:36.393385 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found existing default KVM network
I0819 13:10:36.394643 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:36.394477 2146017 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015710}
I0819 13:10:36.394674 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | created network xml:
I0819 13:10:36.394688 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | <network>
I0819 13:10:36.394698 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | <name>mk-old-k8s-version-620467</name>
I0819 13:10:36.394709 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | <dns enable='no'/>
I0819 13:10:36.394723 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG |
I0819 13:10:36.394738 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0819 13:10:36.394749 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | <dhcp>
I0819 13:10:36.394762 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0819 13:10:36.394773 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | </dhcp>
I0819 13:10:36.394789 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | </ip>
I0819 13:10:36.394804 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG |
I0819 13:10:36.394818 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | </network>
I0819 13:10:36.394829 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG |
I0819 13:10:36.399973 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | trying to create private KVM network mk-old-k8s-version-620467 192.168.39.0/24...
I0819 13:10:36.473133 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | private KVM network mk-old-k8s-version-620467 192.168.39.0/24 created
I0819 13:10:36.473165 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:36.473090 2146017 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19479-2086935/.minikube
I0819 13:10:36.473178 2144521 main.go:141] libmachine: (old-k8s-version-620467) Setting up store path in /home/jenkins/minikube-integration/19479-2086935/.minikube/machines/old-k8s-version-620467 ...
I0819 13:10:36.473196 2144521 main.go:141] libmachine: (old-k8s-version-620467) Building disk image from file:///home/jenkins/minikube-integration/19479-2086935/.minikube/cache/iso/amd64/minikube-v1.33.1-1723740674-19452-amd64.iso
I0819 13:10:36.473210 2144521 main.go:141] libmachine: (old-k8s-version-620467) Downloading /home/jenkins/minikube-integration/19479-2086935/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19479-2086935/.minikube/cache/iso/amd64/minikube-v1.33.1-1723740674-19452-amd64.iso...
I0819 13:10:36.747122 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:36.746971 2146017 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19479-2086935/.minikube/machines/old-k8s-version-620467/id_rsa...
I0819 13:10:37.004759 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:37.004622 2146017 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19479-2086935/.minikube/machines/old-k8s-version-620467/old-k8s-version-620467.rawdisk...
I0819 13:10:37.004797 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | Writing magic tar header
I0819 13:10:37.004821 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | Writing SSH key tar header
I0819 13:10:37.004840 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:37.004753 2146017 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19479-2086935/.minikube/machines/old-k8s-version-620467 ...
I0819 13:10:37.004942 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19479-2086935/.minikube/machines/old-k8s-version-620467
I0819 13:10:37.004976 2144521 main.go:141] libmachine: (old-k8s-version-620467) Setting executable bit set on /home/jenkins/minikube-integration/19479-2086935/.minikube/machines/old-k8s-version-620467 (perms=drwx------)
I0819 13:10:37.004993 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19479-2086935/.minikube/machines
I0819 13:10:37.005018 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19479-2086935/.minikube
I0819 13:10:37.005031 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19479-2086935
I0819 13:10:37.005050 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0819 13:10:37.005062 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | Checking permissions on dir: /home/jenkins
I0819 13:10:37.005078 2144521 main.go:141] libmachine: (old-k8s-version-620467) Setting executable bit set on /home/jenkins/minikube-integration/19479-2086935/.minikube/machines (perms=drwxr-xr-x)
I0819 13:10:37.005092 2144521 main.go:141] libmachine: (old-k8s-version-620467) Setting executable bit set on /home/jenkins/minikube-integration/19479-2086935/.minikube (perms=drwxr-xr-x)
I0819 13:10:37.005105 2144521 main.go:141] libmachine: (old-k8s-version-620467) Setting executable bit set on /home/jenkins/minikube-integration/19479-2086935 (perms=drwxrwxr-x)
I0819 13:10:37.005120 2144521 main.go:141] libmachine: (old-k8s-version-620467) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0819 13:10:37.005132 2144521 main.go:141] libmachine: (old-k8s-version-620467) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0819 13:10:37.005158 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | Checking permissions on dir: /home
I0819 13:10:37.005179 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | Skipping /home - not owner
I0819 13:10:37.005186 2144521 main.go:141] libmachine: (old-k8s-version-620467) Creating domain...
I0819 13:10:37.006436 2144521 main.go:141] libmachine: (old-k8s-version-620467) define libvirt domain using xml:
I0819 13:10:37.006463 2144521 main.go:141] libmachine: (old-k8s-version-620467) <domain type='kvm'>
I0819 13:10:37.006475 2144521 main.go:141] libmachine: (old-k8s-version-620467) <name>old-k8s-version-620467</name>
I0819 13:10:37.006484 2144521 main.go:141] libmachine: (old-k8s-version-620467) <memory unit='MiB'>2200</memory>
I0819 13:10:37.006493 2144521 main.go:141] libmachine: (old-k8s-version-620467) <vcpu>2</vcpu>
I0819 13:10:37.006507 2144521 main.go:141] libmachine: (old-k8s-version-620467) <features>
I0819 13:10:37.006519 2144521 main.go:141] libmachine: (old-k8s-version-620467) <acpi/>
I0819 13:10:37.006526 2144521 main.go:141] libmachine: (old-k8s-version-620467) <apic/>
I0819 13:10:37.006534 2144521 main.go:141] libmachine: (old-k8s-version-620467) <pae/>
I0819 13:10:37.006560 2144521 main.go:141] libmachine: (old-k8s-version-620467)
I0819 13:10:37.006571 2144521 main.go:141] libmachine: (old-k8s-version-620467) </features>
I0819 13:10:37.006579 2144521 main.go:141] libmachine: (old-k8s-version-620467) <cpu mode='host-passthrough'>
I0819 13:10:37.006591 2144521 main.go:141] libmachine: (old-k8s-version-620467)
I0819 13:10:37.006598 2144521 main.go:141] libmachine: (old-k8s-version-620467) </cpu>
I0819 13:10:37.006610 2144521 main.go:141] libmachine: (old-k8s-version-620467) <os>
I0819 13:10:37.006618 2144521 main.go:141] libmachine: (old-k8s-version-620467) <type>hvm</type>
I0819 13:10:37.006627 2144521 main.go:141] libmachine: (old-k8s-version-620467) <boot dev='cdrom'/>
I0819 13:10:37.006641 2144521 main.go:141] libmachine: (old-k8s-version-620467) <boot dev='hd'/>
I0819 13:10:37.006654 2144521 main.go:141] libmachine: (old-k8s-version-620467) <bootmenu enable='no'/>
I0819 13:10:37.006673 2144521 main.go:141] libmachine: (old-k8s-version-620467) </os>
I0819 13:10:37.006685 2144521 main.go:141] libmachine: (old-k8s-version-620467) <devices>
I0819 13:10:37.006696 2144521 main.go:141] libmachine: (old-k8s-version-620467) <disk type='file' device='cdrom'>
I0819 13:10:37.006713 2144521 main.go:141] libmachine: (old-k8s-version-620467) <source file='/home/jenkins/minikube-integration/19479-2086935/.minikube/machines/old-k8s-version-620467/boot2docker.iso'/>
I0819 13:10:37.006727 2144521 main.go:141] libmachine: (old-k8s-version-620467) <target dev='hdc' bus='scsi'/>
I0819 13:10:37.006738 2144521 main.go:141] libmachine: (old-k8s-version-620467) <readonly/>
I0819 13:10:37.006749 2144521 main.go:141] libmachine: (old-k8s-version-620467) </disk>
I0819 13:10:37.006762 2144521 main.go:141] libmachine: (old-k8s-version-620467) <disk type='file' device='disk'>
I0819 13:10:37.006775 2144521 main.go:141] libmachine: (old-k8s-version-620467) <driver name='qemu' type='raw' cache='default' io='threads' />
I0819 13:10:37.006792 2144521 main.go:141] libmachine: (old-k8s-version-620467) <source file='/home/jenkins/minikube-integration/19479-2086935/.minikube/machines/old-k8s-version-620467/old-k8s-version-620467.rawdisk'/>
I0819 13:10:37.006807 2144521 main.go:141] libmachine: (old-k8s-version-620467) <target dev='hda' bus='virtio'/>
I0819 13:10:37.006821 2144521 main.go:141] libmachine: (old-k8s-version-620467) </disk>
I0819 13:10:37.006832 2144521 main.go:141] libmachine: (old-k8s-version-620467) <interface type='network'>
I0819 13:10:37.006873 2144521 main.go:141] libmachine: (old-k8s-version-620467) <source network='mk-old-k8s-version-620467'/>
I0819 13:10:37.006901 2144521 main.go:141] libmachine: (old-k8s-version-620467) <model type='virtio'/>
I0819 13:10:37.006912 2144521 main.go:141] libmachine: (old-k8s-version-620467) </interface>
I0819 13:10:37.006927 2144521 main.go:141] libmachine: (old-k8s-version-620467) <interface type='network'>
I0819 13:10:37.006940 2144521 main.go:141] libmachine: (old-k8s-version-620467) <source network='default'/>
I0819 13:10:37.006951 2144521 main.go:141] libmachine: (old-k8s-version-620467) <model type='virtio'/>
I0819 13:10:37.006964 2144521 main.go:141] libmachine: (old-k8s-version-620467) </interface>
I0819 13:10:37.006975 2144521 main.go:141] libmachine: (old-k8s-version-620467) <serial type='pty'>
I0819 13:10:37.006987 2144521 main.go:141] libmachine: (old-k8s-version-620467) <target port='0'/>
I0819 13:10:37.007007 2144521 main.go:141] libmachine: (old-k8s-version-620467) </serial>
I0819 13:10:37.007021 2144521 main.go:141] libmachine: (old-k8s-version-620467) <console type='pty'>
I0819 13:10:37.007046 2144521 main.go:141] libmachine: (old-k8s-version-620467) <target type='serial' port='0'/>
I0819 13:10:37.007066 2144521 main.go:141] libmachine: (old-k8s-version-620467) </console>
I0819 13:10:37.007076 2144521 main.go:141] libmachine: (old-k8s-version-620467) <rng model='virtio'>
I0819 13:10:37.007088 2144521 main.go:141] libmachine: (old-k8s-version-620467) <backend model='random'>/dev/random</backend>
I0819 13:10:37.007099 2144521 main.go:141] libmachine: (old-k8s-version-620467) </rng>
I0819 13:10:37.007108 2144521 main.go:141] libmachine: (old-k8s-version-620467)
I0819 13:10:37.007120 2144521 main.go:141] libmachine: (old-k8s-version-620467)
I0819 13:10:37.007131 2144521 main.go:141] libmachine: (old-k8s-version-620467) </devices>
I0819 13:10:37.007162 2144521 main.go:141] libmachine: (old-k8s-version-620467) </domain>
I0819 13:10:37.007186 2144521 main.go:141] libmachine: (old-k8s-version-620467)
I0819 13:10:37.011250 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:b4:bc:f9 in network default
I0819 13:10:37.011785 2144521 main.go:141] libmachine: (old-k8s-version-620467) Ensuring networks are active...
I0819 13:10:37.011809 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:37.012630 2144521 main.go:141] libmachine: (old-k8s-version-620467) Ensuring network default is active
I0819 13:10:37.013020 2144521 main.go:141] libmachine: (old-k8s-version-620467) Ensuring network mk-old-k8s-version-620467 is active
I0819 13:10:37.013685 2144521 main.go:141] libmachine: (old-k8s-version-620467) Getting domain xml...
I0819 13:10:37.014551 2144521 main.go:141] libmachine: (old-k8s-version-620467) Creating domain...
I0819 13:10:38.366450 2144521 main.go:141] libmachine: (old-k8s-version-620467) Waiting to get IP...
I0819 13:10:38.367857 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:38.368600 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | unable to find current IP address of domain old-k8s-version-620467 in network mk-old-k8s-version-620467
I0819 13:10:38.368631 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:38.368572 2146017 retry.go:31] will retry after 212.183477ms: waiting for machine to come up
I0819 13:10:38.582190 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:38.583032 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | unable to find current IP address of domain old-k8s-version-620467 in network mk-old-k8s-version-620467
I0819 13:10:38.583064 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:38.582983 2146017 retry.go:31] will retry after 236.593016ms: waiting for machine to come up
I0819 13:10:38.821866 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:38.822566 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | unable to find current IP address of domain old-k8s-version-620467 in network mk-old-k8s-version-620467
I0819 13:10:38.822601 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:38.822526 2146017 retry.go:31] will retry after 454.803905ms: waiting for machine to come up
I0819 13:10:39.279049 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:39.279510 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | unable to find current IP address of domain old-k8s-version-620467 in network mk-old-k8s-version-620467
I0819 13:10:39.279533 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:39.279461 2146017 retry.go:31] will retry after 426.014427ms: waiting for machine to come up
I0819 13:10:39.707161 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:39.707848 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | unable to find current IP address of domain old-k8s-version-620467 in network mk-old-k8s-version-620467
I0819 13:10:39.707878 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:39.707788 2146017 retry.go:31] will retry after 573.847046ms: waiting for machine to come up
I0819 13:10:40.283758 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:40.284251 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | unable to find current IP address of domain old-k8s-version-620467 in network mk-old-k8s-version-620467
I0819 13:10:40.284275 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:40.284200 2146017 retry.go:31] will retry after 587.505245ms: waiting for machine to come up
I0819 13:10:40.873205 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:40.873746 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | unable to find current IP address of domain old-k8s-version-620467 in network mk-old-k8s-version-620467
I0819 13:10:40.873783 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:40.873713 2146017 retry.go:31] will retry after 794.536659ms: waiting for machine to come up
I0819 13:10:41.670329 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:41.670837 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | unable to find current IP address of domain old-k8s-version-620467 in network mk-old-k8s-version-620467
I0819 13:10:41.670889 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:41.670797 2146017 retry.go:31] will retry after 1.420823705s: waiting for machine to come up
I0819 13:10:43.093155 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:43.093733 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | unable to find current IP address of domain old-k8s-version-620467 in network mk-old-k8s-version-620467
I0819 13:10:43.093771 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:43.093686 2146017 retry.go:31] will retry after 1.693966785s: waiting for machine to come up
I0819 13:10:44.789681 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:44.790259 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | unable to find current IP address of domain old-k8s-version-620467 in network mk-old-k8s-version-620467
I0819 13:10:44.790313 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:44.790202 2146017 retry.go:31] will retry after 1.854348429s: waiting for machine to come up
I0819 13:10:46.646583 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:46.647132 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | unable to find current IP address of domain old-k8s-version-620467 in network mk-old-k8s-version-620467
I0819 13:10:46.647165 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:46.647100 2146017 retry.go:31] will retry after 1.961413612s: waiting for machine to come up
I0819 13:10:48.610599 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:48.611096 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | unable to find current IP address of domain old-k8s-version-620467 in network mk-old-k8s-version-620467
I0819 13:10:48.611117 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:48.611014 2146017 retry.go:31] will retry after 2.933791164s: waiting for machine to come up
I0819 13:10:51.547001 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:51.547475 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | unable to find current IP address of domain old-k8s-version-620467 in network mk-old-k8s-version-620467
I0819 13:10:51.547495 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:51.547441 2146017 retry.go:31] will retry after 2.765905584s: waiting for machine to come up
I0819 13:10:54.315285 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:54.315751 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | unable to find current IP address of domain old-k8s-version-620467 in network mk-old-k8s-version-620467
I0819 13:10:54.315781 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | I0819 13:10:54.315701 2146017 retry.go:31] will retry after 5.191807089s: waiting for machine to come up
I0819 13:10:59.509240 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:59.509749 2144521 main.go:141] libmachine: (old-k8s-version-620467) Found IP for machine: 192.168.39.238
I0819 13:10:59.509771 2144521 main.go:141] libmachine: (old-k8s-version-620467) Reserving static IP address...
I0819 13:10:59.509788 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has current primary IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:59.510113 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-620467", mac: "52:54:00:88:ef:79", ip: "192.168.39.238"} in network mk-old-k8s-version-620467
I0819 13:10:59.605058 2144521 main.go:141] libmachine: (old-k8s-version-620467) Reserved static IP address: 192.168.39.238
I0819 13:10:59.605103 2144521 main.go:141] libmachine: (old-k8s-version-620467) Waiting for SSH to be available...
I0819 13:10:59.605113 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | Getting to WaitForSSH function...
I0819 13:10:59.608326 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:59.608793 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:minikube Clientid:01:52:54:00:88:ef:79}
I0819 13:10:59.608826 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:59.608936 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | Using SSH client type: external
I0819 13:10:59.608980 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | Using SSH private key: /home/jenkins/minikube-integration/19479-2086935/.minikube/machines/old-k8s-version-620467/id_rsa (-rw-------)
I0819 13:10:59.609036 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.238 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19479-2086935/.minikube/machines/old-k8s-version-620467/id_rsa -p 22] /usr/bin/ssh <nil>}
I0819 13:10:59.609052 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | About to run SSH command:
I0819 13:10:59.609100 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | exit 0
I0819 13:10:59.740375 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | SSH cmd err, output: <nil>:
I0819 13:10:59.740667 2144521 main.go:141] libmachine: (old-k8s-version-620467) KVM machine creation complete!
I0819 13:10:59.741032 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetConfigRaw
I0819 13:10:59.762985 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .DriverName
I0819 13:10:59.763306 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .DriverName
I0819 13:10:59.763528 2144521 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0819 13:10:59.763550 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetState
I0819 13:10:59.765281 2144521 main.go:141] libmachine: Detecting operating system of created instance...
I0819 13:10:59.765297 2144521 main.go:141] libmachine: Waiting for SSH to be available...
I0819 13:10:59.765311 2144521 main.go:141] libmachine: Getting to WaitForSSH function...
I0819 13:10:59.765318 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHHostname
I0819 13:10:59.768038 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:59.768797 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:old-k8s-version-620467 Clientid:01:52:54:00:88:ef:79}
I0819 13:10:59.769182 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:59.769437 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHPort
I0819 13:10:59.769659 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHKeyPath
I0819 13:10:59.769851 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHKeyPath
I0819 13:10:59.770013 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHUsername
I0819 13:10:59.770215 2144521 main.go:141] libmachine: Using SSH client type: native
I0819 13:10:59.770447 2144521 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.238 22 <nil> <nil>}
I0819 13:10:59.770461 2144521 main.go:141] libmachine: About to run SSH command:
exit 0
I0819 13:10:59.880402 2144521 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0819 13:10:59.880434 2144521 main.go:141] libmachine: Detecting the provisioner...
I0819 13:10:59.880446 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHHostname
I0819 13:10:59.884215 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:59.884570 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:old-k8s-version-620467 Clientid:01:52:54:00:88:ef:79}
I0819 13:10:59.884606 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:10:59.884767 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHPort
I0819 13:10:59.885000 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHKeyPath
I0819 13:10:59.885156 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHKeyPath
I0819 13:10:59.885308 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHUsername
I0819 13:10:59.885514 2144521 main.go:141] libmachine: Using SSH client type: native
I0819 13:10:59.885727 2144521 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.238 22 <nil> <nil>}
I0819 13:10:59.885742 2144521 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0819 13:11:00.001273 2144521 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0819 13:11:00.001381 2144521 main.go:141] libmachine: found compatible host: buildroot
I0819 13:11:00.001394 2144521 main.go:141] libmachine: Provisioning with buildroot...
I0819 13:11:00.001402 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetMachineName
I0819 13:11:00.001704 2144521 buildroot.go:166] provisioning hostname "old-k8s-version-620467"
I0819 13:11:00.001736 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetMachineName
I0819 13:11:00.001940 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHHostname
I0819 13:11:00.004756 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.005103 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:old-k8s-version-620467 Clientid:01:52:54:00:88:ef:79}
I0819 13:11:00.005126 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.005317 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHPort
I0819 13:11:00.005517 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHKeyPath
I0819 13:11:00.005690 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHKeyPath
I0819 13:11:00.005905 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHUsername
I0819 13:11:00.006059 2144521 main.go:141] libmachine: Using SSH client type: native
I0819 13:11:00.006236 2144521 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.238 22 <nil> <nil>}
I0819 13:11:00.006248 2144521 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-620467 && echo "old-k8s-version-620467" | sudo tee /etc/hostname
I0819 13:11:00.131938 2144521 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-620467
I0819 13:11:00.131985 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHHostname
I0819 13:11:00.135060 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.135411 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:old-k8s-version-620467 Clientid:01:52:54:00:88:ef:79}
I0819 13:11:00.135444 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.135611 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHPort
I0819 13:11:00.135799 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHKeyPath
I0819 13:11:00.135966 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHKeyPath
I0819 13:11:00.136129 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHUsername
I0819 13:11:00.136320 2144521 main.go:141] libmachine: Using SSH client type: native
I0819 13:11:00.136567 2144521 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.238 22 <nil> <nil>}
I0819 13:11:00.136592 2144521 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-620467' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-620467/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-620467' | sudo tee -a /etc/hosts;
fi
fi
I0819 13:11:00.254344 2144521 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0819 13:11:00.254380 2144521 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19479-2086935/.minikube CaCertPath:/home/jenkins/minikube-integration/19479-2086935/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19479-2086935/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19479-2086935/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19479-2086935/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19479-2086935/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19479-2086935/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19479-2086935/.minikube}
I0819 13:11:00.254425 2144521 buildroot.go:174] setting up certificates
I0819 13:11:00.254437 2144521 provision.go:84] configureAuth start
I0819 13:11:00.254451 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetMachineName
I0819 13:11:00.254796 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetIP
I0819 13:11:00.258161 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.258702 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:old-k8s-version-620467 Clientid:01:52:54:00:88:ef:79}
I0819 13:11:00.258736 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.258930 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHHostname
I0819 13:11:00.261599 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.261958 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:old-k8s-version-620467 Clientid:01:52:54:00:88:ef:79}
I0819 13:11:00.261990 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.262159 2144521 provision.go:143] copyHostCerts
I0819 13:11:00.262237 2144521 exec_runner.go:144] found /home/jenkins/minikube-integration/19479-2086935/.minikube/ca.pem, removing ...
I0819 13:11:00.262266 2144521 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19479-2086935/.minikube/ca.pem
I0819 13:11:00.262359 2144521 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19479-2086935/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19479-2086935/.minikube/ca.pem (1078 bytes)
I0819 13:11:00.262546 2144521 exec_runner.go:144] found /home/jenkins/minikube-integration/19479-2086935/.minikube/cert.pem, removing ...
I0819 13:11:00.262564 2144521 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19479-2086935/.minikube/cert.pem
I0819 13:11:00.262602 2144521 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19479-2086935/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19479-2086935/.minikube/cert.pem (1123 bytes)
I0819 13:11:00.262702 2144521 exec_runner.go:144] found /home/jenkins/minikube-integration/19479-2086935/.minikube/key.pem, removing ...
I0819 13:11:00.262714 2144521 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19479-2086935/.minikube/key.pem
I0819 13:11:00.262744 2144521 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19479-2086935/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19479-2086935/.minikube/key.pem (1675 bytes)
I0819 13:11:00.262824 2144521 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19479-2086935/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19479-2086935/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19479-2086935/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-620467 san=[127.0.0.1 192.168.39.238 localhost minikube old-k8s-version-620467]
I0819 13:11:00.385809 2144521 provision.go:177] copyRemoteCerts
I0819 13:11:00.385885 2144521 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0819 13:11:00.385913 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHHostname
I0819 13:11:00.389204 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.389626 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:old-k8s-version-620467 Clientid:01:52:54:00:88:ef:79}
I0819 13:11:00.389667 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.389860 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHPort
I0819 13:11:00.390066 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHKeyPath
I0819 13:11:00.390225 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHUsername
I0819 13:11:00.390343 2144521 sshutil.go:53] new ssh client: &{IP:192.168.39.238 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19479-2086935/.minikube/machines/old-k8s-version-620467/id_rsa Username:docker}
I0819 13:11:00.475338 2144521 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-2086935/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0819 13:11:00.501422 2144521 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-2086935/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0819 13:11:00.525221 2144521 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-2086935/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0819 13:11:00.548141 2144521 provision.go:87] duration metric: took 293.686161ms to configureAuth
I0819 13:11:00.548192 2144521 buildroot.go:189] setting minikube options for container-runtime
I0819 13:11:00.548378 2144521 config.go:182] Loaded profile config "old-k8s-version-620467": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0819 13:11:00.548481 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHHostname
I0819 13:11:00.551103 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.551418 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:old-k8s-version-620467 Clientid:01:52:54:00:88:ef:79}
I0819 13:11:00.551455 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.551626 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHPort
I0819 13:11:00.551821 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHKeyPath
I0819 13:11:00.552004 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHKeyPath
I0819 13:11:00.552199 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHUsername
I0819 13:11:00.552348 2144521 main.go:141] libmachine: Using SSH client type: native
I0819 13:11:00.552537 2144521 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.238 22 <nil> <nil>}
I0819 13:11:00.552551 2144521 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0819 13:11:00.828105 2144521 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0819 13:11:00.828137 2144521 main.go:141] libmachine: Checking connection to Docker...
I0819 13:11:00.828149 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetURL
I0819 13:11:00.829477 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | Using libvirt version 6000000
I0819 13:11:00.831535 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.831913 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:old-k8s-version-620467 Clientid:01:52:54:00:88:ef:79}
I0819 13:11:00.831952 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.832177 2144521 main.go:141] libmachine: Docker is up and running!
I0819 13:11:00.832196 2144521 main.go:141] libmachine: Reticulating splines...
I0819 13:11:00.832205 2144521 client.go:171] duration metric: took 24.441164705s to LocalClient.Create
I0819 13:11:00.832236 2144521 start.go:167] duration metric: took 24.441252312s to libmachine.API.Create "old-k8s-version-620467"
I0819 13:11:00.832249 2144521 start.go:293] postStartSetup for "old-k8s-version-620467" (driver="kvm2")
I0819 13:11:00.832260 2144521 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0819 13:11:00.832277 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .DriverName
I0819 13:11:00.832540 2144521 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0819 13:11:00.832565 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHHostname
I0819 13:11:00.834966 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.835433 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:old-k8s-version-620467 Clientid:01:52:54:00:88:ef:79}
I0819 13:11:00.835460 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.835635 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHPort
I0819 13:11:00.835842 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHKeyPath
I0819 13:11:00.836005 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHUsername
I0819 13:11:00.836134 2144521 sshutil.go:53] new ssh client: &{IP:192.168.39.238 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19479-2086935/.minikube/machines/old-k8s-version-620467/id_rsa Username:docker}
I0819 13:11:00.918906 2144521 ssh_runner.go:195] Run: cat /etc/os-release
I0819 13:11:00.923178 2144521 info.go:137] Remote host: Buildroot 2023.02.9
I0819 13:11:00.923211 2144521 filesync.go:126] Scanning /home/jenkins/minikube-integration/19479-2086935/.minikube/addons for local assets ...
I0819 13:11:00.923274 2144521 filesync.go:126] Scanning /home/jenkins/minikube-integration/19479-2086935/.minikube/files for local assets ...
I0819 13:11:00.923409 2144521 filesync.go:149] local asset: /home/jenkins/minikube-integration/19479-2086935/.minikube/files/etc/ssl/certs/20941932.pem -> 20941932.pem in /etc/ssl/certs
I0819 13:11:00.923524 2144521 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0819 13:11:00.933195 2144521 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-2086935/.minikube/files/etc/ssl/certs/20941932.pem --> /etc/ssl/certs/20941932.pem (1708 bytes)
I0819 13:11:00.958837 2144521 start.go:296] duration metric: took 126.571848ms for postStartSetup
I0819 13:11:00.958901 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetConfigRaw
I0819 13:11:00.959559 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetIP
I0819 13:11:00.962312 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.962763 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:old-k8s-version-620467 Clientid:01:52:54:00:88:ef:79}
I0819 13:11:00.962797 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.963091 2144521 profile.go:143] Saving config to /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/config.json ...
I0819 13:11:00.963286 2144521 start.go:128] duration metric: took 24.593728845s to createHost
I0819 13:11:00.963311 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHHostname
I0819 13:11:00.965820 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.966177 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:old-k8s-version-620467 Clientid:01:52:54:00:88:ef:79}
I0819 13:11:00.966221 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:00.966311 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHPort
I0819 13:11:00.966509 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHKeyPath
I0819 13:11:00.966675 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHKeyPath
I0819 13:11:00.966823 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHUsername
I0819 13:11:00.966982 2144521 main.go:141] libmachine: Using SSH client type: native
I0819 13:11:00.967166 2144521 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.39.238 22 <nil> <nil>}
I0819 13:11:00.967181 2144521 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0819 13:11:01.076962 2144521 main.go:141] libmachine: SSH cmd err, output: <nil>: 1724073061.048147065
I0819 13:11:01.076991 2144521 fix.go:216] guest clock: 1724073061.048147065
I0819 13:11:01.077002 2144521 fix.go:229] Guest: 2024-08-19 13:11:01.048147065 +0000 UTC Remote: 2024-08-19 13:11:00.963297489 +0000 UTC m=+50.122875252 (delta=84.849576ms)
I0819 13:11:01.077040 2144521 fix.go:200] guest clock delta is within tolerance: 84.849576ms
I0819 13:11:01.077047 2144521 start.go:83] releasing machines lock for "old-k8s-version-620467", held for 24.707681748s
I0819 13:11:01.077079 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .DriverName
I0819 13:11:01.077398 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetIP
I0819 13:11:01.080817 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:01.081261 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:old-k8s-version-620467 Clientid:01:52:54:00:88:ef:79}
I0819 13:11:01.081289 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:01.081500 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .DriverName
I0819 13:11:01.082091 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .DriverName
I0819 13:11:01.082306 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .DriverName
I0819 13:11:01.082402 2144521 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0819 13:11:01.082459 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHHostname
I0819 13:11:01.082551 2144521 ssh_runner.go:195] Run: cat /version.json
I0819 13:11:01.082575 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHHostname
I0819 13:11:01.085576 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:01.085858 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:01.085895 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:old-k8s-version-620467 Clientid:01:52:54:00:88:ef:79}
I0819 13:11:01.085917 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:01.086076 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHPort
I0819 13:11:01.086257 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHKeyPath
I0819 13:11:01.086287 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:old-k8s-version-620467 Clientid:01:52:54:00:88:ef:79}
I0819 13:11:01.086314 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:01.086431 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHUsername
I0819 13:11:01.086456 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHPort
I0819 13:11:01.086613 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHKeyPath
I0819 13:11:01.086637 2144521 sshutil.go:53] new ssh client: &{IP:192.168.39.238 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19479-2086935/.minikube/machines/old-k8s-version-620467/id_rsa Username:docker}
I0819 13:11:01.086743 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetSSHUsername
I0819 13:11:01.086906 2144521 sshutil.go:53] new ssh client: &{IP:192.168.39.238 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19479-2086935/.minikube/machines/old-k8s-version-620467/id_rsa Username:docker}
I0819 13:11:01.202563 2144521 ssh_runner.go:195] Run: systemctl --version
I0819 13:11:01.209752 2144521 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0819 13:11:01.368653 2144521 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0819 13:11:01.377368 2144521 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0819 13:11:01.377450 2144521 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0819 13:11:01.401680 2144521 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0819 13:11:01.401705 2144521 start.go:495] detecting cgroup driver to use...
I0819 13:11:01.401773 2144521 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0819 13:11:01.423577 2144521 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0819 13:11:01.438215 2144521 docker.go:217] disabling cri-docker service (if available) ...
I0819 13:11:01.438291 2144521 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0819 13:11:01.453684 2144521 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0819 13:11:01.468067 2144521 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0819 13:11:01.593562 2144521 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0819 13:11:01.752475 2144521 docker.go:233] disabling docker service ...
I0819 13:11:01.752556 2144521 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0819 13:11:01.769409 2144521 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0819 13:11:01.783520 2144521 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0819 13:11:01.934033 2144521 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0819 13:11:02.094564 2144521 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0819 13:11:02.111284 2144521 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0819 13:11:02.132775 2144521 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0819 13:11:02.132841 2144521 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0819 13:11:02.144044 2144521 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0819 13:11:02.144121 2144521 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0819 13:11:02.156893 2144521 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0819 13:11:02.173117 2144521 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0819 13:11:02.185344 2144521 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0819 13:11:02.197987 2144521 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0819 13:11:02.207857 2144521 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0819 13:11:02.207923 2144521 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0819 13:11:02.221236 2144521 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0819 13:11:02.233688 2144521 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0819 13:11:02.380412 2144521 ssh_runner.go:195] Run: sudo systemctl restart crio
I0819 13:11:02.564374 2144521 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0819 13:11:02.564443 2144521 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0819 13:11:02.573751 2144521 start.go:563] Will wait 60s for crictl version
I0819 13:11:02.573804 2144521 ssh_runner.go:195] Run: which crictl
I0819 13:11:02.582261 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0819 13:11:02.626760 2144521 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0819 13:11:02.626850 2144521 ssh_runner.go:195] Run: crio --version
I0819 13:11:02.663270 2144521 ssh_runner.go:195] Run: crio --version
I0819 13:11:02.701132 2144521 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0819 13:11:02.702109 2144521 main.go:141] libmachine: (old-k8s-version-620467) Calling .GetIP
I0819 13:11:02.705186 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:02.705591 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:ef:79", ip: ""} in network mk-old-k8s-version-620467: {Iface:virbr2 ExpiryTime:2024-08-19 14:10:52 +0000 UTC Type:0 Mac:52:54:00:88:ef:79 Iaid: IPaddr:192.168.39.238 Prefix:24 Hostname:old-k8s-version-620467 Clientid:01:52:54:00:88:ef:79}
I0819 13:11:02.705618 2144521 main.go:141] libmachine: (old-k8s-version-620467) DBG | domain old-k8s-version-620467 has defined IP address 192.168.39.238 and MAC address 52:54:00:88:ef:79 in network mk-old-k8s-version-620467
I0819 13:11:02.705871 2144521 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0819 13:11:02.711241 2144521 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0819 13:11:02.728380 2144521 kubeadm.go:883] updating cluster {Name:old-k8s-version-620467 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-620467 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.238 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0819 13:11:02.728505 2144521 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0819 13:11:02.728560 2144521 ssh_runner.go:195] Run: sudo crictl images --output json
I0819 13:11:02.771014 2144521 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0819 13:11:02.771101 2144521 ssh_runner.go:195] Run: which lz4
I0819 13:11:02.775718 2144521 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0819 13:11:02.781163 2144521 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0819 13:11:02.781195 2144521 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-2086935/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0819 13:11:04.569838 2144521 crio.go:462] duration metric: took 1.794164327s to copy over tarball
I0819 13:11:04.569917 2144521 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0819 13:11:07.541988 2144521 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.972042221s)
I0819 13:11:07.542030 2144521 crio.go:469] duration metric: took 2.972162106s to extract the tarball
I0819 13:11:07.542040 2144521 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0819 13:11:07.589187 2144521 ssh_runner.go:195] Run: sudo crictl images --output json
I0819 13:11:07.644814 2144521 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0819 13:11:07.644848 2144521 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0819 13:11:07.644938 2144521 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0819 13:11:07.644967 2144521 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0819 13:11:07.645003 2144521 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0819 13:11:07.644940 2144521 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0819 13:11:07.645073 2144521 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0819 13:11:07.644979 2144521 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0819 13:11:07.645256 2144521 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0819 13:11:07.644938 2144521 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0819 13:11:07.649568 2144521 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0819 13:11:07.649680 2144521 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0819 13:11:07.649548 2144521 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0819 13:11:07.649739 2144521 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0819 13:11:07.649846 2144521 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0819 13:11:07.649997 2144521 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0819 13:11:07.650016 2144521 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0819 13:11:07.650529 2144521 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0819 13:11:07.802106 2144521 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0819 13:11:07.816632 2144521 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0819 13:11:07.817280 2144521 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0819 13:11:07.818664 2144521 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0819 13:11:07.819569 2144521 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0819 13:11:07.848273 2144521 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0819 13:11:07.852891 2144521 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0819 13:11:07.857882 2144521 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0819 13:11:07.857938 2144521 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0819 13:11:07.857987 2144521 ssh_runner.go:195] Run: which crictl
I0819 13:11:07.911716 2144521 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0819 13:11:07.993583 2144521 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0819 13:11:07.993691 2144521 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0819 13:11:07.993758 2144521 ssh_runner.go:195] Run: which crictl
I0819 13:11:08.030548 2144521 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0819 13:11:08.031115 2144521 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0819 13:11:08.031160 2144521 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0819 13:11:08.031209 2144521 ssh_runner.go:195] Run: which crictl
I0819 13:11:08.031311 2144521 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0819 13:11:08.031331 2144521 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0819 13:11:08.031371 2144521 ssh_runner.go:195] Run: which crictl
I0819 13:11:08.031508 2144521 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0819 13:11:08.031543 2144521 ssh_runner.go:195] Run: which crictl
I0819 13:11:08.051011 2144521 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0819 13:11:08.051070 2144521 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0819 13:11:08.051118 2144521 ssh_runner.go:195] Run: which crictl
I0819 13:11:08.051217 2144521 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0819 13:11:08.051244 2144521 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0819 13:11:08.051265 2144521 ssh_runner.go:195] Run: which crictl
I0819 13:11:08.051337 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0819 13:11:08.170839 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0819 13:11:08.170984 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0819 13:11:08.171049 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0819 13:11:08.171113 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0819 13:11:08.171226 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0819 13:11:08.171301 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0819 13:11:08.171380 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0819 13:11:08.355760 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0819 13:11:08.355833 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0819 13:11:08.355936 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0819 13:11:08.355954 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0819 13:11:08.356015 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0819 13:11:08.356092 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0819 13:11:08.356115 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0819 13:11:08.521649 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0819 13:11:08.521791 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0819 13:11:08.530764 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0819 13:11:08.530933 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0819 13:11:08.531039 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0819 13:11:08.531164 2144521 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19479-2086935/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0819 13:11:08.531348 2144521 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0819 13:11:08.647045 2144521 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19479-2086935/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0819 13:11:08.663751 2144521 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19479-2086935/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0819 13:11:08.663823 2144521 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19479-2086935/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0819 13:11:08.663915 2144521 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19479-2086935/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0819 13:11:08.686425 2144521 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19479-2086935/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0819 13:11:08.686528 2144521 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19479-2086935/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0819 13:11:08.686566 2144521 cache_images.go:92] duration metric: took 1.041701275s to LoadCachedImages
W0819 13:11:08.686645 2144521 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19479-2086935/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19479-2086935/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
I0819 13:11:08.686657 2144521 kubeadm.go:934] updating node { 192.168.39.238 8443 v1.20.0 crio true true} ...
I0819 13:11:08.686793 2144521 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-620467 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.238
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-620467 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0819 13:11:08.686867 2144521 ssh_runner.go:195] Run: crio config
I0819 13:11:08.736062 2144521 cni.go:84] Creating CNI manager for ""
I0819 13:11:08.736086 2144521 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0819 13:11:08.736098 2144521 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0819 13:11:08.736120 2144521 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.238 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-620467 NodeName:old-k8s-version-620467 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.238"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.238 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0819 13:11:08.736296 2144521 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.238
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-620467"
kubeletExtraArgs:
node-ip: 192.168.39.238
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.238"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0819 13:11:08.736361 2144521 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0819 13:11:08.748174 2144521 binaries.go:44] Found k8s binaries, skipping transfer
I0819 13:11:08.748252 2144521 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0819 13:11:08.759570 2144521 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0819 13:11:08.777297 2144521 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0819 13:11:08.796417 2144521 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0819 13:11:08.817553 2144521 ssh_runner.go:195] Run: grep 192.168.39.238 control-plane.minikube.internal$ /etc/hosts
I0819 13:11:08.821787 2144521 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.238 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0819 13:11:08.836442 2144521 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0819 13:11:09.006930 2144521 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0819 13:11:09.024435 2144521 certs.go:68] Setting up /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467 for IP: 192.168.39.238
I0819 13:11:09.024466 2144521 certs.go:194] generating shared ca certs ...
I0819 13:11:09.024489 2144521 certs.go:226] acquiring lock for ca certs: {Name:mkb3c2422cbedf8a27f3584c3a3ecbed30049e1b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 13:11:09.024691 2144521 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19479-2086935/.minikube/ca.key
I0819 13:11:09.024752 2144521 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19479-2086935/.minikube/proxy-client-ca.key
I0819 13:11:09.024767 2144521 certs.go:256] generating profile certs ...
I0819 13:11:09.024846 2144521 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/client.key
I0819 13:11:09.024864 2144521 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/client.crt with IP's: []
I0819 13:11:09.138418 2144521 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/client.crt ...
I0819 13:11:09.138461 2144521 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/client.crt: {Name:mkcd63956c5baca319ea20fc314b032a92fa0a3c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 13:11:09.138678 2144521 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/client.key ...
I0819 13:11:09.138696 2144521 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/client.key: {Name:mk5d546432a6f3b0e38fb4f3fcdbd8037e0cbc7e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 13:11:09.138829 2144521 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/apiserver.key.53723c14
I0819 13:11:09.138852 2144521 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/apiserver.crt.53723c14 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.238]
I0819 13:11:09.284157 2144521 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/apiserver.crt.53723c14 ...
I0819 13:11:09.284206 2144521 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/apiserver.crt.53723c14: {Name:mk5121e0e97e0f6eac9c9fa63f4478a65765c851 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 13:11:09.284463 2144521 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/apiserver.key.53723c14 ...
I0819 13:11:09.284486 2144521 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/apiserver.key.53723c14: {Name:mka4856bab4efb19cadab94fc1536e61fb65c3b6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 13:11:09.284612 2144521 certs.go:381] copying /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/apiserver.crt.53723c14 -> /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/apiserver.crt
I0819 13:11:09.284726 2144521 certs.go:385] copying /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/apiserver.key.53723c14 -> /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/apiserver.key
I0819 13:11:09.284818 2144521 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/proxy-client.key
I0819 13:11:09.284841 2144521 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/proxy-client.crt with IP's: []
I0819 13:11:09.348905 2144521 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/proxy-client.crt ...
I0819 13:11:09.348938 2144521 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/proxy-client.crt: {Name:mk95c0904bf11ae613b448e10c407518d04ffccf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 13:11:09.440643 2144521 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/proxy-client.key ...
I0819 13:11:09.440731 2144521 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/proxy-client.key: {Name:mke98392c678cdf1745bb17320b717d3f8dd63b6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0819 13:11:09.441080 2144521 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-2086935/.minikube/certs/2094193.pem (1338 bytes)
W0819 13:11:09.441143 2144521 certs.go:480] ignoring /home/jenkins/minikube-integration/19479-2086935/.minikube/certs/2094193_empty.pem, impossibly tiny 0 bytes
I0819 13:11:09.441165 2144521 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-2086935/.minikube/certs/ca-key.pem (1675 bytes)
I0819 13:11:09.441204 2144521 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-2086935/.minikube/certs/ca.pem (1078 bytes)
I0819 13:11:09.441236 2144521 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-2086935/.minikube/certs/cert.pem (1123 bytes)
I0819 13:11:09.441284 2144521 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-2086935/.minikube/certs/key.pem (1675 bytes)
I0819 13:11:09.441360 2144521 certs.go:484] found cert: /home/jenkins/minikube-integration/19479-2086935/.minikube/files/etc/ssl/certs/20941932.pem (1708 bytes)
I0819 13:11:09.442349 2144521 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-2086935/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0819 13:11:09.471583 2144521 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-2086935/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0819 13:11:09.498989 2144521 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-2086935/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0819 13:11:09.525971 2144521 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-2086935/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0819 13:11:09.553122 2144521 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0819 13:11:09.580758 2144521 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0819 13:11:09.626281 2144521 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0819 13:11:09.655685 2144521 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-2086935/.minikube/profiles/old-k8s-version-620467/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0819 13:11:09.690720 2144521 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-2086935/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0819 13:11:09.719160 2144521 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-2086935/.minikube/certs/2094193.pem --> /usr/share/ca-certificates/2094193.pem (1338 bytes)
I0819 13:11:09.745144 2144521 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19479-2086935/.minikube/files/etc/ssl/certs/20941932.pem --> /usr/share/ca-certificates/20941932.pem (1708 bytes)
I0819 13:11:09.770978 2144521 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0819 13:11:09.789313 2144521 ssh_runner.go:195] Run: openssl version
I0819 13:11:09.795574 2144521 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0819 13:11:09.807362 2144521 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0819 13:11:09.813247 2144521 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 19 11:57 /usr/share/ca-certificates/minikubeCA.pem
I0819 13:11:09.813330 2144521 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0819 13:11:09.820316 2144521 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0819 13:11:09.832779 2144521 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2094193.pem && ln -fs /usr/share/ca-certificates/2094193.pem /etc/ssl/certs/2094193.pem"
I0819 13:11:09.846948 2144521 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2094193.pem
I0819 13:11:09.851828 2144521 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 19 12:08 /usr/share/ca-certificates/2094193.pem
I0819 13:11:09.851896 2144521 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2094193.pem
I0819 13:11:09.857987 2144521 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/2094193.pem /etc/ssl/certs/51391683.0"
I0819 13:11:09.872670 2144521 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/20941932.pem && ln -fs /usr/share/ca-certificates/20941932.pem /etc/ssl/certs/20941932.pem"
I0819 13:11:09.887717 2144521 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/20941932.pem
I0819 13:11:09.897109 2144521 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 19 12:08 /usr/share/ca-certificates/20941932.pem
I0819 13:11:09.897174 2144521 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/20941932.pem
I0819 13:11:09.905630 2144521 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/20941932.pem /etc/ssl/certs/3ec20f2e.0"
I0819 13:11:09.925676 2144521 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0819 13:11:09.932317 2144521 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0819 13:11:09.932382 2144521 kubeadm.go:392] StartCluster: {Name:old-k8s-version-620467 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1723740748-19452@sha256:2211a6931895d2d502e957e9667096db10734a96767d670cb4dbffdd37397b0d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-620467 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.238 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0819 13:11:09.932496 2144521 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0819 13:11:09.932577 2144521 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0819 13:11:10.032470 2144521 cri.go:89] found id: ""
I0819 13:11:10.032556 2144521 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0819 13:11:10.049596 2144521 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0819 13:11:10.061331 2144521 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0819 13:11:10.073503 2144521 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0819 13:11:10.073530 2144521 kubeadm.go:157] found existing configuration files:
I0819 13:11:10.073595 2144521 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0819 13:11:10.083952 2144521 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0819 13:11:10.084054 2144521 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0819 13:11:10.096372 2144521 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0819 13:11:10.108843 2144521 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0819 13:11:10.108903 2144521 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0819 13:11:10.121650 2144521 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0819 13:11:10.133702 2144521 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0819 13:11:10.133757 2144521 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0819 13:11:10.147012 2144521 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0819 13:11:10.158108 2144521 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0819 13:11:10.158173 2144521 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0819 13:11:10.171646 2144521 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0819 13:11:10.347593 2144521 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0819 13:11:10.347707 2144521 kubeadm.go:310] [preflight] Running pre-flight checks
I0819 13:11:10.548691 2144521 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0819 13:11:10.548865 2144521 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0819 13:11:10.549041 2144521 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0819 13:11:10.800207 2144521 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0819 13:11:10.807735 2144521 out.go:235] - Generating certificates and keys ...
I0819 13:11:10.807862 2144521 kubeadm.go:310] [certs] Using existing ca certificate authority
I0819 13:11:10.807946 2144521 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0819 13:11:11.224858 2144521 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0819 13:11:11.632391 2144521 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0819 13:11:11.743173 2144521 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0819 13:11:12.040900 2144521 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0819 13:11:12.165763 2144521 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0819 13:11:12.166117 2144521 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-620467] and IPs [192.168.39.238 127.0.0.1 ::1]
I0819 13:11:12.364381 2144521 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0819 13:11:12.364575 2144521 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-620467] and IPs [192.168.39.238 127.0.0.1 ::1]
I0819 13:11:12.659809 2144521 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0819 13:11:12.769071 2144521 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0819 13:11:12.916712 2144521 kubeadm.go:310] [certs] Generating "sa" key and public key
I0819 13:11:12.916777 2144521 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0819 13:11:13.188383 2144521 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0819 13:11:13.410505 2144521 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0819 13:11:13.658061 2144521 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0819 13:11:14.349804 2144521 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0819 13:11:14.375356 2144521 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0819 13:11:14.375654 2144521 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0819 13:11:14.375729 2144521 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0819 13:11:14.611141 2144521 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0819 13:11:14.612609 2144521 out.go:235] - Booting up control plane ...
I0819 13:11:14.612767 2144521 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0819 13:11:14.633084 2144521 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0819 13:11:14.633812 2144521 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0819 13:11:14.639313 2144521 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0819 13:11:14.648767 2144521 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0819 13:11:54.642132 2144521 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0819 13:11:54.642796 2144521 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 13:11:54.643043 2144521 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 13:11:59.643606 2144521 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 13:11:59.643879 2144521 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 13:12:09.642917 2144521 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 13:12:09.643197 2144521 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 13:12:29.642685 2144521 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 13:12:29.642992 2144521 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 13:13:09.644512 2144521 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 13:13:09.645173 2144521 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 13:13:09.645198 2144521 kubeadm.go:310]
I0819 13:13:09.645324 2144521 kubeadm.go:310] Unfortunately, an error has occurred:
I0819 13:13:09.645460 2144521 kubeadm.go:310] timed out waiting for the condition
I0819 13:13:09.645487 2144521 kubeadm.go:310]
I0819 13:13:09.645560 2144521 kubeadm.go:310] This error is likely caused by:
I0819 13:13:09.645629 2144521 kubeadm.go:310] - The kubelet is not running
I0819 13:13:09.645848 2144521 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0819 13:13:09.645864 2144521 kubeadm.go:310]
I0819 13:13:09.646092 2144521 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0819 13:13:09.646170 2144521 kubeadm.go:310] - 'systemctl status kubelet'
I0819 13:13:09.646246 2144521 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0819 13:13:09.646255 2144521 kubeadm.go:310]
I0819 13:13:09.646502 2144521 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0819 13:13:09.646675 2144521 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0819 13:13:09.646687 2144521 kubeadm.go:310]
I0819 13:13:09.646911 2144521 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0819 13:13:09.647092 2144521 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0819 13:13:09.647262 2144521 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0819 13:13:09.647428 2144521 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0819 13:13:09.647458 2144521 kubeadm.go:310]
I0819 13:13:09.647905 2144521 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0819 13:13:09.648652 2144521 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0819 13:13:09.648806 2144521 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0819 13:13:09.648918 2144521 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-620467] and IPs [192.168.39.238 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-620467] and IPs [192.168.39.238 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-620467] and IPs [192.168.39.238 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-620467] and IPs [192.168.39.238 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0819 13:13:09.648971 2144521 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0819 13:13:10.141056 2144521 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0819 13:13:10.155553 2144521 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0819 13:13:10.165640 2144521 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0819 13:13:10.165660 2144521 kubeadm.go:157] found existing configuration files:
I0819 13:13:10.165706 2144521 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0819 13:13:10.176240 2144521 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0819 13:13:10.176313 2144521 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0819 13:13:10.187220 2144521 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0819 13:13:10.197787 2144521 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0819 13:13:10.197881 2144521 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0819 13:13:10.208492 2144521 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0819 13:13:10.218870 2144521 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0819 13:13:10.218930 2144521 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0819 13:13:10.229422 2144521 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0819 13:13:10.238612 2144521 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0819 13:13:10.238669 2144521 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0819 13:13:10.247866 2144521 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0819 13:13:10.318229 2144521 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0819 13:13:10.318313 2144521 kubeadm.go:310] [preflight] Running pre-flight checks
I0819 13:13:10.475208 2144521 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0819 13:13:10.475381 2144521 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0819 13:13:10.475559 2144521 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0819 13:13:10.692963 2144521 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0819 13:13:10.694437 2144521 out.go:235] - Generating certificates and keys ...
I0819 13:13:10.694555 2144521 kubeadm.go:310] [certs] Using existing ca certificate authority
I0819 13:13:10.694643 2144521 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0819 13:13:10.694752 2144521 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0819 13:13:10.694862 2144521 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0819 13:13:10.694959 2144521 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0819 13:13:10.695246 2144521 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0819 13:13:10.695673 2144521 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0819 13:13:10.696170 2144521 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0819 13:13:10.696711 2144521 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0819 13:13:10.697193 2144521 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0819 13:13:10.697379 2144521 kubeadm.go:310] [certs] Using the existing "sa" key
I0819 13:13:10.697484 2144521 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0819 13:13:10.822045 2144521 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0819 13:13:11.013274 2144521 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0819 13:13:11.198491 2144521 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0819 13:13:11.256177 2144521 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0819 13:13:11.270916 2144521 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0819 13:13:11.271054 2144521 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0819 13:13:11.271118 2144521 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0819 13:13:11.408953 2144521 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0819 13:13:11.410663 2144521 out.go:235] - Booting up control plane ...
I0819 13:13:11.410771 2144521 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0819 13:13:11.419276 2144521 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0819 13:13:11.421901 2144521 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0819 13:13:11.422637 2144521 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0819 13:13:11.429253 2144521 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0819 13:13:51.431735 2144521 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0819 13:13:51.431947 2144521 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 13:13:51.432123 2144521 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 13:13:56.432831 2144521 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 13:13:56.433034 2144521 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 13:14:06.433541 2144521 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 13:14:06.433753 2144521 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 13:14:26.432855 2144521 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 13:14:26.433034 2144521 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 13:15:06.433063 2144521 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0819 13:15:06.433393 2144521 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0819 13:15:06.433427 2144521 kubeadm.go:310]
I0819 13:15:06.433484 2144521 kubeadm.go:310] Unfortunately, an error has occurred:
I0819 13:15:06.433544 2144521 kubeadm.go:310] timed out waiting for the condition
I0819 13:15:06.433554 2144521 kubeadm.go:310]
I0819 13:15:06.433608 2144521 kubeadm.go:310] This error is likely caused by:
I0819 13:15:06.433654 2144521 kubeadm.go:310] - The kubelet is not running
I0819 13:15:06.433808 2144521 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0819 13:15:06.433843 2144521 kubeadm.go:310]
I0819 13:15:06.433962 2144521 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0819 13:15:06.434011 2144521 kubeadm.go:310] - 'systemctl status kubelet'
I0819 13:15:06.434069 2144521 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0819 13:15:06.434078 2144521 kubeadm.go:310]
I0819 13:15:06.434283 2144521 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0819 13:15:06.434355 2144521 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0819 13:15:06.434364 2144521 kubeadm.go:310]
I0819 13:15:06.434466 2144521 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0819 13:15:06.434542 2144521 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0819 13:15:06.434606 2144521 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0819 13:15:06.434713 2144521 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0819 13:15:06.434739 2144521 kubeadm.go:310]
I0819 13:15:06.435689 2144521 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0819 13:15:06.435801 2144521 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0819 13:15:06.435898 2144521 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0819 13:15:06.435993 2144521 kubeadm.go:394] duration metric: took 3m56.503620155s to StartCluster
I0819 13:15:06.436058 2144521 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0819 13:15:06.436138 2144521 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0819 13:15:06.479572 2144521 cri.go:89] found id: ""
I0819 13:15:06.479617 2144521 logs.go:276] 0 containers: []
W0819 13:15:06.479627 2144521 logs.go:278] No container was found matching "kube-apiserver"
I0819 13:15:06.479633 2144521 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0819 13:15:06.479730 2144521 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0819 13:15:06.515059 2144521 cri.go:89] found id: ""
I0819 13:15:06.515108 2144521 logs.go:276] 0 containers: []
W0819 13:15:06.515121 2144521 logs.go:278] No container was found matching "etcd"
I0819 13:15:06.515129 2144521 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0819 13:15:06.515192 2144521 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0819 13:15:06.556349 2144521 cri.go:89] found id: ""
I0819 13:15:06.556384 2144521 logs.go:276] 0 containers: []
W0819 13:15:06.556395 2144521 logs.go:278] No container was found matching "coredns"
I0819 13:15:06.556403 2144521 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0819 13:15:06.556468 2144521 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0819 13:15:06.592190 2144521 cri.go:89] found id: ""
I0819 13:15:06.592228 2144521 logs.go:276] 0 containers: []
W0819 13:15:06.592238 2144521 logs.go:278] No container was found matching "kube-scheduler"
I0819 13:15:06.592246 2144521 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0819 13:15:06.592308 2144521 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0819 13:15:06.628013 2144521 cri.go:89] found id: ""
I0819 13:15:06.628045 2144521 logs.go:276] 0 containers: []
W0819 13:15:06.628057 2144521 logs.go:278] No container was found matching "kube-proxy"
I0819 13:15:06.628065 2144521 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0819 13:15:06.628132 2144521 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0819 13:15:06.664103 2144521 cri.go:89] found id: ""
I0819 13:15:06.664132 2144521 logs.go:276] 0 containers: []
W0819 13:15:06.664141 2144521 logs.go:278] No container was found matching "kube-controller-manager"
I0819 13:15:06.664149 2144521 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0819 13:15:06.664222 2144521 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0819 13:15:06.700725 2144521 cri.go:89] found id: ""
I0819 13:15:06.700757 2144521 logs.go:276] 0 containers: []
W0819 13:15:06.700765 2144521 logs.go:278] No container was found matching "kindnet"
I0819 13:15:06.700776 2144521 logs.go:123] Gathering logs for container status ...
I0819 13:15:06.700795 2144521 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0819 13:15:06.741754 2144521 logs.go:123] Gathering logs for kubelet ...
I0819 13:15:06.741800 2144521 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0819 13:15:06.801613 2144521 logs.go:123] Gathering logs for dmesg ...
I0819 13:15:06.801666 2144521 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0819 13:15:06.823414 2144521 logs.go:123] Gathering logs for describe nodes ...
I0819 13:15:06.823445 2144521 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0819 13:15:06.964872 2144521 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0819 13:15:06.964899 2144521 logs.go:123] Gathering logs for CRI-O ...
I0819 13:15:06.964918 2144521 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
W0819 13:15:07.075674 2144521 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0819 13:15:07.075797 2144521 out.go:270] *
*
W0819 13:15:07.075880 2144521 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0819 13:15:07.075907 2144521 out.go:270] *
*
W0819 13:15:07.076758 2144521 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0819 13:15:07.080222 2144521 out.go:201]
W0819 13:15:07.082046 2144521 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0819 13:15:07.082096 2144521 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0819 13:15:07.082132 2144521 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0819 13:15:07.083481 2144521 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-620467 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-620467 -n old-k8s-version-620467
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-620467 -n old-k8s-version-620467: exit status 6 (253.182075ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0819 13:15:07.375922 2151927 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-620467" does not appear in /home/jenkins/minikube-integration/19479-2086935/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-620467" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (296.56s)