=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-795352 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-795352 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (5m0.551620821s)
-- stdout --
* [old-k8s-version-795352] minikube v1.33.0-beta.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18649
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18649-3628/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18649-3628/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-795352" primary control-plane node in "old-k8s-version-795352" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0416 17:22:55.463708 45115 out.go:291] Setting OutFile to fd 1 ...
I0416 17:22:55.463948 45115 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0416 17:22:55.463957 45115 out.go:304] Setting ErrFile to fd 2...
I0416 17:22:55.463962 45115 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0416 17:22:55.464181 45115 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18649-3628/.minikube/bin
I0416 17:22:55.464711 45115 out.go:298] Setting JSON to false
I0416 17:22:55.465557 45115 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":3927,"bootTime":1713284248,"procs":182,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0416 17:22:55.465613 45115 start.go:139] virtualization: kvm guest
I0416 17:22:55.467925 45115 out.go:177] * [old-k8s-version-795352] minikube v1.33.0-beta.0 on Ubuntu 20.04 (kvm/amd64)
I0416 17:22:55.470724 45115 out.go:177] - MINIKUBE_LOCATION=18649
I0416 17:22:55.470072 45115 notify.go:220] Checking for updates...
I0416 17:22:55.473219 45115 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0416 17:22:55.476792 45115 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18649-3628/kubeconfig
I0416 17:22:55.478055 45115 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18649-3628/.minikube
I0416 17:22:55.479284 45115 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0416 17:22:55.480727 45115 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0416 17:22:55.482416 45115 driver.go:392] Setting default libvirt URI to qemu:///system
I0416 17:22:55.524012 45115 out.go:177] * Using the kvm2 driver based on user configuration
I0416 17:22:55.525336 45115 start.go:297] selected driver: kvm2
I0416 17:22:55.525349 45115 start.go:901] validating driver "kvm2" against <nil>
I0416 17:22:55.525361 45115 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0416 17:22:55.526328 45115 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0416 17:22:55.545077 45115 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18649-3628/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0416 17:22:55.562814 45115 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0-beta.0
I0416 17:22:55.562856 45115 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0416 17:22:55.563053 45115 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0416 17:22:55.563123 45115 cni.go:84] Creating CNI manager for ""
I0416 17:22:55.563137 45115 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0416 17:22:55.563145 45115 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0416 17:22:55.563194 45115 start.go:340] cluster config:
{Name:old-k8s-version-795352 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-795352 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0416 17:22:55.563284 45115 iso.go:125] acquiring lock: {Name:mk3888719222dce6df586b814751e2a4f8b5072d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0416 17:22:55.565021 45115 out.go:177] * Starting "old-k8s-version-795352" primary control-plane node in "old-k8s-version-795352" cluster
I0416 17:22:55.566384 45115 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0416 17:22:55.566429 45115 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18649-3628/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0416 17:22:55.566448 45115 cache.go:56] Caching tarball of preloaded images
I0416 17:22:55.566644 45115 preload.go:173] Found /home/jenkins/minikube-integration/18649-3628/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0416 17:22:55.566677 45115 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0416 17:22:55.567247 45115 profile.go:143] Saving config to /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/config.json ...
I0416 17:22:55.567312 45115 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/config.json: {Name:mk89a4d870c1a1e3739526ed4481fded6f20b765 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0416 17:22:55.567504 45115 start.go:360] acquireMachinesLock for old-k8s-version-795352: {Name:mk8a94aad43bb997463d1a4d11a9eec22146ca4f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0416 17:23:20.254695 45115 start.go:364] duration metric: took 24.687127936s to acquireMachinesLock for "old-k8s-version-795352"
I0416 17:23:20.254751 45115 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-795352 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-795352 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0416 17:23:20.254938 45115 start.go:125] createHost starting for "" (driver="kvm2")
I0416 17:23:20.257350 45115 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0416 17:23:20.257600 45115 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0416 17:23:20.257653 45115 main.go:141] libmachine: Launching plugin server for driver kvm2
I0416 17:23:20.274089 45115 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41253
I0416 17:23:20.274568 45115 main.go:141] libmachine: () Calling .GetVersion
I0416 17:23:20.275146 45115 main.go:141] libmachine: Using API Version 1
I0416 17:23:20.275163 45115 main.go:141] libmachine: () Calling .SetConfigRaw
I0416 17:23:20.275477 45115 main.go:141] libmachine: () Calling .GetMachineName
I0416 17:23:20.275683 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetMachineName
I0416 17:23:20.275835 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .DriverName
I0416 17:23:20.276008 45115 start.go:159] libmachine.API.Create for "old-k8s-version-795352" (driver="kvm2")
I0416 17:23:20.276037 45115 client.go:168] LocalClient.Create starting
I0416 17:23:20.276069 45115 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18649-3628/.minikube/certs/ca.pem
I0416 17:23:20.276110 45115 main.go:141] libmachine: Decoding PEM data...
I0416 17:23:20.276144 45115 main.go:141] libmachine: Parsing certificate...
I0416 17:23:20.276209 45115 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18649-3628/.minikube/certs/cert.pem
I0416 17:23:20.276234 45115 main.go:141] libmachine: Decoding PEM data...
I0416 17:23:20.276249 45115 main.go:141] libmachine: Parsing certificate...
I0416 17:23:20.276278 45115 main.go:141] libmachine: Running pre-create checks...
I0416 17:23:20.276291 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .PreCreateCheck
I0416 17:23:20.276721 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetConfigRaw
I0416 17:23:20.277160 45115 main.go:141] libmachine: Creating machine...
I0416 17:23:20.277177 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .Create
I0416 17:23:20.277327 45115 main.go:141] libmachine: (old-k8s-version-795352) Creating KVM machine...
I0416 17:23:20.278339 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found existing default KVM network
I0416 17:23:20.279039 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:20.278884 45444 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:fb:82:0f} reservation:<nil>}
I0416 17:23:20.279692 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:20.279611 45444 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00010fa50}
I0416 17:23:20.279726 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | created network xml:
I0416 17:23:20.279747 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | <network>
I0416 17:23:20.279763 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | <name>mk-old-k8s-version-795352</name>
I0416 17:23:20.279778 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | <dns enable='no'/>
I0416 17:23:20.279790 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG |
I0416 17:23:20.279802 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0416 17:23:20.279826 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | <dhcp>
I0416 17:23:20.279839 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0416 17:23:20.279855 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | </dhcp>
I0416 17:23:20.279867 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | </ip>
I0416 17:23:20.279876 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG |
I0416 17:23:20.279887 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | </network>
I0416 17:23:20.279901 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG |
I0416 17:23:20.285194 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | trying to create private KVM network mk-old-k8s-version-795352 192.168.50.0/24...
I0416 17:23:20.354561 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | private KVM network mk-old-k8s-version-795352 192.168.50.0/24 created
I0416 17:23:20.354638 45115 main.go:141] libmachine: (old-k8s-version-795352) Setting up store path in /home/jenkins/minikube-integration/18649-3628/.minikube/machines/old-k8s-version-795352 ...
I0416 17:23:20.354668 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:20.354529 45444 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18649-3628/.minikube
I0416 17:23:20.354686 45115 main.go:141] libmachine: (old-k8s-version-795352) Building disk image from file:///home/jenkins/minikube-integration/18649-3628/.minikube/cache/iso/amd64/minikube-v1.33.0-1713236417-18649-amd64.iso
I0416 17:23:20.354902 45115 main.go:141] libmachine: (old-k8s-version-795352) Downloading /home/jenkins/minikube-integration/18649-3628/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18649-3628/.minikube/cache/iso/amd64/minikube-v1.33.0-1713236417-18649-amd64.iso...
I0416 17:23:20.572903 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:20.572801 45444 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18649-3628/.minikube/machines/old-k8s-version-795352/id_rsa...
I0416 17:23:20.669590 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:20.669472 45444 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18649-3628/.minikube/machines/old-k8s-version-795352/old-k8s-version-795352.rawdisk...
I0416 17:23:20.669626 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | Writing magic tar header
I0416 17:23:20.669700 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | Writing SSH key tar header
I0416 17:23:20.669731 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:20.669589 45444 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18649-3628/.minikube/machines/old-k8s-version-795352 ...
I0416 17:23:20.669773 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18649-3628/.minikube/machines/old-k8s-version-795352
I0416 17:23:20.669801 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18649-3628/.minikube/machines
I0416 17:23:20.669815 45115 main.go:141] libmachine: (old-k8s-version-795352) Setting executable bit set on /home/jenkins/minikube-integration/18649-3628/.minikube/machines/old-k8s-version-795352 (perms=drwx------)
I0416 17:23:20.669839 45115 main.go:141] libmachine: (old-k8s-version-795352) Setting executable bit set on /home/jenkins/minikube-integration/18649-3628/.minikube/machines (perms=drwxr-xr-x)
I0416 17:23:20.669854 45115 main.go:141] libmachine: (old-k8s-version-795352) Setting executable bit set on /home/jenkins/minikube-integration/18649-3628/.minikube (perms=drwxr-xr-x)
I0416 17:23:20.669868 45115 main.go:141] libmachine: (old-k8s-version-795352) Setting executable bit set on /home/jenkins/minikube-integration/18649-3628 (perms=drwxrwxr-x)
I0416 17:23:20.669880 45115 main.go:141] libmachine: (old-k8s-version-795352) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0416 17:23:20.669894 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18649-3628/.minikube
I0416 17:23:20.669907 45115 main.go:141] libmachine: (old-k8s-version-795352) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0416 17:23:20.669924 45115 main.go:141] libmachine: (old-k8s-version-795352) Creating domain...
I0416 17:23:20.669938 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18649-3628
I0416 17:23:20.669967 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0416 17:23:20.669992 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | Checking permissions on dir: /home/jenkins
I0416 17:23:20.670006 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | Checking permissions on dir: /home
I0416 17:23:20.670022 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | Skipping /home - not owner
I0416 17:23:20.670927 45115 main.go:141] libmachine: (old-k8s-version-795352) define libvirt domain using xml:
I0416 17:23:20.670951 45115 main.go:141] libmachine: (old-k8s-version-795352) <domain type='kvm'>
I0416 17:23:20.670962 45115 main.go:141] libmachine: (old-k8s-version-795352) <name>old-k8s-version-795352</name>
I0416 17:23:20.670970 45115 main.go:141] libmachine: (old-k8s-version-795352) <memory unit='MiB'>2200</memory>
I0416 17:23:20.670982 45115 main.go:141] libmachine: (old-k8s-version-795352) <vcpu>2</vcpu>
I0416 17:23:20.670993 45115 main.go:141] libmachine: (old-k8s-version-795352) <features>
I0416 17:23:20.671001 45115 main.go:141] libmachine: (old-k8s-version-795352) <acpi/>
I0416 17:23:20.671012 45115 main.go:141] libmachine: (old-k8s-version-795352) <apic/>
I0416 17:23:20.671035 45115 main.go:141] libmachine: (old-k8s-version-795352) <pae/>
I0416 17:23:20.671046 45115 main.go:141] libmachine: (old-k8s-version-795352)
I0416 17:23:20.671055 45115 main.go:141] libmachine: (old-k8s-version-795352) </features>
I0416 17:23:20.671066 45115 main.go:141] libmachine: (old-k8s-version-795352) <cpu mode='host-passthrough'>
I0416 17:23:20.671073 45115 main.go:141] libmachine: (old-k8s-version-795352)
I0416 17:23:20.671082 45115 main.go:141] libmachine: (old-k8s-version-795352) </cpu>
I0416 17:23:20.671091 45115 main.go:141] libmachine: (old-k8s-version-795352) <os>
I0416 17:23:20.671114 45115 main.go:141] libmachine: (old-k8s-version-795352) <type>hvm</type>
I0416 17:23:20.671127 45115 main.go:141] libmachine: (old-k8s-version-795352) <boot dev='cdrom'/>
I0416 17:23:20.671137 45115 main.go:141] libmachine: (old-k8s-version-795352) <boot dev='hd'/>
I0416 17:23:20.671160 45115 main.go:141] libmachine: (old-k8s-version-795352) <bootmenu enable='no'/>
I0416 17:23:20.671169 45115 main.go:141] libmachine: (old-k8s-version-795352) </os>
I0416 17:23:20.671178 45115 main.go:141] libmachine: (old-k8s-version-795352) <devices>
I0416 17:23:20.671190 45115 main.go:141] libmachine: (old-k8s-version-795352) <disk type='file' device='cdrom'>
I0416 17:23:20.671208 45115 main.go:141] libmachine: (old-k8s-version-795352) <source file='/home/jenkins/minikube-integration/18649-3628/.minikube/machines/old-k8s-version-795352/boot2docker.iso'/>
I0416 17:23:20.671220 45115 main.go:141] libmachine: (old-k8s-version-795352) <target dev='hdc' bus='scsi'/>
I0416 17:23:20.671232 45115 main.go:141] libmachine: (old-k8s-version-795352) <readonly/>
I0416 17:23:20.671242 45115 main.go:141] libmachine: (old-k8s-version-795352) </disk>
I0416 17:23:20.671251 45115 main.go:141] libmachine: (old-k8s-version-795352) <disk type='file' device='disk'>
I0416 17:23:20.671273 45115 main.go:141] libmachine: (old-k8s-version-795352) <driver name='qemu' type='raw' cache='default' io='threads' />
I0416 17:23:20.671292 45115 main.go:141] libmachine: (old-k8s-version-795352) <source file='/home/jenkins/minikube-integration/18649-3628/.minikube/machines/old-k8s-version-795352/old-k8s-version-795352.rawdisk'/>
I0416 17:23:20.671303 45115 main.go:141] libmachine: (old-k8s-version-795352) <target dev='hda' bus='virtio'/>
I0416 17:23:20.671313 45115 main.go:141] libmachine: (old-k8s-version-795352) </disk>
I0416 17:23:20.671325 45115 main.go:141] libmachine: (old-k8s-version-795352) <interface type='network'>
I0416 17:23:20.671337 45115 main.go:141] libmachine: (old-k8s-version-795352) <source network='mk-old-k8s-version-795352'/>
I0416 17:23:20.671347 45115 main.go:141] libmachine: (old-k8s-version-795352) <model type='virtio'/>
I0416 17:23:20.671360 45115 main.go:141] libmachine: (old-k8s-version-795352) </interface>
I0416 17:23:20.671372 45115 main.go:141] libmachine: (old-k8s-version-795352) <interface type='network'>
I0416 17:23:20.671385 45115 main.go:141] libmachine: (old-k8s-version-795352) <source network='default'/>
I0416 17:23:20.671393 45115 main.go:141] libmachine: (old-k8s-version-795352) <model type='virtio'/>
I0416 17:23:20.671404 45115 main.go:141] libmachine: (old-k8s-version-795352) </interface>
I0416 17:23:20.671416 45115 main.go:141] libmachine: (old-k8s-version-795352) <serial type='pty'>
I0416 17:23:20.671426 45115 main.go:141] libmachine: (old-k8s-version-795352) <target port='0'/>
I0416 17:23:20.671430 45115 main.go:141] libmachine: (old-k8s-version-795352) </serial>
I0416 17:23:20.671443 45115 main.go:141] libmachine: (old-k8s-version-795352) <console type='pty'>
I0416 17:23:20.671455 45115 main.go:141] libmachine: (old-k8s-version-795352) <target type='serial' port='0'/>
I0416 17:23:20.671468 45115 main.go:141] libmachine: (old-k8s-version-795352) </console>
I0416 17:23:20.671479 45115 main.go:141] libmachine: (old-k8s-version-795352) <rng model='virtio'>
I0416 17:23:20.671492 45115 main.go:141] libmachine: (old-k8s-version-795352) <backend model='random'>/dev/random</backend>
I0416 17:23:20.671502 45115 main.go:141] libmachine: (old-k8s-version-795352) </rng>
I0416 17:23:20.671510 45115 main.go:141] libmachine: (old-k8s-version-795352)
I0416 17:23:20.671518 45115 main.go:141] libmachine: (old-k8s-version-795352)
I0416 17:23:20.671526 45115 main.go:141] libmachine: (old-k8s-version-795352) </devices>
I0416 17:23:20.671545 45115 main.go:141] libmachine: (old-k8s-version-795352) </domain>
I0416 17:23:20.671559 45115 main.go:141] libmachine: (old-k8s-version-795352)
I0416 17:23:20.678205 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:1e:4f:fb in network default
I0416 17:23:20.678768 45115 main.go:141] libmachine: (old-k8s-version-795352) Ensuring networks are active...
I0416 17:23:20.678793 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:20.679429 45115 main.go:141] libmachine: (old-k8s-version-795352) Ensuring network default is active
I0416 17:23:20.679754 45115 main.go:141] libmachine: (old-k8s-version-795352) Ensuring network mk-old-k8s-version-795352 is active
I0416 17:23:20.680263 45115 main.go:141] libmachine: (old-k8s-version-795352) Getting domain xml...
I0416 17:23:20.680914 45115 main.go:141] libmachine: (old-k8s-version-795352) Creating domain...
I0416 17:23:21.902060 45115 main.go:141] libmachine: (old-k8s-version-795352) Waiting to get IP...
I0416 17:23:21.902938 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:21.903322 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | unable to find current IP address of domain old-k8s-version-795352 in network mk-old-k8s-version-795352
I0416 17:23:21.903348 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:21.903294 45444 retry.go:31] will retry after 241.214853ms: waiting for machine to come up
I0416 17:23:22.146678 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:22.147353 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | unable to find current IP address of domain old-k8s-version-795352 in network mk-old-k8s-version-795352
I0416 17:23:22.147382 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:22.147316 45444 retry.go:31] will retry after 323.420251ms: waiting for machine to come up
I0416 17:23:22.472617 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:22.473102 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | unable to find current IP address of domain old-k8s-version-795352 in network mk-old-k8s-version-795352
I0416 17:23:22.473136 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:22.473052 45444 retry.go:31] will retry after 389.35714ms: waiting for machine to come up
I0416 17:23:22.863719 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:22.864199 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | unable to find current IP address of domain old-k8s-version-795352 in network mk-old-k8s-version-795352
I0416 17:23:22.864228 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:22.864171 45444 retry.go:31] will retry after 453.077921ms: waiting for machine to come up
I0416 17:23:23.318656 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:23.319140 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | unable to find current IP address of domain old-k8s-version-795352 in network mk-old-k8s-version-795352
I0416 17:23:23.319788 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:23.319549 45444 retry.go:31] will retry after 634.472504ms: waiting for machine to come up
I0416 17:23:23.955531 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:23.956023 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | unable to find current IP address of domain old-k8s-version-795352 in network mk-old-k8s-version-795352
I0416 17:23:23.956055 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:23.955968 45444 retry.go:31] will retry after 816.750123ms: waiting for machine to come up
I0416 17:23:24.774026 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:24.774440 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | unable to find current IP address of domain old-k8s-version-795352 in network mk-old-k8s-version-795352
I0416 17:23:24.774472 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:24.774368 45444 retry.go:31] will retry after 1.191365295s: waiting for machine to come up
I0416 17:23:25.967334 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:25.967804 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | unable to find current IP address of domain old-k8s-version-795352 in network mk-old-k8s-version-795352
I0416 17:23:25.967831 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:25.967760 45444 retry.go:31] will retry after 1.241211843s: waiting for machine to come up
I0416 17:23:27.210290 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:27.210738 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | unable to find current IP address of domain old-k8s-version-795352 in network mk-old-k8s-version-795352
I0416 17:23:27.210766 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:27.210691 45444 retry.go:31] will retry after 1.81587298s: waiting for machine to come up
I0416 17:23:29.027740 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:29.028090 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | unable to find current IP address of domain old-k8s-version-795352 in network mk-old-k8s-version-795352
I0416 17:23:29.028115 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:29.028040 45444 retry.go:31] will retry after 2.232078129s: waiting for machine to come up
I0416 17:23:31.262075 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:31.262559 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | unable to find current IP address of domain old-k8s-version-795352 in network mk-old-k8s-version-795352
I0416 17:23:31.262587 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:31.262506 45444 retry.go:31] will retry after 2.762769559s: waiting for machine to come up
I0416 17:23:34.027358 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:34.027853 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | unable to find current IP address of domain old-k8s-version-795352 in network mk-old-k8s-version-795352
I0416 17:23:34.027888 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:34.027797 45444 retry.go:31] will retry after 3.526948951s: waiting for machine to come up
I0416 17:23:37.557727 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:37.558206 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | unable to find current IP address of domain old-k8s-version-795352 in network mk-old-k8s-version-795352
I0416 17:23:37.558233 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:37.558161 45444 retry.go:31] will retry after 3.837672285s: waiting for machine to come up
I0416 17:23:41.397357 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:41.397708 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | unable to find current IP address of domain old-k8s-version-795352 in network mk-old-k8s-version-795352
I0416 17:23:41.397748 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | I0416 17:23:41.397665 45444 retry.go:31] will retry after 4.576680968s: waiting for machine to come up
I0416 17:23:45.976191 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:45.976671 45115 main.go:141] libmachine: (old-k8s-version-795352) Found IP for machine: 192.168.50.168
I0416 17:23:45.976697 45115 main.go:141] libmachine: (old-k8s-version-795352) Reserving static IP address...
I0416 17:23:45.976725 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has current primary IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:45.977188 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-795352", mac: "52:54:00:9a:48:0e", ip: "192.168.50.168"} in network mk-old-k8s-version-795352
I0416 17:23:46.048325 45115 main.go:141] libmachine: (old-k8s-version-795352) Reserved static IP address: 192.168.50.168
I0416 17:23:46.048352 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | Getting to WaitForSSH function...
I0416 17:23:46.048362 45115 main.go:141] libmachine: (old-k8s-version-795352) Waiting for SSH to be available...
I0416 17:23:46.050852 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.051242 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:minikube Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:46.051275 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.051399 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | Using SSH client type: external
I0416 17:23:46.051427 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | Using SSH private key: /home/jenkins/minikube-integration/18649-3628/.minikube/machines/old-k8s-version-795352/id_rsa (-rw-------)
I0416 17:23:46.051472 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.168 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18649-3628/.minikube/machines/old-k8s-version-795352/id_rsa -p 22] /usr/bin/ssh <nil>}
I0416 17:23:46.051486 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | About to run SSH command:
I0416 17:23:46.051505 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | exit 0
I0416 17:23:46.181012 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | SSH cmd err, output: <nil>:
I0416 17:23:46.181279 45115 main.go:141] libmachine: (old-k8s-version-795352) KVM machine creation complete!
I0416 17:23:46.181657 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetConfigRaw
I0416 17:23:46.182263 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .DriverName
I0416 17:23:46.182449 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .DriverName
I0416 17:23:46.182629 45115 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0416 17:23:46.182643 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetState
I0416 17:23:46.184002 45115 main.go:141] libmachine: Detecting operating system of created instance...
I0416 17:23:46.184016 45115 main.go:141] libmachine: Waiting for SSH to be available...
I0416 17:23:46.184021 45115 main.go:141] libmachine: Getting to WaitForSSH function...
I0416 17:23:46.184027 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHHostname
I0416 17:23:46.186775 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.187200 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:old-k8s-version-795352 Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:46.187221 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.187375 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHPort
I0416 17:23:46.187552 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHKeyPath
I0416 17:23:46.187700 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHKeyPath
I0416 17:23:46.187853 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHUsername
I0416 17:23:46.188012 45115 main.go:141] libmachine: Using SSH client type: native
I0416 17:23:46.188194 45115 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.50.168 22 <nil> <nil>}
I0416 17:23:46.188205 45115 main.go:141] libmachine: About to run SSH command:
exit 0
I0416 17:23:46.288086 45115 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0416 17:23:46.288112 45115 main.go:141] libmachine: Detecting the provisioner...
I0416 17:23:46.288123 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHHostname
I0416 17:23:46.290679 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.290963 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:old-k8s-version-795352 Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:46.290992 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.291092 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHPort
I0416 17:23:46.291272 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHKeyPath
I0416 17:23:46.291444 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHKeyPath
I0416 17:23:46.291626 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHUsername
I0416 17:23:46.291801 45115 main.go:141] libmachine: Using SSH client type: native
I0416 17:23:46.291988 45115 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.50.168 22 <nil> <nil>}
I0416 17:23:46.292003 45115 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0416 17:23:46.393674 45115 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0416 17:23:46.393766 45115 main.go:141] libmachine: found compatible host: buildroot
I0416 17:23:46.393781 45115 main.go:141] libmachine: Provisioning with buildroot...
I0416 17:23:46.393795 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetMachineName
I0416 17:23:46.394049 45115 buildroot.go:166] provisioning hostname "old-k8s-version-795352"
I0416 17:23:46.394081 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetMachineName
I0416 17:23:46.394286 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHHostname
I0416 17:23:46.397195 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.397586 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:old-k8s-version-795352 Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:46.397608 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.397750 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHPort
I0416 17:23:46.397905 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHKeyPath
I0416 17:23:46.398062 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHKeyPath
I0416 17:23:46.398228 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHUsername
I0416 17:23:46.398373 45115 main.go:141] libmachine: Using SSH client type: native
I0416 17:23:46.398570 45115 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.50.168 22 <nil> <nil>}
I0416 17:23:46.398589 45115 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-795352 && echo "old-k8s-version-795352" | sudo tee /etc/hostname
I0416 17:23:46.512190 45115 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-795352
I0416 17:23:46.512219 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHHostname
I0416 17:23:46.514829 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.515058 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:old-k8s-version-795352 Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:46.515095 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.515360 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHPort
I0416 17:23:46.515569 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHKeyPath
I0416 17:23:46.515722 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHKeyPath
I0416 17:23:46.515868 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHUsername
I0416 17:23:46.516030 45115 main.go:141] libmachine: Using SSH client type: native
I0416 17:23:46.516201 45115 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.50.168 22 <nil> <nil>}
I0416 17:23:46.516219 45115 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-795352' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-795352/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-795352' | sudo tee -a /etc/hosts;
fi
fi
I0416 17:23:46.630472 45115 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0416 17:23:46.630510 45115 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18649-3628/.minikube CaCertPath:/home/jenkins/minikube-integration/18649-3628/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18649-3628/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18649-3628/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18649-3628/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18649-3628/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18649-3628/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18649-3628/.minikube}
I0416 17:23:46.630534 45115 buildroot.go:174] setting up certificates
I0416 17:23:46.630545 45115 provision.go:84] configureAuth start
I0416 17:23:46.630554 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetMachineName
I0416 17:23:46.630850 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetIP
I0416 17:23:46.633619 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.633966 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:old-k8s-version-795352 Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:46.633998 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.634164 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHHostname
I0416 17:23:46.636655 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.637042 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:old-k8s-version-795352 Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:46.637075 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.637229 45115 provision.go:143] copyHostCerts
I0416 17:23:46.637315 45115 exec_runner.go:144] found /home/jenkins/minikube-integration/18649-3628/.minikube/ca.pem, removing ...
I0416 17:23:46.637337 45115 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18649-3628/.minikube/ca.pem
I0416 17:23:46.637400 45115 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18649-3628/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18649-3628/.minikube/ca.pem (1082 bytes)
I0416 17:23:46.637512 45115 exec_runner.go:144] found /home/jenkins/minikube-integration/18649-3628/.minikube/cert.pem, removing ...
I0416 17:23:46.637525 45115 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18649-3628/.minikube/cert.pem
I0416 17:23:46.637555 45115 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18649-3628/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18649-3628/.minikube/cert.pem (1123 bytes)
I0416 17:23:46.637641 45115 exec_runner.go:144] found /home/jenkins/minikube-integration/18649-3628/.minikube/key.pem, removing ...
I0416 17:23:46.637652 45115 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18649-3628/.minikube/key.pem
I0416 17:23:46.637679 45115 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18649-3628/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18649-3628/.minikube/key.pem (1679 bytes)
I0416 17:23:46.637756 45115 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18649-3628/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18649-3628/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18649-3628/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-795352 san=[127.0.0.1 192.168.50.168 localhost minikube old-k8s-version-795352]
I0416 17:23:46.811463 45115 provision.go:177] copyRemoteCerts
I0416 17:23:46.811515 45115 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0416 17:23:46.811541 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHHostname
I0416 17:23:46.814225 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.814515 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:old-k8s-version-795352 Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:46.814537 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.814791 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHPort
I0416 17:23:46.814970 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHKeyPath
I0416 17:23:46.815120 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHUsername
I0416 17:23:46.815243 45115 sshutil.go:53] new ssh client: &{IP:192.168.50.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18649-3628/.minikube/machines/old-k8s-version-795352/id_rsa Username:docker}
I0416 17:23:46.896187 45115 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18649-3628/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0416 17:23:46.924847 45115 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18649-3628/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0416 17:23:46.951834 45115 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18649-3628/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0416 17:23:46.978200 45115 provision.go:87] duration metric: took 347.642793ms to configureAuth
I0416 17:23:46.978225 45115 buildroot.go:189] setting minikube options for container-runtime
I0416 17:23:46.978385 45115 config.go:182] Loaded profile config "old-k8s-version-795352": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0416 17:23:46.978449 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHHostname
I0416 17:23:46.981033 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.981333 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:old-k8s-version-795352 Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:46.981361 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:46.981513 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHPort
I0416 17:23:46.981679 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHKeyPath
I0416 17:23:46.981849 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHKeyPath
I0416 17:23:46.981975 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHUsername
I0416 17:23:46.982123 45115 main.go:141] libmachine: Using SSH client type: native
I0416 17:23:46.982287 45115 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.50.168 22 <nil> <nil>}
I0416 17:23:46.982312 45115 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0416 17:23:47.254897 45115 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0416 17:23:47.254924 45115 main.go:141] libmachine: Checking connection to Docker...
I0416 17:23:47.254935 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetURL
I0416 17:23:47.256309 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | Using libvirt version 6000000
I0416 17:23:47.258278 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:47.258537 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:old-k8s-version-795352 Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:47.258568 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:47.258687 45115 main.go:141] libmachine: Docker is up and running!
I0416 17:23:47.258702 45115 main.go:141] libmachine: Reticulating splines...
I0416 17:23:47.258708 45115 client.go:171] duration metric: took 26.982661097s to LocalClient.Create
I0416 17:23:47.258741 45115 start.go:167] duration metric: took 26.982726138s to libmachine.API.Create "old-k8s-version-795352"
I0416 17:23:47.258751 45115 start.go:293] postStartSetup for "old-k8s-version-795352" (driver="kvm2")
I0416 17:23:47.258769 45115 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0416 17:23:47.258785 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .DriverName
I0416 17:23:47.259025 45115 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0416 17:23:47.259048 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHHostname
I0416 17:23:47.261279 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:47.261631 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:old-k8s-version-795352 Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:47.261677 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:47.261824 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHPort
I0416 17:23:47.262001 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHKeyPath
I0416 17:23:47.262159 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHUsername
I0416 17:23:47.262302 45115 sshutil.go:53] new ssh client: &{IP:192.168.50.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18649-3628/.minikube/machines/old-k8s-version-795352/id_rsa Username:docker}
I0416 17:23:47.345554 45115 ssh_runner.go:195] Run: cat /etc/os-release
I0416 17:23:47.350508 45115 info.go:137] Remote host: Buildroot 2023.02.9
I0416 17:23:47.350529 45115 filesync.go:126] Scanning /home/jenkins/minikube-integration/18649-3628/.minikube/addons for local assets ...
I0416 17:23:47.350581 45115 filesync.go:126] Scanning /home/jenkins/minikube-integration/18649-3628/.minikube/files for local assets ...
I0416 17:23:47.350660 45115 filesync.go:149] local asset: /home/jenkins/minikube-integration/18649-3628/.minikube/files/etc/ssl/certs/109102.pem -> 109102.pem in /etc/ssl/certs
I0416 17:23:47.350771 45115 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0416 17:23:47.361846 45115 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18649-3628/.minikube/files/etc/ssl/certs/109102.pem --> /etc/ssl/certs/109102.pem (1708 bytes)
I0416 17:23:47.387474 45115 start.go:296] duration metric: took 128.704914ms for postStartSetup
I0416 17:23:47.387521 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetConfigRaw
I0416 17:23:47.388048 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetIP
I0416 17:23:47.390439 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:47.390838 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:old-k8s-version-795352 Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:47.390865 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:47.391092 45115 profile.go:143] Saving config to /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/config.json ...
I0416 17:23:47.391275 45115 start.go:128] duration metric: took 27.136320534s to createHost
I0416 17:23:47.391298 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHHostname
I0416 17:23:47.393689 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:47.394055 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:old-k8s-version-795352 Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:47.394085 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:47.394165 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHPort
I0416 17:23:47.394342 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHKeyPath
I0416 17:23:47.394526 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHKeyPath
I0416 17:23:47.394702 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHUsername
I0416 17:23:47.394908 45115 main.go:141] libmachine: Using SSH client type: native
I0416 17:23:47.395101 45115 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.50.168 22 <nil> <nil>}
I0416 17:23:47.395116 45115 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0416 17:23:47.498479 45115 main.go:141] libmachine: SSH cmd err, output: <nil>: 1713288227.482971805
I0416 17:23:47.498515 45115 fix.go:216] guest clock: 1713288227.482971805
I0416 17:23:47.498525 45115 fix.go:229] Guest: 2024-04-16 17:23:47.482971805 +0000 UTC Remote: 2024-04-16 17:23:47.391287239 +0000 UTC m=+51.986466631 (delta=91.684566ms)
I0416 17:23:47.498563 45115 fix.go:200] guest clock delta is within tolerance: 91.684566ms
I0416 17:23:47.498568 45115 start.go:83] releasing machines lock for "old-k8s-version-795352", held for 27.243847024s
I0416 17:23:47.498596 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .DriverName
I0416 17:23:47.498868 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetIP
I0416 17:23:47.501818 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:47.502236 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:old-k8s-version-795352 Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:47.502266 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:47.502466 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .DriverName
I0416 17:23:47.502967 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .DriverName
I0416 17:23:47.503171 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .DriverName
I0416 17:23:47.503281 45115 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0416 17:23:47.503344 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHHostname
I0416 17:23:47.503410 45115 ssh_runner.go:195] Run: cat /version.json
I0416 17:23:47.503435 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHHostname
I0416 17:23:47.506167 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:47.506519 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:old-k8s-version-795352 Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:47.506544 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:47.506563 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:47.506703 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHPort
I0416 17:23:47.506874 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHKeyPath
I0416 17:23:47.507057 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHUsername
I0416 17:23:47.507104 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:old-k8s-version-795352 Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:47.507130 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:47.507203 45115 sshutil.go:53] new ssh client: &{IP:192.168.50.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18649-3628/.minikube/machines/old-k8s-version-795352/id_rsa Username:docker}
I0416 17:23:47.507293 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHPort
I0416 17:23:47.507444 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHKeyPath
I0416 17:23:47.507589 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetSSHUsername
I0416 17:23:47.507719 45115 sshutil.go:53] new ssh client: &{IP:192.168.50.168 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18649-3628/.minikube/machines/old-k8s-version-795352/id_rsa Username:docker}
I0416 17:23:47.607920 45115 ssh_runner.go:195] Run: systemctl --version
I0416 17:23:47.615130 45115 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0416 17:23:47.787000 45115 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0416 17:23:47.794621 45115 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0416 17:23:47.794702 45115 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0416 17:23:47.812947 45115 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0416 17:23:47.812974 45115 start.go:494] detecting cgroup driver to use...
I0416 17:23:47.813041 45115 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0416 17:23:47.831639 45115 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0416 17:23:47.849154 45115 docker.go:217] disabling cri-docker service (if available) ...
I0416 17:23:47.849198 45115 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0416 17:23:47.869770 45115 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0416 17:23:47.887809 45115 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0416 17:23:48.006494 45115 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0416 17:23:48.180331 45115 docker.go:233] disabling docker service ...
I0416 17:23:48.180412 45115 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0416 17:23:48.199547 45115 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0416 17:23:48.216315 45115 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0416 17:23:48.370026 45115 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0416 17:23:48.526678 45115 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0416 17:23:48.554729 45115 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0416 17:23:48.582608 45115 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0416 17:23:48.582673 45115 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0416 17:23:48.599249 45115 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0416 17:23:48.599309 45115 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0416 17:23:48.616156 45115 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0416 17:23:48.632068 45115 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0416 17:23:48.646199 45115 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0416 17:23:48.662343 45115 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0416 17:23:48.674657 45115 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0416 17:23:48.674721 45115 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0416 17:23:48.691274 45115 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0416 17:23:48.703350 45115 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0416 17:23:48.866853 45115 ssh_runner.go:195] Run: sudo systemctl restart crio
I0416 17:23:49.011954 45115 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0416 17:23:49.012014 45115 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0416 17:23:49.017953 45115 start.go:562] Will wait 60s for crictl version
I0416 17:23:49.018015 45115 ssh_runner.go:195] Run: which crictl
I0416 17:23:49.022289 45115 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0416 17:23:49.069223 45115 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0416 17:23:49.069307 45115 ssh_runner.go:195] Run: crio --version
I0416 17:23:49.110257 45115 ssh_runner.go:195] Run: crio --version
I0416 17:23:49.155652 45115 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0416 17:23:49.156993 45115 main.go:141] libmachine: (old-k8s-version-795352) Calling .GetIP
I0416 17:23:49.160514 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:49.160947 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9a:48:0e", ip: ""} in network mk-old-k8s-version-795352: {Iface:virbr2 ExpiryTime:2024-04-16 18:23:36 +0000 UTC Type:0 Mac:52:54:00:9a:48:0e Iaid: IPaddr:192.168.50.168 Prefix:24 Hostname:old-k8s-version-795352 Clientid:01:52:54:00:9a:48:0e}
I0416 17:23:49.161001 45115 main.go:141] libmachine: (old-k8s-version-795352) DBG | domain old-k8s-version-795352 has defined IP address 192.168.50.168 and MAC address 52:54:00:9a:48:0e in network mk-old-k8s-version-795352
I0416 17:23:49.161183 45115 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0416 17:23:49.168396 45115 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0416 17:23:49.185445 45115 kubeadm.go:877] updating cluster {Name:old-k8s-version-795352 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-795352 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.168 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0416 17:23:49.185583 45115 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0416 17:23:49.185679 45115 ssh_runner.go:195] Run: sudo crictl images --output json
I0416 17:23:49.229817 45115 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0416 17:23:49.229909 45115 ssh_runner.go:195] Run: which lz4
I0416 17:23:49.234552 45115 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0416 17:23:49.240019 45115 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0416 17:23:49.240047 45115 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18649-3628/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0416 17:23:51.430296 45115 crio.go:462] duration metric: took 2.195768121s to copy over tarball
I0416 17:23:51.430377 45115 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0416 17:23:54.757140 45115 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.326732555s)
I0416 17:23:54.757190 45115 crio.go:469] duration metric: took 3.326861057s to extract the tarball
I0416 17:23:54.757200 45115 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0416 17:23:54.804344 45115 ssh_runner.go:195] Run: sudo crictl images --output json
I0416 17:23:54.856493 45115 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0416 17:23:54.856520 45115 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0416 17:23:54.856589 45115 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0416 17:23:54.856641 45115 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0416 17:23:54.856682 45115 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0416 17:23:54.856694 45115 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0416 17:23:54.856732 45115 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0416 17:23:54.856796 45115 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0416 17:23:54.856804 45115 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0416 17:23:54.856590 45115 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0416 17:23:54.858987 45115 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0416 17:23:54.859001 45115 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0416 17:23:54.859019 45115 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0416 17:23:54.858991 45115 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0416 17:23:54.858992 45115 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0416 17:23:54.859048 45115 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0416 17:23:54.859154 45115 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0416 17:23:54.859305 45115 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0416 17:23:55.011843 45115 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0416 17:23:55.016406 45115 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0416 17:23:55.041770 45115 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0416 17:23:55.047823 45115 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0416 17:23:55.048183 45115 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0416 17:23:55.064333 45115 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0416 17:23:55.093822 45115 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0416 17:23:55.093865 45115 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0416 17:23:55.093916 45115 ssh_runner.go:195] Run: which crictl
I0416 17:23:55.096939 45115 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0416 17:23:55.140552 45115 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0416 17:23:55.144318 45115 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0416 17:23:55.144364 45115 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0416 17:23:55.144410 45115 ssh_runner.go:195] Run: which crictl
I0416 17:23:55.256982 45115 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0416 17:23:55.257035 45115 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0416 17:23:55.257084 45115 ssh_runner.go:195] Run: which crictl
I0416 17:23:55.257182 45115 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0416 17:23:55.257209 45115 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0416 17:23:55.257243 45115 ssh_runner.go:195] Run: which crictl
I0416 17:23:55.257325 45115 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0416 17:23:55.257350 45115 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0416 17:23:55.257383 45115 ssh_runner.go:195] Run: which crictl
I0416 17:23:55.257446 45115 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0416 17:23:55.257473 45115 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0416 17:23:55.257496 45115 ssh_runner.go:195] Run: which crictl
I0416 17:23:55.257551 45115 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0416 17:23:55.293752 45115 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0416 17:23:55.293802 45115 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0416 17:23:55.293851 45115 ssh_runner.go:195] Run: which crictl
I0416 17:23:55.402637 45115 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0416 17:23:55.402708 45115 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0416 17:23:55.402748 45115 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0416 17:23:55.402788 45115 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0416 17:23:55.402828 45115 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0416 17:23:55.402869 45115 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18649-3628/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0416 17:23:55.402888 45115 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0416 17:23:55.548974 45115 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18649-3628/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0416 17:23:55.563200 45115 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18649-3628/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0416 17:23:55.563257 45115 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18649-3628/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0416 17:23:55.563293 45115 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18649-3628/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0416 17:23:55.563342 45115 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18649-3628/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0416 17:23:55.563356 45115 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18649-3628/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0416 17:23:55.563405 45115 cache_images.go:92] duration metric: took 706.871542ms to LoadCachedImages
W0416 17:23:55.563463 45115 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18649-3628/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18649-3628/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
I0416 17:23:55.563479 45115 kubeadm.go:928] updating node { 192.168.50.168 8443 v1.20.0 crio true true} ...
I0416 17:23:55.563594 45115 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-795352 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.168
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-795352 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0416 17:23:55.563666 45115 ssh_runner.go:195] Run: crio config
I0416 17:23:55.622294 45115 cni.go:84] Creating CNI manager for ""
I0416 17:23:55.622318 45115 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0416 17:23:55.622326 45115 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0416 17:23:55.622345 45115 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.168 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-795352 NodeName:old-k8s-version-795352 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.168"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.168 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0416 17:23:55.622483 45115 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.168
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-795352"
kubeletExtraArgs:
node-ip: 192.168.50.168
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.168"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0416 17:23:55.622539 45115 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0416 17:23:55.634259 45115 binaries.go:44] Found k8s binaries, skipping transfer
I0416 17:23:55.634333 45115 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0416 17:23:55.645243 45115 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0416 17:23:55.665692 45115 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0416 17:23:55.686738 45115 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0416 17:23:55.707076 45115 ssh_runner.go:195] Run: grep 192.168.50.168 control-plane.minikube.internal$ /etc/hosts
I0416 17:23:55.711858 45115 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.168 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0416 17:23:55.725927 45115 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0416 17:23:55.878089 45115 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0416 17:23:55.899823 45115 certs.go:68] Setting up /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352 for IP: 192.168.50.168
I0416 17:23:55.899848 45115 certs.go:194] generating shared ca certs ...
I0416 17:23:55.899869 45115 certs.go:226] acquiring lock for ca certs: {Name:mkcd512cd3d59d1d7cccadae7f27731fc66f83b3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0416 17:23:55.900037 45115 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18649-3628/.minikube/ca.key
I0416 17:23:55.900090 45115 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18649-3628/.minikube/proxy-client-ca.key
I0416 17:23:55.900102 45115 certs.go:256] generating profile certs ...
I0416 17:23:55.900168 45115 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/client.key
I0416 17:23:55.900206 45115 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/client.crt with IP's: []
I0416 17:23:56.004591 45115 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/client.crt ...
I0416 17:23:56.004623 45115 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/client.crt: {Name:mk3f82dfe2f09d66fe8d85a0719bf8462ddd47ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0416 17:23:56.004816 45115 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/client.key ...
I0416 17:23:56.004833 45115 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/client.key: {Name:mkb6ee3b86351e698301059c8fa3eed3993c8715 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0416 17:23:56.004968 45115 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/apiserver.key.8f51567a
I0416 17:23:56.004994 45115 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/apiserver.crt.8f51567a with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.168]
I0416 17:23:56.073791 45115 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/apiserver.crt.8f51567a ...
I0416 17:23:56.073834 45115 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/apiserver.crt.8f51567a: {Name:mkb92c7f7d61010d09b3fce64d699ab7445a8052 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0416 17:23:56.074029 45115 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/apiserver.key.8f51567a ...
I0416 17:23:56.074052 45115 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/apiserver.key.8f51567a: {Name:mk12875efe82ba9ce5d07be79e4225664f50bca6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0416 17:23:56.074196 45115 certs.go:381] copying /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/apiserver.crt.8f51567a -> /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/apiserver.crt
I0416 17:23:56.074334 45115 certs.go:385] copying /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/apiserver.key.8f51567a -> /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/apiserver.key
I0416 17:23:56.074447 45115 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/proxy-client.key
I0416 17:23:56.074470 45115 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/proxy-client.crt with IP's: []
I0416 17:23:56.354228 45115 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/proxy-client.crt ...
I0416 17:23:56.354257 45115 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/proxy-client.crt: {Name:mk351e72514648f18e12fd76276a8feb725f19b7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0416 17:23:56.354411 45115 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/proxy-client.key ...
I0416 17:23:56.354424 45115 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/proxy-client.key: {Name:mka778774f8b4c4bd33eb26b868dea4f74deca25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0416 17:23:56.354615 45115 certs.go:484] found cert: /home/jenkins/minikube-integration/18649-3628/.minikube/certs/10910.pem (1338 bytes)
W0416 17:23:56.354651 45115 certs.go:480] ignoring /home/jenkins/minikube-integration/18649-3628/.minikube/certs/10910_empty.pem, impossibly tiny 0 bytes
I0416 17:23:56.354662 45115 certs.go:484] found cert: /home/jenkins/minikube-integration/18649-3628/.minikube/certs/ca-key.pem (1675 bytes)
I0416 17:23:56.354694 45115 certs.go:484] found cert: /home/jenkins/minikube-integration/18649-3628/.minikube/certs/ca.pem (1082 bytes)
I0416 17:23:56.354720 45115 certs.go:484] found cert: /home/jenkins/minikube-integration/18649-3628/.minikube/certs/cert.pem (1123 bytes)
I0416 17:23:56.354741 45115 certs.go:484] found cert: /home/jenkins/minikube-integration/18649-3628/.minikube/certs/key.pem (1679 bytes)
I0416 17:23:56.354777 45115 certs.go:484] found cert: /home/jenkins/minikube-integration/18649-3628/.minikube/files/etc/ssl/certs/109102.pem (1708 bytes)
I0416 17:23:56.355362 45115 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18649-3628/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0416 17:23:56.385356 45115 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18649-3628/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0416 17:23:56.418822 45115 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18649-3628/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0416 17:23:56.447724 45115 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18649-3628/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0416 17:23:56.482782 45115 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0416 17:23:56.517557 45115 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0416 17:23:56.551262 45115 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0416 17:23:56.581519 45115 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18649-3628/.minikube/profiles/old-k8s-version-795352/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0416 17:23:56.610760 45115 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18649-3628/.minikube/files/etc/ssl/certs/109102.pem --> /usr/share/ca-certificates/109102.pem (1708 bytes)
I0416 17:23:56.637519 45115 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18649-3628/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0416 17:23:56.666832 45115 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18649-3628/.minikube/certs/10910.pem --> /usr/share/ca-certificates/10910.pem (1338 bytes)
I0416 17:23:56.695496 45115 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (752 bytes)
I0416 17:23:56.714824 45115 ssh_runner.go:195] Run: openssl version
I0416 17:23:56.721645 45115 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/109102.pem && ln -fs /usr/share/ca-certificates/109102.pem /etc/ssl/certs/109102.pem"
I0416 17:23:56.738289 45115 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/109102.pem
I0416 17:23:56.750971 45115 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 16 16:29 /usr/share/ca-certificates/109102.pem
I0416 17:23:56.751036 45115 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/109102.pem
I0416 17:23:56.761119 45115 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/109102.pem /etc/ssl/certs/3ec20f2e.0"
I0416 17:23:56.780094 45115 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0416 17:23:56.795991 45115 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0416 17:23:56.808531 45115 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 16 16:20 /usr/share/ca-certificates/minikubeCA.pem
I0416 17:23:56.808596 45115 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0416 17:23:56.817091 45115 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0416 17:23:56.835589 45115 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10910.pem && ln -fs /usr/share/ca-certificates/10910.pem /etc/ssl/certs/10910.pem"
I0416 17:23:56.847421 45115 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10910.pem
I0416 17:23:56.852593 45115 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 16 16:29 /usr/share/ca-certificates/10910.pem
I0416 17:23:56.852649 45115 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10910.pem
I0416 17:23:56.859059 45115 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/10910.pem /etc/ssl/certs/51391683.0"
I0416 17:23:56.870664 45115 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0416 17:23:56.875458 45115 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0416 17:23:56.875535 45115 kubeadm.go:391] StartCluster: {Name:old-k8s-version-795352 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-795352 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.168 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0416 17:23:56.875645 45115 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0416 17:23:56.875711 45115 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0416 17:23:56.913738 45115 cri.go:89] found id: ""
I0416 17:23:56.913811 45115 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0416 17:23:56.924306 45115 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0416 17:23:56.934190 45115 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0416 17:23:56.944068 45115 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0416 17:23:56.944087 45115 kubeadm.go:156] found existing configuration files:
I0416 17:23:56.944146 45115 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0416 17:23:56.953487 45115 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0416 17:23:56.953544 45115 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0416 17:23:56.964023 45115 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0416 17:23:56.973947 45115 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0416 17:23:56.974011 45115 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0416 17:23:56.984420 45115 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0416 17:23:56.994576 45115 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0416 17:23:56.994629 45115 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0416 17:23:57.005201 45115 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0416 17:23:57.014945 45115 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0416 17:23:57.014994 45115 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0416 17:23:57.025097 45115 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0416 17:23:57.302512 45115 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0416 17:25:55.994371 45115 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0416 17:25:55.994481 45115 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0416 17:25:55.997417 45115 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0416 17:25:55.997490 45115 kubeadm.go:309] [preflight] Running pre-flight checks
I0416 17:25:55.997586 45115 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0416 17:25:55.997706 45115 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0416 17:25:55.997833 45115 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0416 17:25:55.997909 45115 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0416 17:25:55.999644 45115 out.go:204] - Generating certificates and keys ...
I0416 17:25:55.999744 45115 kubeadm.go:309] [certs] Using existing ca certificate authority
I0416 17:25:55.999845 45115 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0416 17:25:55.999948 45115 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0416 17:25:56.000022 45115 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0416 17:25:56.000098 45115 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0416 17:25:56.000162 45115 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0416 17:25:56.000234 45115 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0416 17:25:56.000399 45115 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-795352] and IPs [192.168.50.168 127.0.0.1 ::1]
I0416 17:25:56.000465 45115 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0416 17:25:56.000626 45115 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-795352] and IPs [192.168.50.168 127.0.0.1 ::1]
I0416 17:25:56.000715 45115 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0416 17:25:56.000794 45115 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0416 17:25:56.000862 45115 kubeadm.go:309] [certs] Generating "sa" key and public key
I0416 17:25:56.000931 45115 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0416 17:25:56.000992 45115 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0416 17:25:56.001057 45115 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0416 17:25:56.001136 45115 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0416 17:25:56.001205 45115 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0416 17:25:56.001328 45115 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0416 17:25:56.001430 45115 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0416 17:25:56.001479 45115 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0416 17:25:56.001563 45115 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0416 17:25:56.003091 45115 out.go:204] - Booting up control plane ...
I0416 17:25:56.003203 45115 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0416 17:25:56.003304 45115 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0416 17:25:56.003414 45115 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0416 17:25:56.003539 45115 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0416 17:25:56.003780 45115 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0416 17:25:56.003863 45115 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0416 17:25:56.003956 45115 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0416 17:25:56.004198 45115 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0416 17:25:56.004314 45115 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0416 17:25:56.004584 45115 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0416 17:25:56.004670 45115 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0416 17:25:56.004936 45115 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0416 17:25:56.005020 45115 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0416 17:25:56.005243 45115 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0416 17:25:56.005328 45115 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0416 17:25:56.005551 45115 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0416 17:25:56.005557 45115 kubeadm.go:309]
I0416 17:25:56.005608 45115 kubeadm.go:309] Unfortunately, an error has occurred:
I0416 17:25:56.005659 45115 kubeadm.go:309] timed out waiting for the condition
I0416 17:25:56.005664 45115 kubeadm.go:309]
I0416 17:25:56.005709 45115 kubeadm.go:309] This error is likely caused by:
I0416 17:25:56.005751 45115 kubeadm.go:309] - The kubelet is not running
I0416 17:25:56.005881 45115 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0416 17:25:56.005888 45115 kubeadm.go:309]
I0416 17:25:56.006015 45115 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0416 17:25:56.006055 45115 kubeadm.go:309] - 'systemctl status kubelet'
I0416 17:25:56.006096 45115 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0416 17:25:56.006101 45115 kubeadm.go:309]
I0416 17:25:56.006247 45115 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0416 17:25:56.006344 45115 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0416 17:25:56.006352 45115 kubeadm.go:309]
I0416 17:25:56.006482 45115 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0416 17:25:56.006591 45115 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0416 17:25:56.006681 45115 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0416 17:25:56.006772 45115 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
W0416 17:25:56.006924 45115 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-795352] and IPs [192.168.50.168 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-795352] and IPs [192.168.50.168 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-795352] and IPs [192.168.50.168 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-795352] and IPs [192.168.50.168 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0416 17:25:56.006982 45115 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0416 17:25:56.007275 45115 kubeadm.go:309]
I0416 17:25:58.573541 45115 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.566530482s)
I0416 17:25:58.573630 45115 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0416 17:25:58.593490 45115 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0416 17:25:58.609698 45115 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0416 17:25:58.609721 45115 kubeadm.go:156] found existing configuration files:
I0416 17:25:58.609765 45115 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0416 17:25:58.624157 45115 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0416 17:25:58.624237 45115 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0416 17:25:58.640048 45115 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0416 17:25:58.654869 45115 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0416 17:25:58.654945 45115 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0416 17:25:58.667206 45115 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0416 17:25:58.678485 45115 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0416 17:25:58.678551 45115 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0416 17:25:58.693719 45115 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0416 17:25:58.708092 45115 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0416 17:25:58.708155 45115 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0416 17:25:58.722520 45115 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0416 17:25:58.799009 45115 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0416 17:25:58.799128 45115 kubeadm.go:309] [preflight] Running pre-flight checks
I0416 17:25:58.982077 45115 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0416 17:25:58.982235 45115 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0416 17:25:58.982411 45115 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0416 17:25:59.217947 45115 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0416 17:25:59.219479 45115 out.go:204] - Generating certificates and keys ...
I0416 17:25:59.219581 45115 kubeadm.go:309] [certs] Using existing ca certificate authority
I0416 17:25:59.219664 45115 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0416 17:25:59.219919 45115 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0416 17:25:59.220151 45115 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0416 17:25:59.220795 45115 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0416 17:25:59.221130 45115 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0416 17:25:59.221795 45115 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0416 17:25:59.222558 45115 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0416 17:25:59.223165 45115 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0416 17:25:59.223682 45115 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0416 17:25:59.223936 45115 kubeadm.go:309] [certs] Using the existing "sa" key
I0416 17:25:59.224077 45115 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0416 17:25:59.475778 45115 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0416 17:25:59.614871 45115 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0416 17:25:59.878982 45115 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0416 17:25:59.965832 45115 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0416 17:25:59.981292 45115 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0416 17:25:59.982921 45115 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0416 17:25:59.982992 45115 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0416 17:26:00.170478 45115 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0416 17:26:00.172197 45115 out.go:204] - Booting up control plane ...
I0416 17:26:00.172327 45115 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0416 17:26:00.187140 45115 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0416 17:26:00.188829 45115 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0416 17:26:00.191557 45115 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0416 17:26:00.207167 45115 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0416 17:26:40.210100 45115 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0416 17:26:40.210529 45115 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0416 17:26:40.210848 45115 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0416 17:26:45.212216 45115 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0416 17:26:45.212503 45115 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0416 17:26:55.212940 45115 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0416 17:26:55.213161 45115 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0416 17:27:15.214346 45115 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0416 17:27:15.214511 45115 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0416 17:27:55.214746 45115 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0416 17:27:55.215016 45115 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0416 17:27:55.215028 45115 kubeadm.go:309]
I0416 17:27:55.215103 45115 kubeadm.go:309] Unfortunately, an error has occurred:
I0416 17:27:55.215178 45115 kubeadm.go:309] timed out waiting for the condition
I0416 17:27:55.215194 45115 kubeadm.go:309]
I0416 17:27:55.215249 45115 kubeadm.go:309] This error is likely caused by:
I0416 17:27:55.215301 45115 kubeadm.go:309] - The kubelet is not running
I0416 17:27:55.215415 45115 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0416 17:27:55.215426 45115 kubeadm.go:309]
I0416 17:27:55.215559 45115 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0416 17:27:55.215612 45115 kubeadm.go:309] - 'systemctl status kubelet'
I0416 17:27:55.215653 45115 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0416 17:27:55.215662 45115 kubeadm.go:309]
I0416 17:27:55.215811 45115 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0416 17:27:55.215935 45115 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0416 17:27:55.215949 45115 kubeadm.go:309]
I0416 17:27:55.216106 45115 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0416 17:27:55.216217 45115 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0416 17:27:55.216334 45115 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0416 17:27:55.216446 45115 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0416 17:27:55.216458 45115 kubeadm.go:309]
I0416 17:27:55.217573 45115 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0416 17:27:55.217687 45115 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0416 17:27:55.217808 45115 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0416 17:27:55.217851 45115 kubeadm.go:393] duration metric: took 3m58.342323506s to StartCluster
I0416 17:27:55.217898 45115 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0416 17:27:55.217957 45115 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0416 17:27:55.272815 45115 cri.go:89] found id: ""
I0416 17:27:55.272863 45115 logs.go:276] 0 containers: []
W0416 17:27:55.272875 45115 logs.go:278] No container was found matching "kube-apiserver"
I0416 17:27:55.272883 45115 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0416 17:27:55.272957 45115 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0416 17:27:55.317244 45115 cri.go:89] found id: ""
I0416 17:27:55.317273 45115 logs.go:276] 0 containers: []
W0416 17:27:55.317283 45115 logs.go:278] No container was found matching "etcd"
I0416 17:27:55.317290 45115 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0416 17:27:55.317345 45115 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0416 17:27:55.354900 45115 cri.go:89] found id: ""
I0416 17:27:55.354924 45115 logs.go:276] 0 containers: []
W0416 17:27:55.354934 45115 logs.go:278] No container was found matching "coredns"
I0416 17:27:55.354942 45115 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0416 17:27:55.355008 45115 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0416 17:27:55.402964 45115 cri.go:89] found id: ""
I0416 17:27:55.402993 45115 logs.go:276] 0 containers: []
W0416 17:27:55.403004 45115 logs.go:278] No container was found matching "kube-scheduler"
I0416 17:27:55.403012 45115 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0416 17:27:55.403070 45115 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0416 17:27:55.450504 45115 cri.go:89] found id: ""
I0416 17:27:55.450536 45115 logs.go:276] 0 containers: []
W0416 17:27:55.450546 45115 logs.go:278] No container was found matching "kube-proxy"
I0416 17:27:55.450555 45115 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0416 17:27:55.450633 45115 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0416 17:27:55.504652 45115 cri.go:89] found id: ""
I0416 17:27:55.504681 45115 logs.go:276] 0 containers: []
W0416 17:27:55.504692 45115 logs.go:278] No container was found matching "kube-controller-manager"
I0416 17:27:55.504701 45115 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0416 17:27:55.504767 45115 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0416 17:27:55.556712 45115 cri.go:89] found id: ""
I0416 17:27:55.556744 45115 logs.go:276] 0 containers: []
W0416 17:27:55.556754 45115 logs.go:278] No container was found matching "kindnet"
I0416 17:27:55.556765 45115 logs.go:123] Gathering logs for container status ...
I0416 17:27:55.556780 45115 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0416 17:27:55.601293 45115 logs.go:123] Gathering logs for kubelet ...
I0416 17:27:55.601327 45115 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0416 17:27:55.659597 45115 logs.go:123] Gathering logs for dmesg ...
I0416 17:27:55.659626 45115 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0416 17:27:55.677050 45115 logs.go:123] Gathering logs for describe nodes ...
I0416 17:27:55.677082 45115 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0416 17:27:55.819117 45115 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0416 17:27:55.819149 45115 logs.go:123] Gathering logs for CRI-O ...
I0416 17:27:55.819164 45115 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
W0416 17:27:55.937543 45115 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0416 17:27:55.937616 45115 out.go:239] *
*
W0416 17:27:55.937667 45115 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0416 17:27:55.937688 45115 out.go:239] *
*
W0416 17:27:55.938577 45115 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0416 17:27:55.942231 45115 out.go:177]
W0416 17:27:55.943421 45115 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0416 17:27:55.943492 45115 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0416 17:27:55.943533 45115 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0416 17:27:55.945125 45115 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-795352 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-795352 -n old-k8s-version-795352
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-795352 -n old-k8s-version-795352: exit status 6 (272.689923ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0416 17:27:56.263272 51691 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-795352" does not appear in /home/jenkins/minikube-integration/18649-3628/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-795352" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (300.88s)