=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-862924 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-862924 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (5m11.625190096s)
-- stdout --
* [old-k8s-version-862924] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19302
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19302-3847/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19302-3847/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-862924" primary control-plane node in "old-k8s-version-862924" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0719 15:36:32.847529 54797 out.go:291] Setting OutFile to fd 1 ...
I0719 15:36:32.847808 54797 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0719 15:36:32.847819 54797 out.go:304] Setting ErrFile to fd 2...
I0719 15:36:32.847823 54797 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0719 15:36:32.848034 54797 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19302-3847/.minikube/bin
I0719 15:36:32.848628 54797 out.go:298] Setting JSON to false
I0719 15:36:32.849541 54797 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":4739,"bootTime":1721398654,"procs":207,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0719 15:36:32.849599 54797 start.go:139] virtualization: kvm guest
I0719 15:36:32.851870 54797 out.go:177] * [old-k8s-version-862924] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0719 15:36:32.853593 54797 notify.go:220] Checking for updates...
I0719 15:36:32.853612 54797 out.go:177] - MINIKUBE_LOCATION=19302
I0719 15:36:32.855050 54797 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0719 15:36:32.856434 54797 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19302-3847/kubeconfig
I0719 15:36:32.857713 54797 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19302-3847/.minikube
I0719 15:36:32.858832 54797 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0719 15:36:32.860196 54797 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0719 15:36:32.861984 54797 config.go:182] Loaded profile config "cert-expiration-939600": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0719 15:36:32.862088 54797 config.go:182] Loaded profile config "cert-options-127438": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0719 15:36:32.862161 54797 config.go:182] Loaded profile config "kubernetes-upgrade-574044": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0-beta.0
I0719 15:36:32.862265 54797 driver.go:392] Setting default libvirt URI to qemu:///system
I0719 15:36:32.899693 54797 out.go:177] * Using the kvm2 driver based on user configuration
I0719 15:36:32.900947 54797 start.go:297] selected driver: kvm2
I0719 15:36:32.900964 54797 start.go:901] validating driver "kvm2" against <nil>
I0719 15:36:32.900974 54797 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0719 15:36:32.901622 54797 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0719 15:36:32.901694 54797 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19302-3847/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0719 15:36:32.917551 54797 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0719 15:36:32.917615 54797 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0719 15:36:32.917818 54797 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0719 15:36:32.917850 54797 cni.go:84] Creating CNI manager for ""
I0719 15:36:32.917857 54797 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0719 15:36:32.917864 54797 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0719 15:36:32.917915 54797 start.go:340] cluster config:
{Name:old-k8s-version-862924 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-862924 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0719 15:36:32.918023 54797 iso.go:125] acquiring lock: {Name:mka7ff476ebe5dea1005e82f43afe0b11587572f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0719 15:36:32.919804 54797 out.go:177] * Starting "old-k8s-version-862924" primary control-plane node in "old-k8s-version-862924" cluster
I0719 15:36:32.921206 54797 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0719 15:36:32.921236 54797 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19302-3847/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0719 15:36:32.921244 54797 cache.go:56] Caching tarball of preloaded images
I0719 15:36:32.921323 54797 preload.go:172] Found /home/jenkins/minikube-integration/19302-3847/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0719 15:36:32.921336 54797 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0719 15:36:32.921448 54797 profile.go:143] Saving config to /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/config.json ...
I0719 15:36:32.921471 54797 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/config.json: {Name:mkbfe85e4041ec07d286899f03356ccb5c9d393b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 15:36:32.921617 54797 start.go:360] acquireMachinesLock for old-k8s-version-862924: {Name:mk707c0f2200ec1e3ce6b294507d2f417bea5c9a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0719 15:37:13.748163 54797 start.go:364] duration metric: took 40.826518399s to acquireMachinesLock for "old-k8s-version-862924"
I0719 15:37:13.748231 54797 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-862924 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19298/minikube-v1.33.1-1721324531-19298-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-862924 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0719 15:37:13.748357 54797 start.go:125] createHost starting for "" (driver="kvm2")
I0719 15:37:13.781118 54797 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0719 15:37:13.781320 54797 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0719 15:37:13.781365 54797 main.go:141] libmachine: Launching plugin server for driver kvm2
I0719 15:37:13.797526 54797 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38429
I0719 15:37:13.797965 54797 main.go:141] libmachine: () Calling .GetVersion
I0719 15:37:13.798558 54797 main.go:141] libmachine: Using API Version 1
I0719 15:37:13.798586 54797 main.go:141] libmachine: () Calling .SetConfigRaw
I0719 15:37:13.798996 54797 main.go:141] libmachine: () Calling .GetMachineName
I0719 15:37:13.799216 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetMachineName
I0719 15:37:13.799414 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .DriverName
I0719 15:37:13.799583 54797 start.go:159] libmachine.API.Create for "old-k8s-version-862924" (driver="kvm2")
I0719 15:37:13.799613 54797 client.go:168] LocalClient.Create starting
I0719 15:37:13.799648 54797 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19302-3847/.minikube/certs/ca.pem
I0719 15:37:13.799692 54797 main.go:141] libmachine: Decoding PEM data...
I0719 15:37:13.799721 54797 main.go:141] libmachine: Parsing certificate...
I0719 15:37:13.799798 54797 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19302-3847/.minikube/certs/cert.pem
I0719 15:37:13.799822 54797 main.go:141] libmachine: Decoding PEM data...
I0719 15:37:13.799842 54797 main.go:141] libmachine: Parsing certificate...
I0719 15:37:13.799870 54797 main.go:141] libmachine: Running pre-create checks...
I0719 15:37:13.799879 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .PreCreateCheck
I0719 15:37:13.800204 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetConfigRaw
I0719 15:37:13.800670 54797 main.go:141] libmachine: Creating machine...
I0719 15:37:13.800690 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .Create
I0719 15:37:13.800834 54797 main.go:141] libmachine: (old-k8s-version-862924) Creating KVM machine...
I0719 15:37:13.802094 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found existing default KVM network
I0719 15:37:13.803298 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:13.803162 55211 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:ee:af:01} reservation:<nil>}
I0719 15:37:13.804361 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:13.804273 55211 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002a6720}
I0719 15:37:13.804391 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | created network xml:
I0719 15:37:13.804404 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | <network>
I0719 15:37:13.804419 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | <name>mk-old-k8s-version-862924</name>
I0719 15:37:13.804430 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | <dns enable='no'/>
I0719 15:37:13.804441 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG |
I0719 15:37:13.804451 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0719 15:37:13.804460 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | <dhcp>
I0719 15:37:13.804468 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0719 15:37:13.804489 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | </dhcp>
I0719 15:37:13.804501 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | </ip>
I0719 15:37:13.804510 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG |
I0719 15:37:13.804518 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | </network>
I0719 15:37:13.804526 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG |
I0719 15:37:13.813291 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | trying to create private KVM network mk-old-k8s-version-862924 192.168.50.0/24...
I0719 15:37:13.890473 54797 main.go:141] libmachine: (old-k8s-version-862924) Setting up store path in /home/jenkins/minikube-integration/19302-3847/.minikube/machines/old-k8s-version-862924 ...
I0719 15:37:13.890510 54797 main.go:141] libmachine: (old-k8s-version-862924) Building disk image from file:///home/jenkins/minikube-integration/19302-3847/.minikube/cache/iso/amd64/minikube-v1.33.1-1721324531-19298-amd64.iso
I0719 15:37:13.890522 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | private KVM network mk-old-k8s-version-862924 192.168.50.0/24 created
I0719 15:37:13.890540 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:13.889357 55211 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19302-3847/.minikube
I0719 15:37:13.890565 54797 main.go:141] libmachine: (old-k8s-version-862924) Downloading /home/jenkins/minikube-integration/19302-3847/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19302-3847/.minikube/cache/iso/amd64/minikube-v1.33.1-1721324531-19298-amd64.iso...
I0719 15:37:14.116598 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:14.116390 55211 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19302-3847/.minikube/machines/old-k8s-version-862924/id_rsa...
I0719 15:37:14.257089 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:14.256939 55211 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19302-3847/.minikube/machines/old-k8s-version-862924/old-k8s-version-862924.rawdisk...
I0719 15:37:14.257134 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | Writing magic tar header
I0719 15:37:14.257153 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | Writing SSH key tar header
I0719 15:37:14.257168 54797 main.go:141] libmachine: (old-k8s-version-862924) Setting executable bit set on /home/jenkins/minikube-integration/19302-3847/.minikube/machines/old-k8s-version-862924 (perms=drwx------)
I0719 15:37:14.257186 54797 main.go:141] libmachine: (old-k8s-version-862924) Setting executable bit set on /home/jenkins/minikube-integration/19302-3847/.minikube/machines (perms=drwxr-xr-x)
I0719 15:37:14.257203 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:14.257048 55211 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19302-3847/.minikube/machines/old-k8s-version-862924 ...
I0719 15:37:14.257225 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19302-3847/.minikube/machines/old-k8s-version-862924
I0719 15:37:14.257241 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19302-3847/.minikube/machines
I0719 15:37:14.257256 54797 main.go:141] libmachine: (old-k8s-version-862924) Setting executable bit set on /home/jenkins/minikube-integration/19302-3847/.minikube (perms=drwxr-xr-x)
I0719 15:37:14.257272 54797 main.go:141] libmachine: (old-k8s-version-862924) Setting executable bit set on /home/jenkins/minikube-integration/19302-3847 (perms=drwxrwxr-x)
I0719 15:37:14.257283 54797 main.go:141] libmachine: (old-k8s-version-862924) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0719 15:37:14.257295 54797 main.go:141] libmachine: (old-k8s-version-862924) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0719 15:37:14.257304 54797 main.go:141] libmachine: (old-k8s-version-862924) Creating domain...
I0719 15:37:14.257336 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19302-3847/.minikube
I0719 15:37:14.257360 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19302-3847
I0719 15:37:14.257372 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0719 15:37:14.257379 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | Checking permissions on dir: /home/jenkins
I0719 15:37:14.257391 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | Checking permissions on dir: /home
I0719 15:37:14.257399 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | Skipping /home - not owner
I0719 15:37:14.258554 54797 main.go:141] libmachine: (old-k8s-version-862924) define libvirt domain using xml:
I0719 15:37:14.258584 54797 main.go:141] libmachine: (old-k8s-version-862924) <domain type='kvm'>
I0719 15:37:14.258597 54797 main.go:141] libmachine: (old-k8s-version-862924) <name>old-k8s-version-862924</name>
I0719 15:37:14.258607 54797 main.go:141] libmachine: (old-k8s-version-862924) <memory unit='MiB'>2200</memory>
I0719 15:37:14.258623 54797 main.go:141] libmachine: (old-k8s-version-862924) <vcpu>2</vcpu>
I0719 15:37:14.258632 54797 main.go:141] libmachine: (old-k8s-version-862924) <features>
I0719 15:37:14.258661 54797 main.go:141] libmachine: (old-k8s-version-862924) <acpi/>
I0719 15:37:14.258680 54797 main.go:141] libmachine: (old-k8s-version-862924) <apic/>
I0719 15:37:14.258695 54797 main.go:141] libmachine: (old-k8s-version-862924) <pae/>
I0719 15:37:14.258713 54797 main.go:141] libmachine: (old-k8s-version-862924)
I0719 15:37:14.258726 54797 main.go:141] libmachine: (old-k8s-version-862924) </features>
I0719 15:37:14.258739 54797 main.go:141] libmachine: (old-k8s-version-862924) <cpu mode='host-passthrough'>
I0719 15:37:14.258752 54797 main.go:141] libmachine: (old-k8s-version-862924)
I0719 15:37:14.258764 54797 main.go:141] libmachine: (old-k8s-version-862924) </cpu>
I0719 15:37:14.258777 54797 main.go:141] libmachine: (old-k8s-version-862924) <os>
I0719 15:37:14.258789 54797 main.go:141] libmachine: (old-k8s-version-862924) <type>hvm</type>
I0719 15:37:14.258814 54797 main.go:141] libmachine: (old-k8s-version-862924) <boot dev='cdrom'/>
I0719 15:37:14.258835 54797 main.go:141] libmachine: (old-k8s-version-862924) <boot dev='hd'/>
I0719 15:37:14.258848 54797 main.go:141] libmachine: (old-k8s-version-862924) <bootmenu enable='no'/>
I0719 15:37:14.258859 54797 main.go:141] libmachine: (old-k8s-version-862924) </os>
I0719 15:37:14.258869 54797 main.go:141] libmachine: (old-k8s-version-862924) <devices>
I0719 15:37:14.258879 54797 main.go:141] libmachine: (old-k8s-version-862924) <disk type='file' device='cdrom'>
I0719 15:37:14.258895 54797 main.go:141] libmachine: (old-k8s-version-862924) <source file='/home/jenkins/minikube-integration/19302-3847/.minikube/machines/old-k8s-version-862924/boot2docker.iso'/>
I0719 15:37:14.258907 54797 main.go:141] libmachine: (old-k8s-version-862924) <target dev='hdc' bus='scsi'/>
I0719 15:37:14.258919 54797 main.go:141] libmachine: (old-k8s-version-862924) <readonly/>
I0719 15:37:14.258930 54797 main.go:141] libmachine: (old-k8s-version-862924) </disk>
I0719 15:37:14.258956 54797 main.go:141] libmachine: (old-k8s-version-862924) <disk type='file' device='disk'>
I0719 15:37:14.258984 54797 main.go:141] libmachine: (old-k8s-version-862924) <driver name='qemu' type='raw' cache='default' io='threads' />
I0719 15:37:14.259003 54797 main.go:141] libmachine: (old-k8s-version-862924) <source file='/home/jenkins/minikube-integration/19302-3847/.minikube/machines/old-k8s-version-862924/old-k8s-version-862924.rawdisk'/>
I0719 15:37:14.259027 54797 main.go:141] libmachine: (old-k8s-version-862924) <target dev='hda' bus='virtio'/>
I0719 15:37:14.259042 54797 main.go:141] libmachine: (old-k8s-version-862924) </disk>
I0719 15:37:14.259055 54797 main.go:141] libmachine: (old-k8s-version-862924) <interface type='network'>
I0719 15:37:14.259067 54797 main.go:141] libmachine: (old-k8s-version-862924) <source network='mk-old-k8s-version-862924'/>
I0719 15:37:14.259080 54797 main.go:141] libmachine: (old-k8s-version-862924) <model type='virtio'/>
I0719 15:37:14.259093 54797 main.go:141] libmachine: (old-k8s-version-862924) </interface>
I0719 15:37:14.259106 54797 main.go:141] libmachine: (old-k8s-version-862924) <interface type='network'>
I0719 15:37:14.259120 54797 main.go:141] libmachine: (old-k8s-version-862924) <source network='default'/>
I0719 15:37:14.259131 54797 main.go:141] libmachine: (old-k8s-version-862924) <model type='virtio'/>
I0719 15:37:14.259145 54797 main.go:141] libmachine: (old-k8s-version-862924) </interface>
I0719 15:37:14.259154 54797 main.go:141] libmachine: (old-k8s-version-862924) <serial type='pty'>
I0719 15:37:14.259167 54797 main.go:141] libmachine: (old-k8s-version-862924) <target port='0'/>
I0719 15:37:14.259179 54797 main.go:141] libmachine: (old-k8s-version-862924) </serial>
I0719 15:37:14.259193 54797 main.go:141] libmachine: (old-k8s-version-862924) <console type='pty'>
I0719 15:37:14.259207 54797 main.go:141] libmachine: (old-k8s-version-862924) <target type='serial' port='0'/>
I0719 15:37:14.259220 54797 main.go:141] libmachine: (old-k8s-version-862924) </console>
I0719 15:37:14.259232 54797 main.go:141] libmachine: (old-k8s-version-862924) <rng model='virtio'>
I0719 15:37:14.259243 54797 main.go:141] libmachine: (old-k8s-version-862924) <backend model='random'>/dev/random</backend>
I0719 15:37:14.259255 54797 main.go:141] libmachine: (old-k8s-version-862924) </rng>
I0719 15:37:14.259268 54797 main.go:141] libmachine: (old-k8s-version-862924)
I0719 15:37:14.259280 54797 main.go:141] libmachine: (old-k8s-version-862924)
I0719 15:37:14.259293 54797 main.go:141] libmachine: (old-k8s-version-862924) </devices>
I0719 15:37:14.259305 54797 main.go:141] libmachine: (old-k8s-version-862924) </domain>
I0719 15:37:14.259322 54797 main.go:141] libmachine: (old-k8s-version-862924)
I0719 15:37:14.265742 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:be:5e:06 in network default
I0719 15:37:14.266353 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:14.266375 54797 main.go:141] libmachine: (old-k8s-version-862924) Ensuring networks are active...
I0719 15:37:14.267149 54797 main.go:141] libmachine: (old-k8s-version-862924) Ensuring network default is active
I0719 15:37:14.267519 54797 main.go:141] libmachine: (old-k8s-version-862924) Ensuring network mk-old-k8s-version-862924 is active
I0719 15:37:14.268140 54797 main.go:141] libmachine: (old-k8s-version-862924) Getting domain xml...
I0719 15:37:14.269010 54797 main.go:141] libmachine: (old-k8s-version-862924) Creating domain...
I0719 15:37:15.578725 54797 main.go:141] libmachine: (old-k8s-version-862924) Waiting to get IP...
I0719 15:37:15.579540 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:15.580031 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | unable to find current IP address of domain old-k8s-version-862924 in network mk-old-k8s-version-862924
I0719 15:37:15.580086 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:15.580019 55211 retry.go:31] will retry after 192.294822ms: waiting for machine to come up
I0719 15:37:15.774446 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:15.775070 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | unable to find current IP address of domain old-k8s-version-862924 in network mk-old-k8s-version-862924
I0719 15:37:15.775101 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:15.775028 55211 retry.go:31] will retry after 368.310018ms: waiting for machine to come up
I0719 15:37:16.144652 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:16.145233 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | unable to find current IP address of domain old-k8s-version-862924 in network mk-old-k8s-version-862924
I0719 15:37:16.145350 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:16.145314 55211 retry.go:31] will retry after 484.204097ms: waiting for machine to come up
I0719 15:37:16.631027 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:16.631662 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | unable to find current IP address of domain old-k8s-version-862924 in network mk-old-k8s-version-862924
I0719 15:37:16.631687 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:16.631600 55211 retry.go:31] will retry after 473.071812ms: waiting for machine to come up
I0719 15:37:17.106007 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:17.106551 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | unable to find current IP address of domain old-k8s-version-862924 in network mk-old-k8s-version-862924
I0719 15:37:17.106573 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:17.106515 55211 retry.go:31] will retry after 628.895845ms: waiting for machine to come up
I0719 15:37:17.737501 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:17.738027 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | unable to find current IP address of domain old-k8s-version-862924 in network mk-old-k8s-version-862924
I0719 15:37:17.738054 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:17.737995 55211 retry.go:31] will retry after 952.256957ms: waiting for machine to come up
I0719 15:37:18.692041 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:18.692482 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | unable to find current IP address of domain old-k8s-version-862924 in network mk-old-k8s-version-862924
I0719 15:37:18.692509 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:18.692436 55211 retry.go:31] will retry after 810.175641ms: waiting for machine to come up
I0719 15:37:19.503890 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:19.504395 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | unable to find current IP address of domain old-k8s-version-862924 in network mk-old-k8s-version-862924
I0719 15:37:19.504422 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:19.504344 55211 retry.go:31] will retry after 1.250767778s: waiting for machine to come up
I0719 15:37:20.756551 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:20.757091 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | unable to find current IP address of domain old-k8s-version-862924 in network mk-old-k8s-version-862924
I0719 15:37:20.757120 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:20.757043 55211 retry.go:31] will retry after 1.317826779s: waiting for machine to come up
I0719 15:37:22.076577 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:22.077080 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | unable to find current IP address of domain old-k8s-version-862924 in network mk-old-k8s-version-862924
I0719 15:37:22.077114 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:22.077040 55211 retry.go:31] will retry after 2.165024824s: waiting for machine to come up
I0719 15:37:24.243556 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:24.244181 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | unable to find current IP address of domain old-k8s-version-862924 in network mk-old-k8s-version-862924
I0719 15:37:24.244211 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:24.244123 55211 retry.go:31] will retry after 1.942652305s: waiting for machine to come up
I0719 15:37:26.560667 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:26.561409 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | unable to find current IP address of domain old-k8s-version-862924 in network mk-old-k8s-version-862924
I0719 15:37:26.561441 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:26.561361 55211 retry.go:31] will retry after 2.724602942s: waiting for machine to come up
I0719 15:37:29.287883 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:29.288430 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | unable to find current IP address of domain old-k8s-version-862924 in network mk-old-k8s-version-862924
I0719 15:37:29.288478 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:29.288401 55211 retry.go:31] will retry after 4.518333411s: waiting for machine to come up
I0719 15:37:33.808527 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:33.809163 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | unable to find current IP address of domain old-k8s-version-862924 in network mk-old-k8s-version-862924
I0719 15:37:33.809197 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | I0719 15:37:33.809144 55211 retry.go:31] will retry after 4.012052096s: waiting for machine to come up
I0719 15:37:37.825983 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:37.826490 54797 main.go:141] libmachine: (old-k8s-version-862924) Found IP for machine: 192.168.50.102
I0719 15:37:37.826513 54797 main.go:141] libmachine: (old-k8s-version-862924) Reserving static IP address...
I0719 15:37:37.826527 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has current primary IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:37.826888 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-862924", mac: "52:54:00:36:d7:f3", ip: "192.168.50.102"} in network mk-old-k8s-version-862924
I0719 15:37:37.898900 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | Getting to WaitForSSH function...
I0719 15:37:37.898929 54797 main.go:141] libmachine: (old-k8s-version-862924) Reserved static IP address: 192.168.50.102
I0719 15:37:37.898949 54797 main.go:141] libmachine: (old-k8s-version-862924) Waiting for SSH to be available...
I0719 15:37:37.901316 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:37.901711 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:minikube Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:37.901738 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:37.901860 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | Using SSH client type: external
I0719 15:37:37.901894 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | Using SSH private key: /home/jenkins/minikube-integration/19302-3847/.minikube/machines/old-k8s-version-862924/id_rsa (-rw-------)
I0719 15:37:37.901930 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.102 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19302-3847/.minikube/machines/old-k8s-version-862924/id_rsa -p 22] /usr/bin/ssh <nil>}
I0719 15:37:37.901940 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | About to run SSH command:
I0719 15:37:37.901952 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | exit 0
I0719 15:37:38.030276 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | SSH cmd err, output: <nil>:
I0719 15:37:38.030499 54797 main.go:141] libmachine: (old-k8s-version-862924) KVM machine creation complete!
I0719 15:37:38.030808 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetConfigRaw
I0719 15:37:38.031375 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .DriverName
I0719 15:37:38.031598 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .DriverName
I0719 15:37:38.031762 54797 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0719 15:37:38.031774 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetState
I0719 15:37:38.033004 54797 main.go:141] libmachine: Detecting operating system of created instance...
I0719 15:37:38.033015 54797 main.go:141] libmachine: Waiting for SSH to be available...
I0719 15:37:38.033020 54797 main.go:141] libmachine: Getting to WaitForSSH function...
I0719 15:37:38.033027 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHHostname
I0719 15:37:38.035221 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:38.035507 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:old-k8s-version-862924 Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:38.035530 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:38.035685 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHPort
I0719 15:37:38.035844 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHKeyPath
I0719 15:37:38.035982 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHKeyPath
I0719 15:37:38.036080 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHUsername
I0719 15:37:38.036239 54797 main.go:141] libmachine: Using SSH client type: native
I0719 15:37:38.036408 54797 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.102 22 <nil> <nil>}
I0719 15:37:38.036419 54797 main.go:141] libmachine: About to run SSH command:
exit 0
I0719 15:37:38.137769 54797 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0719 15:37:38.137796 54797 main.go:141] libmachine: Detecting the provisioner...
I0719 15:37:38.137804 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHHostname
I0719 15:37:38.140490 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:38.140759 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:old-k8s-version-862924 Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:38.140799 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:38.140989 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHPort
I0719 15:37:38.141179 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHKeyPath
I0719 15:37:38.141370 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHKeyPath
I0719 15:37:38.141510 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHUsername
I0719 15:37:38.141655 54797 main.go:141] libmachine: Using SSH client type: native
I0719 15:37:38.141835 54797 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.102 22 <nil> <nil>}
I0719 15:37:38.141847 54797 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0719 15:37:38.246846 54797 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0719 15:37:38.246919 54797 main.go:141] libmachine: found compatible host: buildroot
I0719 15:37:38.246928 54797 main.go:141] libmachine: Provisioning with buildroot...
I0719 15:37:38.246940 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetMachineName
I0719 15:37:38.247166 54797 buildroot.go:166] provisioning hostname "old-k8s-version-862924"
I0719 15:37:38.247187 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetMachineName
I0719 15:37:38.247349 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHHostname
I0719 15:37:38.249561 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:38.249896 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:old-k8s-version-862924 Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:38.249916 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:38.250074 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHPort
I0719 15:37:38.250231 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHKeyPath
I0719 15:37:38.250394 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHKeyPath
I0719 15:37:38.250540 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHUsername
I0719 15:37:38.250696 54797 main.go:141] libmachine: Using SSH client type: native
I0719 15:37:38.250852 54797 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.102 22 <nil> <nil>}
I0719 15:37:38.250865 54797 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-862924 && echo "old-k8s-version-862924" | sudo tee /etc/hostname
I0719 15:37:38.370825 54797 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-862924
I0719 15:37:38.370851 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHHostname
I0719 15:37:38.373331 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:38.373598 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:old-k8s-version-862924 Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:38.373624 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:38.373779 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHPort
I0719 15:37:38.373978 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHKeyPath
I0719 15:37:38.374107 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHKeyPath
I0719 15:37:38.374265 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHUsername
I0719 15:37:38.374425 54797 main.go:141] libmachine: Using SSH client type: native
I0719 15:37:38.374621 54797 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.102 22 <nil> <nil>}
I0719 15:37:38.374644 54797 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-862924' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-862924/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-862924' | sudo tee -a /etc/hosts;
fi
fi
I0719 15:37:38.491142 54797 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0719 15:37:38.491165 54797 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19302-3847/.minikube CaCertPath:/home/jenkins/minikube-integration/19302-3847/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19302-3847/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19302-3847/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19302-3847/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19302-3847/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19302-3847/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19302-3847/.minikube}
I0719 15:37:38.491182 54797 buildroot.go:174] setting up certificates
I0719 15:37:38.491193 54797 provision.go:84] configureAuth start
I0719 15:37:38.491203 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetMachineName
I0719 15:37:38.491518 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetIP
I0719 15:37:38.493856 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:38.494144 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:old-k8s-version-862924 Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:38.494174 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:38.494293 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHHostname
I0719 15:37:38.496060 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:38.496340 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:old-k8s-version-862924 Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:38.496366 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:38.496499 54797 provision.go:143] copyHostCerts
I0719 15:37:38.496562 54797 exec_runner.go:144] found /home/jenkins/minikube-integration/19302-3847/.minikube/ca.pem, removing ...
I0719 15:37:38.496575 54797 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19302-3847/.minikube/ca.pem
I0719 15:37:38.496632 54797 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19302-3847/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19302-3847/.minikube/ca.pem (1082 bytes)
I0719 15:37:38.496751 54797 exec_runner.go:144] found /home/jenkins/minikube-integration/19302-3847/.minikube/cert.pem, removing ...
I0719 15:37:38.496761 54797 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19302-3847/.minikube/cert.pem
I0719 15:37:38.496792 54797 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19302-3847/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19302-3847/.minikube/cert.pem (1123 bytes)
I0719 15:37:38.496891 54797 exec_runner.go:144] found /home/jenkins/minikube-integration/19302-3847/.minikube/key.pem, removing ...
I0719 15:37:38.496900 54797 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19302-3847/.minikube/key.pem
I0719 15:37:38.496930 54797 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19302-3847/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19302-3847/.minikube/key.pem (1675 bytes)
I0719 15:37:38.496999 54797 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19302-3847/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19302-3847/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19302-3847/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-862924 san=[127.0.0.1 192.168.50.102 localhost minikube old-k8s-version-862924]
I0719 15:37:38.630632 54797 provision.go:177] copyRemoteCerts
I0719 15:37:38.630698 54797 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0719 15:37:38.630733 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHHostname
I0719 15:37:38.633100 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:38.633371 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:old-k8s-version-862924 Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:38.633412 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:38.633607 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHPort
I0719 15:37:38.633789 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHKeyPath
I0719 15:37:38.633931 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHUsername
I0719 15:37:38.634048 54797 sshutil.go:53] new ssh client: &{IP:192.168.50.102 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19302-3847/.minikube/machines/old-k8s-version-862924/id_rsa Username:docker}
I0719 15:37:38.717037 54797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-3847/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0719 15:37:38.741827 54797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-3847/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0719 15:37:38.764762 54797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-3847/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0719 15:37:38.786833 54797 provision.go:87] duration metric: took 295.627287ms to configureAuth
I0719 15:37:38.786862 54797 buildroot.go:189] setting minikube options for container-runtime
I0719 15:37:38.787036 54797 config.go:182] Loaded profile config "old-k8s-version-862924": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0719 15:37:38.787113 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHHostname
I0719 15:37:38.789680 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:38.790104 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:old-k8s-version-862924 Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:38.790126 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:38.790307 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHPort
I0719 15:37:38.790463 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHKeyPath
I0719 15:37:38.790603 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHKeyPath
I0719 15:37:38.790724 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHUsername
I0719 15:37:38.790854 54797 main.go:141] libmachine: Using SSH client type: native
I0719 15:37:38.791010 54797 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.102 22 <nil> <nil>}
I0719 15:37:38.791026 54797 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0719 15:37:39.052738 54797 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0719 15:37:39.052764 54797 main.go:141] libmachine: Checking connection to Docker...
I0719 15:37:39.052772 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetURL
I0719 15:37:39.054348 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | Using libvirt version 6000000
I0719 15:37:39.056468 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:39.056866 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:old-k8s-version-862924 Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:39.056888 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:39.057017 54797 main.go:141] libmachine: Docker is up and running!
I0719 15:37:39.057033 54797 main.go:141] libmachine: Reticulating splines...
I0719 15:37:39.057041 54797 client.go:171] duration metric: took 25.257418339s to LocalClient.Create
I0719 15:37:39.057065 54797 start.go:167] duration metric: took 25.2574837s to libmachine.API.Create "old-k8s-version-862924"
I0719 15:37:39.057076 54797 start.go:293] postStartSetup for "old-k8s-version-862924" (driver="kvm2")
I0719 15:37:39.057085 54797 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0719 15:37:39.057097 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .DriverName
I0719 15:37:39.057287 54797 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0719 15:37:39.057312 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHHostname
I0719 15:37:39.059494 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:39.059803 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:old-k8s-version-862924 Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:39.059826 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:39.059938 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHPort
I0719 15:37:39.060118 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHKeyPath
I0719 15:37:39.060292 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHUsername
I0719 15:37:39.060421 54797 sshutil.go:53] new ssh client: &{IP:192.168.50.102 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19302-3847/.minikube/machines/old-k8s-version-862924/id_rsa Username:docker}
I0719 15:37:39.140251 54797 ssh_runner.go:195] Run: cat /etc/os-release
I0719 15:37:39.144438 54797 info.go:137] Remote host: Buildroot 2023.02.9
I0719 15:37:39.144458 54797 filesync.go:126] Scanning /home/jenkins/minikube-integration/19302-3847/.minikube/addons for local assets ...
I0719 15:37:39.144514 54797 filesync.go:126] Scanning /home/jenkins/minikube-integration/19302-3847/.minikube/files for local assets ...
I0719 15:37:39.144617 54797 filesync.go:149] local asset: /home/jenkins/minikube-integration/19302-3847/.minikube/files/etc/ssl/certs/110122.pem -> 110122.pem in /etc/ssl/certs
I0719 15:37:39.144720 54797 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0719 15:37:39.154011 54797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-3847/.minikube/files/etc/ssl/certs/110122.pem --> /etc/ssl/certs/110122.pem (1708 bytes)
I0719 15:37:39.177205 54797 start.go:296] duration metric: took 120.118513ms for postStartSetup
I0719 15:37:39.177246 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetConfigRaw
I0719 15:37:39.177871 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetIP
I0719 15:37:39.180210 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:39.180613 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:old-k8s-version-862924 Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:39.180643 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:39.181005 54797 profile.go:143] Saving config to /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/config.json ...
I0719 15:37:39.181211 54797 start.go:128] duration metric: took 25.432842164s to createHost
I0719 15:37:39.181235 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHHostname
I0719 15:37:39.183411 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:39.183718 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:old-k8s-version-862924 Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:39.183753 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:39.183854 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHPort
I0719 15:37:39.184026 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHKeyPath
I0719 15:37:39.184217 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHKeyPath
I0719 15:37:39.184417 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHUsername
I0719 15:37:39.184627 54797 main.go:141] libmachine: Using SSH client type: native
I0719 15:37:39.184812 54797 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.102 22 <nil> <nil>}
I0719 15:37:39.184824 54797 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0719 15:37:39.286897 54797 main.go:141] libmachine: SSH cmd err, output: <nil>: 1721403459.241554704
I0719 15:37:39.286918 54797 fix.go:216] guest clock: 1721403459.241554704
I0719 15:37:39.286925 54797 fix.go:229] Guest: 2024-07-19 15:37:39.241554704 +0000 UTC Remote: 2024-07-19 15:37:39.181224271 +0000 UTC m=+66.366310797 (delta=60.330433ms)
I0719 15:37:39.286960 54797 fix.go:200] guest clock delta is within tolerance: 60.330433ms
I0719 15:37:39.286967 54797 start.go:83] releasing machines lock for "old-k8s-version-862924", held for 25.538768626s
I0719 15:37:39.287001 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .DriverName
I0719 15:37:39.287281 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetIP
I0719 15:37:39.290040 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:39.290520 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:old-k8s-version-862924 Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:39.290606 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:39.290699 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .DriverName
I0719 15:37:39.291210 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .DriverName
I0719 15:37:39.291423 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .DriverName
I0719 15:37:39.291530 54797 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0719 15:37:39.291636 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHHostname
I0719 15:37:39.291644 54797 ssh_runner.go:195] Run: cat /version.json
I0719 15:37:39.291718 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHHostname
I0719 15:37:39.294546 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:39.294798 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:39.294850 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:old-k8s-version-862924 Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:39.294877 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:39.295007 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHPort
I0719 15:37:39.295210 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHKeyPath
I0719 15:37:39.295229 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:old-k8s-version-862924 Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:39.295250 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:39.295369 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHUsername
I0719 15:37:39.295424 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHPort
I0719 15:37:39.295551 54797 sshutil.go:53] new ssh client: &{IP:192.168.50.102 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19302-3847/.minikube/machines/old-k8s-version-862924/id_rsa Username:docker}
I0719 15:37:39.295565 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHKeyPath
I0719 15:37:39.295732 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetSSHUsername
I0719 15:37:39.295866 54797 sshutil.go:53] new ssh client: &{IP:192.168.50.102 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19302-3847/.minikube/machines/old-k8s-version-862924/id_rsa Username:docker}
I0719 15:37:39.400150 54797 ssh_runner.go:195] Run: systemctl --version
I0719 15:37:39.409396 54797 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0719 15:37:39.577041 54797 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0719 15:37:39.583394 54797 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0719 15:37:39.583469 54797 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0719 15:37:39.600693 54797 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0719 15:37:39.600716 54797 start.go:495] detecting cgroup driver to use...
I0719 15:37:39.600793 54797 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0719 15:37:39.616561 54797 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0719 15:37:39.630139 54797 docker.go:217] disabling cri-docker service (if available) ...
I0719 15:37:39.630184 54797 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0719 15:37:39.643168 54797 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0719 15:37:39.657206 54797 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0719 15:37:39.777706 54797 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0719 15:37:39.931619 54797 docker.go:233] disabling docker service ...
I0719 15:37:39.931716 54797 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0719 15:37:39.950430 54797 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0719 15:37:39.963984 54797 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0719 15:37:40.101908 54797 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0719 15:37:40.239747 54797 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0719 15:37:40.255651 54797 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0719 15:37:40.274918 54797 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0719 15:37:40.274979 54797 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0719 15:37:40.285627 54797 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0719 15:37:40.285703 54797 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0719 15:37:40.297574 54797 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0719 15:37:40.308579 54797 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0719 15:37:40.319491 54797 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0719 15:37:40.330280 54797 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0719 15:37:40.339553 54797 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0719 15:37:40.339590 54797 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0719 15:37:40.352421 54797 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0719 15:37:40.361784 54797 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0719 15:37:40.496066 54797 ssh_runner.go:195] Run: sudo systemctl restart crio
I0719 15:37:40.636161 54797 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0719 15:37:40.636223 54797 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0719 15:37:40.640975 54797 start.go:563] Will wait 60s for crictl version
I0719 15:37:40.641025 54797 ssh_runner.go:195] Run: which crictl
I0719 15:37:40.644705 54797 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0719 15:37:40.688005 54797 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0719 15:37:40.688085 54797 ssh_runner.go:195] Run: crio --version
I0719 15:37:40.721092 54797 ssh_runner.go:195] Run: crio --version
I0719 15:37:40.751891 54797 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0719 15:37:40.753272 54797 main.go:141] libmachine: (old-k8s-version-862924) Calling .GetIP
I0719 15:37:40.759037 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:40.759736 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:d7:f3", ip: ""} in network mk-old-k8s-version-862924: {Iface:virbr4 ExpiryTime:2024-07-19 16:37:29 +0000 UTC Type:0 Mac:52:54:00:36:d7:f3 Iaid: IPaddr:192.168.50.102 Prefix:24 Hostname:old-k8s-version-862924 Clientid:01:52:54:00:36:d7:f3}
I0719 15:37:40.759765 54797 main.go:141] libmachine: (old-k8s-version-862924) DBG | domain old-k8s-version-862924 has defined IP address 192.168.50.102 and MAC address 52:54:00:36:d7:f3 in network mk-old-k8s-version-862924
I0719 15:37:40.759983 54797 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0719 15:37:40.764352 54797 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0719 15:37:40.778216 54797 kubeadm.go:883] updating cluster {Name:old-k8s-version-862924 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19298/minikube-v1.33.1-1721324531-19298-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-862924 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.102 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0719 15:37:40.778374 54797 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0719 15:37:40.778432 54797 ssh_runner.go:195] Run: sudo crictl images --output json
I0719 15:37:40.821884 54797 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0719 15:37:40.821955 54797 ssh_runner.go:195] Run: which lz4
I0719 15:37:40.825981 54797 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0719 15:37:40.830529 54797 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0719 15:37:40.830557 54797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-3847/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0719 15:37:42.534212 54797 crio.go:462] duration metric: took 1.70825306s to copy over tarball
I0719 15:37:42.534309 54797 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0719 15:37:45.104430 54797 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.570080669s)
I0719 15:37:45.104493 54797 crio.go:469] duration metric: took 2.570209989s to extract the tarball
I0719 15:37:45.104507 54797 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0719 15:37:45.149217 54797 ssh_runner.go:195] Run: sudo crictl images --output json
I0719 15:37:45.196502 54797 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0719 15:37:45.196535 54797 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0719 15:37:45.196617 54797 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0719 15:37:45.196639 54797 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0719 15:37:45.196648 54797 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0719 15:37:45.196696 54797 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0719 15:37:45.196728 54797 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0719 15:37:45.196741 54797 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0719 15:37:45.196765 54797 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0719 15:37:45.196618 54797 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0719 15:37:45.197835 54797 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0719 15:37:45.198053 54797 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0719 15:37:45.198072 54797 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0719 15:37:45.198053 54797 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0719 15:37:45.198103 54797 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0719 15:37:45.198114 54797 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0719 15:37:45.198094 54797 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0719 15:37:45.198137 54797 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0719 15:37:45.354649 54797 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0719 15:37:45.365730 54797 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0719 15:37:45.365979 54797 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0719 15:37:45.369152 54797 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0719 15:37:45.375887 54797 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0719 15:37:45.389054 54797 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0719 15:37:45.415088 54797 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0719 15:37:45.415153 54797 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0719 15:37:45.415203 54797 ssh_runner.go:195] Run: which crictl
I0719 15:37:45.428900 54797 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0719 15:37:45.539387 54797 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0719 15:37:45.539430 54797 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0719 15:37:45.539428 54797 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0719 15:37:45.539458 54797 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0719 15:37:45.539476 54797 ssh_runner.go:195] Run: which crictl
I0719 15:37:45.539395 54797 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0719 15:37:45.539533 54797 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0719 15:37:45.539495 54797 ssh_runner.go:195] Run: which crictl
I0719 15:37:45.539595 54797 ssh_runner.go:195] Run: which crictl
I0719 15:37:45.556522 54797 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0719 15:37:45.556557 54797 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0719 15:37:45.556603 54797 ssh_runner.go:195] Run: which crictl
I0719 15:37:45.556610 54797 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0719 15:37:45.556637 54797 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0719 15:37:45.556655 54797 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0719 15:37:45.556670 54797 ssh_runner.go:195] Run: which crictl
I0719 15:37:45.556686 54797 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0719 15:37:45.556705 54797 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0719 15:37:45.556715 54797 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0719 15:37:45.556725 54797 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0719 15:37:45.556744 54797 ssh_runner.go:195] Run: which crictl
I0719 15:37:45.556756 54797 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0719 15:37:45.613221 54797 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0719 15:37:45.613397 54797 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19302-3847/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0719 15:37:45.657496 54797 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19302-3847/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0719 15:37:45.657557 54797 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0719 15:37:45.667075 54797 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0719 15:37:45.667111 54797 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19302-3847/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0719 15:37:45.667155 54797 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19302-3847/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0719 15:37:45.698784 54797 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19302-3847/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0719 15:37:45.723573 54797 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19302-3847/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0719 15:37:45.730335 54797 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19302-3847/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0719 15:37:46.151168 54797 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0719 15:37:46.293910 54797 cache_images.go:92] duration metric: took 1.09735523s to LoadCachedImages
W0719 15:37:46.294011 54797 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19302-3847/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19302-3847/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I0719 15:37:46.294073 54797 kubeadm.go:934] updating node { 192.168.50.102 8443 v1.20.0 crio true true} ...
I0719 15:37:46.294223 54797 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-862924 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.102
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-862924 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0719 15:37:46.294311 54797 ssh_runner.go:195] Run: crio config
I0719 15:37:46.347232 54797 cni.go:84] Creating CNI manager for ""
I0719 15:37:46.347251 54797 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0719 15:37:46.347260 54797 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0719 15:37:46.347283 54797 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.102 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-862924 NodeName:old-k8s-version-862924 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.102"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.102 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0719 15:37:46.347442 54797 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.102
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-862924"
kubeletExtraArgs:
node-ip: 192.168.50.102
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.102"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0719 15:37:46.347498 54797 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0719 15:37:46.358056 54797 binaries.go:44] Found k8s binaries, skipping transfer
I0719 15:37:46.358119 54797 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0719 15:37:46.367415 54797 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0719 15:37:46.385125 54797 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0719 15:37:46.402083 54797 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0719 15:37:46.420089 54797 ssh_runner.go:195] Run: grep 192.168.50.102 control-plane.minikube.internal$ /etc/hosts
I0719 15:37:46.423976 54797 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.102 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0719 15:37:46.435949 54797 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0719 15:37:46.569321 54797 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0719 15:37:46.587647 54797 certs.go:68] Setting up /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924 for IP: 192.168.50.102
I0719 15:37:46.587674 54797 certs.go:194] generating shared ca certs ...
I0719 15:37:46.587696 54797 certs.go:226] acquiring lock for ca certs: {Name:mk638c072f0071983aef143d50a1226fac96a359 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 15:37:46.587873 54797 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19302-3847/.minikube/ca.key
I0719 15:37:46.587969 54797 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19302-3847/.minikube/proxy-client-ca.key
I0719 15:37:46.587987 54797 certs.go:256] generating profile certs ...
I0719 15:37:46.588066 54797 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/client.key
I0719 15:37:46.588085 54797 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/client.crt with IP's: []
I0719 15:37:46.734943 54797 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/client.crt ...
I0719 15:37:46.734979 54797 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/client.crt: {Name:mk2333d319649b763100d8b4718a57b0a993aece Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 15:37:46.735267 54797 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/client.key ...
I0719 15:37:46.735289 54797 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/client.key: {Name:mk764ad25efa00784a2daf4aae8df27597c74a14 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 15:37:46.735392 54797 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/apiserver.key.4659f1b2
I0719 15:37:46.735412 54797 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/apiserver.crt.4659f1b2 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.102]
I0719 15:37:47.020106 54797 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/apiserver.crt.4659f1b2 ...
I0719 15:37:47.020135 54797 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/apiserver.crt.4659f1b2: {Name:mk76f46f96b32b3812d4e110dc9a6de135b220f0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 15:37:47.020311 54797 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/apiserver.key.4659f1b2 ...
I0719 15:37:47.020326 54797 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/apiserver.key.4659f1b2: {Name:mk82c2e840a665f1bb5b07961a88720803183a77 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 15:37:47.020420 54797 certs.go:381] copying /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/apiserver.crt.4659f1b2 -> /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/apiserver.crt
I0719 15:37:47.067693 54797 certs.go:385] copying /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/apiserver.key.4659f1b2 -> /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/apiserver.key
I0719 15:37:47.067821 54797 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/proxy-client.key
I0719 15:37:47.067845 54797 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/proxy-client.crt with IP's: []
I0719 15:37:47.154176 54797 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/proxy-client.crt ...
I0719 15:37:47.154203 54797 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/proxy-client.crt: {Name:mkc3426e5e6eb5344951b8ff4778f04f6f855ece Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 15:37:47.213986 54797 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/proxy-client.key ...
I0719 15:37:47.214025 54797 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/proxy-client.key: {Name:mkfa6574902be71225f700eeff2caed32ab42756 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0719 15:37:47.214299 54797 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-3847/.minikube/certs/11012.pem (1338 bytes)
W0719 15:37:47.214350 54797 certs.go:480] ignoring /home/jenkins/minikube-integration/19302-3847/.minikube/certs/11012_empty.pem, impossibly tiny 0 bytes
I0719 15:37:47.214368 54797 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-3847/.minikube/certs/ca-key.pem (1679 bytes)
I0719 15:37:47.214395 54797 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-3847/.minikube/certs/ca.pem (1082 bytes)
I0719 15:37:47.214420 54797 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-3847/.minikube/certs/cert.pem (1123 bytes)
I0719 15:37:47.214447 54797 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-3847/.minikube/certs/key.pem (1675 bytes)
I0719 15:37:47.214498 54797 certs.go:484] found cert: /home/jenkins/minikube-integration/19302-3847/.minikube/files/etc/ssl/certs/110122.pem (1708 bytes)
I0719 15:37:47.215312 54797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-3847/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0719 15:37:47.242636 54797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-3847/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0719 15:37:47.266008 54797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-3847/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0719 15:37:47.292280 54797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-3847/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0719 15:37:47.315369 54797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0719 15:37:47.338646 54797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0719 15:37:47.363960 54797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0719 15:37:47.388863 54797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-3847/.minikube/profiles/old-k8s-version-862924/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0719 15:37:47.412736 54797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-3847/.minikube/files/etc/ssl/certs/110122.pem --> /usr/share/ca-certificates/110122.pem (1708 bytes)
I0719 15:37:47.444991 54797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-3847/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0719 15:37:47.474661 54797 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19302-3847/.minikube/certs/11012.pem --> /usr/share/ca-certificates/11012.pem (1338 bytes)
I0719 15:37:47.515314 54797 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0719 15:37:47.544618 54797 ssh_runner.go:195] Run: openssl version
I0719 15:37:47.551568 54797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/110122.pem && ln -fs /usr/share/ca-certificates/110122.pem /etc/ssl/certs/110122.pem"
I0719 15:37:47.562665 54797 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/110122.pem
I0719 15:37:47.567042 54797 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 19 14:34 /usr/share/ca-certificates/110122.pem
I0719 15:37:47.567089 54797 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/110122.pem
I0719 15:37:47.572800 54797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/110122.pem /etc/ssl/certs/3ec20f2e.0"
I0719 15:37:47.583621 54797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0719 15:37:47.595007 54797 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0719 15:37:47.600061 54797 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 19 14:22 /usr/share/ca-certificates/minikubeCA.pem
I0719 15:37:47.600107 54797 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0719 15:37:47.606428 54797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0719 15:37:47.619068 54797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11012.pem && ln -fs /usr/share/ca-certificates/11012.pem /etc/ssl/certs/11012.pem"
I0719 15:37:47.632177 54797 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11012.pem
I0719 15:37:47.636459 54797 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 19 14:34 /usr/share/ca-certificates/11012.pem
I0719 15:37:47.636514 54797 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11012.pem
I0719 15:37:47.642292 54797 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11012.pem /etc/ssl/certs/51391683.0"
I0719 15:37:47.655430 54797 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0719 15:37:47.659480 54797 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0719 15:37:47.659534 54797 kubeadm.go:392] StartCluster: {Name:old-k8s-version-862924 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19298/minikube-v1.33.1-1721324531-19298-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721324606-19298@sha256:1c495b056df42bd3fd9a5c30d049e1802f9ed73a342611781f1ccc3c3853953f Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-862924 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.102 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0719 15:37:47.659620 54797 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0719 15:37:47.659660 54797 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0719 15:37:47.703463 54797 cri.go:89] found id: ""
I0719 15:37:47.703531 54797 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0719 15:37:47.714420 54797 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0719 15:37:47.725207 54797 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0719 15:37:47.736419 54797 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0719 15:37:47.736439 54797 kubeadm.go:157] found existing configuration files:
I0719 15:37:47.736482 54797 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0719 15:37:47.746985 54797 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0719 15:37:47.747048 54797 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0719 15:37:47.758031 54797 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0719 15:37:47.767219 54797 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0719 15:37:47.767285 54797 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0719 15:37:47.776964 54797 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0719 15:37:47.787863 54797 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0719 15:37:47.787913 54797 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0719 15:37:47.798171 54797 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0719 15:37:47.808633 54797 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0719 15:37:47.808692 54797 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0719 15:37:47.819577 54797 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0719 15:37:47.945430 54797 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0719 15:37:47.945568 54797 kubeadm.go:310] [preflight] Running pre-flight checks
I0719 15:37:48.094512 54797 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0719 15:37:48.094661 54797 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0719 15:37:48.094782 54797 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0719 15:37:48.282319 54797 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0719 15:37:48.284113 54797 out.go:204] - Generating certificates and keys ...
I0719 15:37:48.284207 54797 kubeadm.go:310] [certs] Using existing ca certificate authority
I0719 15:37:48.284295 54797 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0719 15:37:48.476999 54797 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0719 15:37:48.816646 54797 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0719 15:37:48.932537 54797 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0719 15:37:49.305508 54797 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0719 15:37:49.604353 54797 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0719 15:37:49.604906 54797 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-862924] and IPs [192.168.50.102 127.0.0.1 ::1]
I0719 15:37:49.769780 54797 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0719 15:37:49.770117 54797 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-862924] and IPs [192.168.50.102 127.0.0.1 ::1]
I0719 15:37:49.879126 54797 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0719 15:37:49.966067 54797 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0719 15:37:50.480315 54797 kubeadm.go:310] [certs] Generating "sa" key and public key
I0719 15:37:50.480444 54797 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0719 15:37:50.667477 54797 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0719 15:37:50.854868 54797 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0719 15:37:50.991705 54797 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0719 15:37:51.107595 54797 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0719 15:37:51.137918 54797 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0719 15:37:51.139057 54797 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0719 15:37:51.139144 54797 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0719 15:37:51.299623 54797 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0719 15:37:51.301558 54797 out.go:204] - Booting up control plane ...
I0719 15:37:51.301686 54797 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0719 15:37:51.306370 54797 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0719 15:37:51.308170 54797 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0719 15:37:51.309284 54797 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0719 15:37:51.315569 54797 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0719 15:38:31.276271 54797 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0719 15:38:31.277052 54797 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 15:38:31.277313 54797 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 15:38:36.277218 54797 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 15:38:36.277508 54797 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 15:38:46.275980 54797 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 15:38:46.276248 54797 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 15:39:06.275821 54797 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 15:39:06.276064 54797 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 15:39:46.274446 54797 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 15:39:46.274709 54797 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 15:39:46.274754 54797 kubeadm.go:310]
I0719 15:39:46.274821 54797 kubeadm.go:310] Unfortunately, an error has occurred:
I0719 15:39:46.274899 54797 kubeadm.go:310] timed out waiting for the condition
I0719 15:39:46.274916 54797 kubeadm.go:310]
I0719 15:39:46.274964 54797 kubeadm.go:310] This error is likely caused by:
I0719 15:39:46.275012 54797 kubeadm.go:310] - The kubelet is not running
I0719 15:39:46.275185 54797 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0719 15:39:46.275201 54797 kubeadm.go:310]
I0719 15:39:46.275322 54797 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0719 15:39:46.275366 54797 kubeadm.go:310] - 'systemctl status kubelet'
I0719 15:39:46.275412 54797 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0719 15:39:46.275427 54797 kubeadm.go:310]
I0719 15:39:46.275586 54797 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0719 15:39:46.275723 54797 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0719 15:39:46.275741 54797 kubeadm.go:310]
I0719 15:39:46.275883 54797 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0719 15:39:46.276048 54797 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0719 15:39:46.276140 54797 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0719 15:39:46.276257 54797 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0719 15:39:46.276276 54797 kubeadm.go:310]
I0719 15:39:46.277100 54797 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0719 15:39:46.277209 54797 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0719 15:39:46.277313 54797 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0719 15:39:46.277424 54797 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-862924] and IPs [192.168.50.102 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-862924] and IPs [192.168.50.102 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-862924] and IPs [192.168.50.102 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-862924] and IPs [192.168.50.102 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0719 15:39:46.277468 54797 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0719 15:39:46.962144 54797 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0719 15:39:46.977046 54797 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0719 15:39:46.986779 54797 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0719 15:39:46.986797 54797 kubeadm.go:157] found existing configuration files:
I0719 15:39:46.986837 54797 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0719 15:39:46.998580 54797 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0719 15:39:46.998636 54797 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0719 15:39:47.010297 54797 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0719 15:39:47.020509 54797 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0719 15:39:47.020566 54797 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0719 15:39:47.030165 54797 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0719 15:39:47.039836 54797 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0719 15:39:47.039878 54797 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0719 15:39:47.049437 54797 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0719 15:39:47.059241 54797 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0719 15:39:47.059287 54797 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0719 15:39:47.069047 54797 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0719 15:39:47.302401 54797 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0719 15:41:43.814887 54797 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0719 15:41:43.814996 54797 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0719 15:41:43.816582 54797 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0719 15:41:43.816651 54797 kubeadm.go:310] [preflight] Running pre-flight checks
I0719 15:41:43.816750 54797 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0719 15:41:43.816863 54797 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0719 15:41:43.816989 54797 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0719 15:41:43.817083 54797 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0719 15:41:43.818905 54797 out.go:204] - Generating certificates and keys ...
I0719 15:41:43.818987 54797 kubeadm.go:310] [certs] Using existing ca certificate authority
I0719 15:41:43.819057 54797 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0719 15:41:43.819151 54797 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0719 15:41:43.819234 54797 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0719 15:41:43.819322 54797 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0719 15:41:43.819386 54797 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0719 15:41:43.819445 54797 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0719 15:41:43.819498 54797 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0719 15:41:43.819554 54797 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0719 15:41:43.819617 54797 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0719 15:41:43.819671 54797 kubeadm.go:310] [certs] Using the existing "sa" key
I0719 15:41:43.819746 54797 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0719 15:41:43.819813 54797 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0719 15:41:43.819885 54797 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0719 15:41:43.819946 54797 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0719 15:41:43.819997 54797 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0719 15:41:43.820082 54797 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0719 15:41:43.820169 54797 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0719 15:41:43.820218 54797 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0719 15:41:43.820317 54797 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0719 15:41:43.822541 54797 out.go:204] - Booting up control plane ...
I0719 15:41:43.822634 54797 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0719 15:41:43.822737 54797 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0719 15:41:43.822836 54797 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0719 15:41:43.822957 54797 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0719 15:41:43.823144 54797 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0719 15:41:43.823211 54797 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0719 15:41:43.823314 54797 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 15:41:43.823562 54797 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 15:41:43.823657 54797 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 15:41:43.823840 54797 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 15:41:43.823937 54797 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 15:41:43.824113 54797 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 15:41:43.824199 54797 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 15:41:43.824440 54797 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 15:41:43.824509 54797 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0719 15:41:43.824685 54797 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0719 15:41:43.824701 54797 kubeadm.go:310]
I0719 15:41:43.824735 54797 kubeadm.go:310] Unfortunately, an error has occurred:
I0719 15:41:43.824769 54797 kubeadm.go:310] timed out waiting for the condition
I0719 15:41:43.824775 54797 kubeadm.go:310]
I0719 15:41:43.824809 54797 kubeadm.go:310] This error is likely caused by:
I0719 15:41:43.824838 54797 kubeadm.go:310] - The kubelet is not running
I0719 15:41:43.824923 54797 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0719 15:41:43.824929 54797 kubeadm.go:310]
I0719 15:41:43.825015 54797 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0719 15:41:43.825043 54797 kubeadm.go:310] - 'systemctl status kubelet'
I0719 15:41:43.825070 54797 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0719 15:41:43.825076 54797 kubeadm.go:310]
I0719 15:41:43.825175 54797 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0719 15:41:43.825277 54797 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0719 15:41:43.825286 54797 kubeadm.go:310]
I0719 15:41:43.825418 54797 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0719 15:41:43.825520 54797 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0719 15:41:43.825632 54797 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0719 15:41:43.825730 54797 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0719 15:41:43.825780 54797 kubeadm.go:310]
I0719 15:41:43.825809 54797 kubeadm.go:394] duration metric: took 3m56.166279101s to StartCluster
I0719 15:41:43.825877 54797 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0719 15:41:43.825949 54797 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0719 15:41:43.867914 54797 cri.go:89] found id: ""
I0719 15:41:43.867944 54797 logs.go:276] 0 containers: []
W0719 15:41:43.867956 54797 logs.go:278] No container was found matching "kube-apiserver"
I0719 15:41:43.867964 54797 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0719 15:41:43.868022 54797 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0719 15:41:43.903489 54797 cri.go:89] found id: ""
I0719 15:41:43.903512 54797 logs.go:276] 0 containers: []
W0719 15:41:43.903521 54797 logs.go:278] No container was found matching "etcd"
I0719 15:41:43.903528 54797 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0719 15:41:43.903583 54797 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0719 15:41:43.938329 54797 cri.go:89] found id: ""
I0719 15:41:43.938359 54797 logs.go:276] 0 containers: []
W0719 15:41:43.938369 54797 logs.go:278] No container was found matching "coredns"
I0719 15:41:43.938374 54797 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0719 15:41:43.938425 54797 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0719 15:41:43.971720 54797 cri.go:89] found id: ""
I0719 15:41:43.971744 54797 logs.go:276] 0 containers: []
W0719 15:41:43.971752 54797 logs.go:278] No container was found matching "kube-scheduler"
I0719 15:41:43.971758 54797 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0719 15:41:43.971814 54797 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0719 15:41:44.005691 54797 cri.go:89] found id: ""
I0719 15:41:44.005716 54797 logs.go:276] 0 containers: []
W0719 15:41:44.005724 54797 logs.go:278] No container was found matching "kube-proxy"
I0719 15:41:44.005729 54797 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0719 15:41:44.005778 54797 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0719 15:41:44.044569 54797 cri.go:89] found id: ""
I0719 15:41:44.044593 54797 logs.go:276] 0 containers: []
W0719 15:41:44.044603 54797 logs.go:278] No container was found matching "kube-controller-manager"
I0719 15:41:44.044609 54797 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0719 15:41:44.044655 54797 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0719 15:41:44.077615 54797 cri.go:89] found id: ""
I0719 15:41:44.077642 54797 logs.go:276] 0 containers: []
W0719 15:41:44.077652 54797 logs.go:278] No container was found matching "kindnet"
I0719 15:41:44.077670 54797 logs.go:123] Gathering logs for kubelet ...
I0719 15:41:44.077684 54797 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0719 15:41:44.131910 54797 logs.go:123] Gathering logs for dmesg ...
I0719 15:41:44.131940 54797 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0719 15:41:44.146111 54797 logs.go:123] Gathering logs for describe nodes ...
I0719 15:41:44.146142 54797 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0719 15:41:44.288867 54797 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0719 15:41:44.288889 54797 logs.go:123] Gathering logs for CRI-O ...
I0719 15:41:44.288903 54797 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0719 15:41:44.382824 54797 logs.go:123] Gathering logs for container status ...
I0719 15:41:44.382857 54797 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0719 15:41:44.425473 54797 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0719 15:41:44.425514 54797 out.go:239] *
*
W0719 15:41:44.425564 54797 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0719 15:41:44.425586 54797 out.go:239] *
*
W0719 15:41:44.426447 54797 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0719 15:41:44.429199 54797 out.go:177]
W0719 15:41:44.430381 54797 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0719 15:41:44.430442 54797 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0719 15:41:44.430470 54797 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0719 15:41:44.432120 54797 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-862924 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-862924 -n old-k8s-version-862924
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-862924 -n old-k8s-version-862924: exit status 6 (215.162473ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0719 15:41:44.694568 57812 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-862924" does not appear in /home/jenkins/minikube-integration/19302-3847/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-862924" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (311.90s)