=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-803027 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-803027 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m56.403022913s)
-- stdout --
* [old-k8s-version-803027] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20539
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20539-621978/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20539-621978/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-803027" primary control-plane node in "old-k8s-version-803027" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0317 13:45:03.356992 669182 out.go:345] Setting OutFile to fd 1 ...
I0317 13:45:03.357265 669182 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0317 13:45:03.357276 669182 out.go:358] Setting ErrFile to fd 2...
I0317 13:45:03.357280 669182 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0317 13:45:03.357471 669182 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20539-621978/.minikube/bin
I0317 13:45:03.358046 669182 out.go:352] Setting JSON to false
I0317 13:45:03.359103 669182 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-2","uptime":12447,"bootTime":1742206656,"procs":221,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1078-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0317 13:45:03.359166 669182 start.go:139] virtualization: kvm guest
I0317 13:45:03.361271 669182 out.go:177] * [old-k8s-version-803027] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0317 13:45:03.362708 669182 notify.go:220] Checking for updates...
I0317 13:45:03.362781 669182 out.go:177] - MINIKUBE_LOCATION=20539
I0317 13:45:03.365419 669182 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0317 13:45:03.366873 669182 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20539-621978/kubeconfig
I0317 13:45:03.368150 669182 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20539-621978/.minikube
I0317 13:45:03.369506 669182 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0317 13:45:03.370923 669182 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0317 13:45:03.372749 669182 config.go:182] Loaded profile config "cert-expiration-355456": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0317 13:45:03.372888 669182 config.go:182] Loaded profile config "cert-options-197082": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0317 13:45:03.373014 669182 config.go:182] Loaded profile config "kubernetes-upgrade-312638": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0317 13:45:03.373152 669182 driver.go:394] Setting default libvirt URI to qemu:///system
I0317 13:45:03.411109 669182 out.go:177] * Using the kvm2 driver based on user configuration
I0317 13:45:03.412539 669182 start.go:297] selected driver: kvm2
I0317 13:45:03.412557 669182 start.go:901] validating driver "kvm2" against <nil>
I0317 13:45:03.412577 669182 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0317 13:45:03.413482 669182 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0317 13:45:03.413609 669182 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20539-621978/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0317 13:45:03.429978 669182 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0317 13:45:03.430017 669182 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0317 13:45:03.430261 669182 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0317 13:45:03.430304 669182 cni.go:84] Creating CNI manager for ""
I0317 13:45:03.430355 669182 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0317 13:45:03.430363 669182 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0317 13:45:03.430407 669182 start.go:340] cluster config:
{Name:old-k8s-version-803027 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-803027 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0317 13:45:03.430517 669182 iso.go:125] acquiring lock: {Name:mk5ae9489b9a7b0ce1eec6303442deb1b82bdd34 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0317 13:45:03.432348 669182 out.go:177] * Starting "old-k8s-version-803027" primary control-plane node in "old-k8s-version-803027" cluster
I0317 13:45:03.433637 669182 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0317 13:45:03.433670 669182 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20539-621978/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0317 13:45:03.433676 669182 cache.go:56] Caching tarball of preloaded images
I0317 13:45:03.433771 669182 preload.go:172] Found /home/jenkins/minikube-integration/20539-621978/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0317 13:45:03.433783 669182 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0317 13:45:03.433875 669182 profile.go:143] Saving config to /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/config.json ...
I0317 13:45:03.433894 669182 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/config.json: {Name:mk419cc2b8d21fbdf5252c0969e3d91f5b49cb1f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 13:45:03.434025 669182 start.go:360] acquireMachinesLock for old-k8s-version-803027: {Name:mk889c42346a1f2803dd912b56533342807c90af Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0317 13:45:29.624331 669182 start.go:364] duration metric: took 26.190251875s to acquireMachinesLock for "old-k8s-version-803027"
I0317 13:45:29.624428 669182 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-803027 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 C
lusterName:old-k8s-version-803027 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p M
ountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0317 13:45:29.624563 669182 start.go:125] createHost starting for "" (driver="kvm2")
I0317 13:45:29.626704 669182 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0317 13:45:29.626956 669182 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0317 13:45:29.627020 669182 main.go:141] libmachine: Launching plugin server for driver kvm2
I0317 13:45:29.644466 669182 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36073
I0317 13:45:29.644924 669182 main.go:141] libmachine: () Calling .GetVersion
I0317 13:45:29.645450 669182 main.go:141] libmachine: Using API Version 1
I0317 13:45:29.645477 669182 main.go:141] libmachine: () Calling .SetConfigRaw
I0317 13:45:29.645856 669182 main.go:141] libmachine: () Calling .GetMachineName
I0317 13:45:29.646107 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetMachineName
I0317 13:45:29.646330 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .DriverName
I0317 13:45:29.646477 669182 start.go:159] libmachine.API.Create for "old-k8s-version-803027" (driver="kvm2")
I0317 13:45:29.646513 669182 client.go:168] LocalClient.Create starting
I0317 13:45:29.646553 669182 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20539-621978/.minikube/certs/ca.pem
I0317 13:45:29.646595 669182 main.go:141] libmachine: Decoding PEM data...
I0317 13:45:29.646616 669182 main.go:141] libmachine: Parsing certificate...
I0317 13:45:29.646684 669182 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20539-621978/.minikube/certs/cert.pem
I0317 13:45:29.646712 669182 main.go:141] libmachine: Decoding PEM data...
I0317 13:45:29.646732 669182 main.go:141] libmachine: Parsing certificate...
I0317 13:45:29.646760 669182 main.go:141] libmachine: Running pre-create checks...
I0317 13:45:29.646774 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .PreCreateCheck
I0317 13:45:29.647144 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetConfigRaw
I0317 13:45:29.647617 669182 main.go:141] libmachine: Creating machine...
I0317 13:45:29.647632 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .Create
I0317 13:45:29.647785 669182 main.go:141] libmachine: (old-k8s-version-803027) creating KVM machine...
I0317 13:45:29.647807 669182 main.go:141] libmachine: (old-k8s-version-803027) creating network...
I0317 13:45:29.649030 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found existing default KVM network
I0317 13:45:29.650600 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:29.650395 669606 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:0a:b8:e8} reservation:<nil>}
I0317 13:45:29.651257 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:29.651144 669606 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:03:54:88} reservation:<nil>}
I0317 13:45:29.652299 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:29.652193 669606 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00028ed70}
I0317 13:45:29.652320 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | created network xml:
I0317 13:45:29.652338 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | <network>
I0317 13:45:29.652352 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | <name>mk-old-k8s-version-803027</name>
I0317 13:45:29.652366 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | <dns enable='no'/>
I0317 13:45:29.652376 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG |
I0317 13:45:29.652388 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0317 13:45:29.652399 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | <dhcp>
I0317 13:45:29.652405 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0317 13:45:29.652415 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | </dhcp>
I0317 13:45:29.652441 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | </ip>
I0317 13:45:29.652464 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG |
I0317 13:45:29.652516 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | </network>
I0317 13:45:29.652552 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG |
I0317 13:45:29.658023 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | trying to create private KVM network mk-old-k8s-version-803027 192.168.61.0/24...
I0317 13:45:29.734287 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | private KVM network mk-old-k8s-version-803027 192.168.61.0/24 created
I0317 13:45:29.734320 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:29.734229 669606 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20539-621978/.minikube
I0317 13:45:29.734356 669182 main.go:141] libmachine: (old-k8s-version-803027) setting up store path in /home/jenkins/minikube-integration/20539-621978/.minikube/machines/old-k8s-version-803027 ...
I0317 13:45:29.734387 669182 main.go:141] libmachine: (old-k8s-version-803027) building disk image from file:///home/jenkins/minikube-integration/20539-621978/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0317 13:45:29.734410 669182 main.go:141] libmachine: (old-k8s-version-803027) Downloading /home/jenkins/minikube-integration/20539-621978/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20539-621978/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0317 13:45:30.009243 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:30.009088 669606 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20539-621978/.minikube/machines/old-k8s-version-803027/id_rsa...
I0317 13:45:30.248726 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:30.248565 669606 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20539-621978/.minikube/machines/old-k8s-version-803027/old-k8s-version-803027.rawdisk...
I0317 13:45:30.248765 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | Writing magic tar header
I0317 13:45:30.248783 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | Writing SSH key tar header
I0317 13:45:30.248796 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:30.248708 669606 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20539-621978/.minikube/machines/old-k8s-version-803027 ...
I0317 13:45:30.248813 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20539-621978/.minikube/machines/old-k8s-version-803027
I0317 13:45:30.248904 669182 main.go:141] libmachine: (old-k8s-version-803027) setting executable bit set on /home/jenkins/minikube-integration/20539-621978/.minikube/machines/old-k8s-version-803027 (perms=drwx------)
I0317 13:45:30.248930 669182 main.go:141] libmachine: (old-k8s-version-803027) setting executable bit set on /home/jenkins/minikube-integration/20539-621978/.minikube/machines (perms=drwxr-xr-x)
I0317 13:45:30.248942 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20539-621978/.minikube/machines
I0317 13:45:30.248960 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20539-621978/.minikube
I0317 13:45:30.248974 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20539-621978
I0317 13:45:30.248992 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0317 13:45:30.249004 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | checking permissions on dir: /home/jenkins
I0317 13:45:30.249019 669182 main.go:141] libmachine: (old-k8s-version-803027) setting executable bit set on /home/jenkins/minikube-integration/20539-621978/.minikube (perms=drwxr-xr-x)
I0317 13:45:30.249035 669182 main.go:141] libmachine: (old-k8s-version-803027) setting executable bit set on /home/jenkins/minikube-integration/20539-621978 (perms=drwxrwxr-x)
I0317 13:45:30.249048 669182 main.go:141] libmachine: (old-k8s-version-803027) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0317 13:45:30.249063 669182 main.go:141] libmachine: (old-k8s-version-803027) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0317 13:45:30.249074 669182 main.go:141] libmachine: (old-k8s-version-803027) creating domain...
I0317 13:45:30.249086 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | checking permissions on dir: /home
I0317 13:45:30.249158 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | skipping /home - not owner
I0317 13:45:30.250340 669182 main.go:141] libmachine: (old-k8s-version-803027) define libvirt domain using xml:
I0317 13:45:30.250360 669182 main.go:141] libmachine: (old-k8s-version-803027) <domain type='kvm'>
I0317 13:45:30.250371 669182 main.go:141] libmachine: (old-k8s-version-803027) <name>old-k8s-version-803027</name>
I0317 13:45:30.250379 669182 main.go:141] libmachine: (old-k8s-version-803027) <memory unit='MiB'>2200</memory>
I0317 13:45:30.250388 669182 main.go:141] libmachine: (old-k8s-version-803027) <vcpu>2</vcpu>
I0317 13:45:30.250401 669182 main.go:141] libmachine: (old-k8s-version-803027) <features>
I0317 13:45:30.250415 669182 main.go:141] libmachine: (old-k8s-version-803027) <acpi/>
I0317 13:45:30.250422 669182 main.go:141] libmachine: (old-k8s-version-803027) <apic/>
I0317 13:45:30.250428 669182 main.go:141] libmachine: (old-k8s-version-803027) <pae/>
I0317 13:45:30.250433 669182 main.go:141] libmachine: (old-k8s-version-803027)
I0317 13:45:30.250438 669182 main.go:141] libmachine: (old-k8s-version-803027) </features>
I0317 13:45:30.250447 669182 main.go:141] libmachine: (old-k8s-version-803027) <cpu mode='host-passthrough'>
I0317 13:45:30.250454 669182 main.go:141] libmachine: (old-k8s-version-803027)
I0317 13:45:30.250459 669182 main.go:141] libmachine: (old-k8s-version-803027) </cpu>
I0317 13:45:30.250467 669182 main.go:141] libmachine: (old-k8s-version-803027) <os>
I0317 13:45:30.250478 669182 main.go:141] libmachine: (old-k8s-version-803027) <type>hvm</type>
I0317 13:45:30.250487 669182 main.go:141] libmachine: (old-k8s-version-803027) <boot dev='cdrom'/>
I0317 13:45:30.250508 669182 main.go:141] libmachine: (old-k8s-version-803027) <boot dev='hd'/>
I0317 13:45:30.250517 669182 main.go:141] libmachine: (old-k8s-version-803027) <bootmenu enable='no'/>
I0317 13:45:30.250526 669182 main.go:141] libmachine: (old-k8s-version-803027) </os>
I0317 13:45:30.250533 669182 main.go:141] libmachine: (old-k8s-version-803027) <devices>
I0317 13:45:30.250537 669182 main.go:141] libmachine: (old-k8s-version-803027) <disk type='file' device='cdrom'>
I0317 13:45:30.250561 669182 main.go:141] libmachine: (old-k8s-version-803027) <source file='/home/jenkins/minikube-integration/20539-621978/.minikube/machines/old-k8s-version-803027/boot2docker.iso'/>
I0317 13:45:30.250580 669182 main.go:141] libmachine: (old-k8s-version-803027) <target dev='hdc' bus='scsi'/>
I0317 13:45:30.250590 669182 main.go:141] libmachine: (old-k8s-version-803027) <readonly/>
I0317 13:45:30.250600 669182 main.go:141] libmachine: (old-k8s-version-803027) </disk>
I0317 13:45:30.250609 669182 main.go:141] libmachine: (old-k8s-version-803027) <disk type='file' device='disk'>
I0317 13:45:30.250622 669182 main.go:141] libmachine: (old-k8s-version-803027) <driver name='qemu' type='raw' cache='default' io='threads' />
I0317 13:45:30.250641 669182 main.go:141] libmachine: (old-k8s-version-803027) <source file='/home/jenkins/minikube-integration/20539-621978/.minikube/machines/old-k8s-version-803027/old-k8s-version-803027.rawdisk'/>
I0317 13:45:30.250649 669182 main.go:141] libmachine: (old-k8s-version-803027) <target dev='hda' bus='virtio'/>
I0317 13:45:30.250679 669182 main.go:141] libmachine: (old-k8s-version-803027) </disk>
I0317 13:45:30.250695 669182 main.go:141] libmachine: (old-k8s-version-803027) <interface type='network'>
I0317 13:45:30.250703 669182 main.go:141] libmachine: (old-k8s-version-803027) <source network='mk-old-k8s-version-803027'/>
I0317 13:45:30.250707 669182 main.go:141] libmachine: (old-k8s-version-803027) <model type='virtio'/>
I0317 13:45:30.250714 669182 main.go:141] libmachine: (old-k8s-version-803027) </interface>
I0317 13:45:30.250719 669182 main.go:141] libmachine: (old-k8s-version-803027) <interface type='network'>
I0317 13:45:30.250725 669182 main.go:141] libmachine: (old-k8s-version-803027) <source network='default'/>
I0317 13:45:30.250729 669182 main.go:141] libmachine: (old-k8s-version-803027) <model type='virtio'/>
I0317 13:45:30.250735 669182 main.go:141] libmachine: (old-k8s-version-803027) </interface>
I0317 13:45:30.250743 669182 main.go:141] libmachine: (old-k8s-version-803027) <serial type='pty'>
I0317 13:45:30.250749 669182 main.go:141] libmachine: (old-k8s-version-803027) <target port='0'/>
I0317 13:45:30.250758 669182 main.go:141] libmachine: (old-k8s-version-803027) </serial>
I0317 13:45:30.250764 669182 main.go:141] libmachine: (old-k8s-version-803027) <console type='pty'>
I0317 13:45:30.250774 669182 main.go:141] libmachine: (old-k8s-version-803027) <target type='serial' port='0'/>
I0317 13:45:30.250779 669182 main.go:141] libmachine: (old-k8s-version-803027) </console>
I0317 13:45:30.250784 669182 main.go:141] libmachine: (old-k8s-version-803027) <rng model='virtio'>
I0317 13:45:30.250790 669182 main.go:141] libmachine: (old-k8s-version-803027) <backend model='random'>/dev/random</backend>
I0317 13:45:30.250796 669182 main.go:141] libmachine: (old-k8s-version-803027) </rng>
I0317 13:45:30.250801 669182 main.go:141] libmachine: (old-k8s-version-803027)
I0317 13:45:30.250805 669182 main.go:141] libmachine: (old-k8s-version-803027)
I0317 13:45:30.250809 669182 main.go:141] libmachine: (old-k8s-version-803027) </devices>
I0317 13:45:30.250816 669182 main.go:141] libmachine: (old-k8s-version-803027) </domain>
I0317 13:45:30.250823 669182 main.go:141] libmachine: (old-k8s-version-803027)
I0317 13:45:30.255405 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:4d:db:0c in network default
I0317 13:45:30.256157 669182 main.go:141] libmachine: (old-k8s-version-803027) starting domain...
I0317 13:45:30.256184 669182 main.go:141] libmachine: (old-k8s-version-803027) ensuring networks are active...
I0317 13:45:30.256201 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:30.256957 669182 main.go:141] libmachine: (old-k8s-version-803027) Ensuring network default is active
I0317 13:45:30.257264 669182 main.go:141] libmachine: (old-k8s-version-803027) Ensuring network mk-old-k8s-version-803027 is active
I0317 13:45:30.257871 669182 main.go:141] libmachine: (old-k8s-version-803027) getting domain XML...
I0317 13:45:30.258741 669182 main.go:141] libmachine: (old-k8s-version-803027) creating domain...
I0317 13:45:31.689653 669182 main.go:141] libmachine: (old-k8s-version-803027) waiting for IP...
I0317 13:45:31.690680 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:31.691208 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find current IP address of domain old-k8s-version-803027 in network mk-old-k8s-version-803027
I0317 13:45:31.691250 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:31.691210 669606 retry.go:31] will retry after 304.250683ms: waiting for domain to come up
I0317 13:45:31.996878 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:31.997573 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find current IP address of domain old-k8s-version-803027 in network mk-old-k8s-version-803027
I0317 13:45:31.997595 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:31.997471 669606 retry.go:31] will retry after 255.016207ms: waiting for domain to come up
I0317 13:45:32.254181 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:32.254643 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find current IP address of domain old-k8s-version-803027 in network mk-old-k8s-version-803027
I0317 13:45:32.254679 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:32.254619 669606 retry.go:31] will retry after 452.135407ms: waiting for domain to come up
I0317 13:45:32.708474 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:32.709032 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find current IP address of domain old-k8s-version-803027 in network mk-old-k8s-version-803027
I0317 13:45:32.709068 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:32.709004 669606 retry.go:31] will retry after 398.406512ms: waiting for domain to come up
I0317 13:45:33.109648 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:33.110152 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find current IP address of domain old-k8s-version-803027 in network mk-old-k8s-version-803027
I0317 13:45:33.110184 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:33.110128 669606 retry.go:31] will retry after 602.499505ms: waiting for domain to come up
I0317 13:45:33.714177 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:33.714769 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find current IP address of domain old-k8s-version-803027 in network mk-old-k8s-version-803027
I0317 13:45:33.714802 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:33.714720 669606 retry.go:31] will retry after 891.272458ms: waiting for domain to come up
I0317 13:45:34.607433 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:34.607927 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find current IP address of domain old-k8s-version-803027 in network mk-old-k8s-version-803027
I0317 13:45:34.607952 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:34.607893 669606 retry.go:31] will retry after 781.532858ms: waiting for domain to come up
I0317 13:45:35.390729 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:35.391230 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find current IP address of domain old-k8s-version-803027 in network mk-old-k8s-version-803027
I0317 13:45:35.391257 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:35.391190 669606 retry.go:31] will retry after 964.003899ms: waiting for domain to come up
I0317 13:45:36.356481 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:36.356992 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find current IP address of domain old-k8s-version-803027 in network mk-old-k8s-version-803027
I0317 13:45:36.357020 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:36.356957 669606 retry.go:31] will retry after 1.853968592s: waiting for domain to come up
I0317 13:45:38.212806 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:38.213353 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find current IP address of domain old-k8s-version-803027 in network mk-old-k8s-version-803027
I0317 13:45:38.213383 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:38.213312 669606 retry.go:31] will retry after 2.301371052s: waiting for domain to come up
I0317 13:45:40.516895 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:40.517864 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find current IP address of domain old-k8s-version-803027 in network mk-old-k8s-version-803027
I0317 13:45:40.517894 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:40.517730 669606 retry.go:31] will retry after 1.991655337s: waiting for domain to come up
I0317 13:45:42.510704 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:42.511352 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find current IP address of domain old-k8s-version-803027 in network mk-old-k8s-version-803027
I0317 13:45:42.511462 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:42.511341 669606 retry.go:31] will retry after 2.384098953s: waiting for domain to come up
I0317 13:45:44.896710 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:44.897178 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find current IP address of domain old-k8s-version-803027 in network mk-old-k8s-version-803027
I0317 13:45:44.897232 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:44.897177 669606 retry.go:31] will retry after 2.760546642s: waiting for domain to come up
I0317 13:45:47.660414 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:47.660970 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find current IP address of domain old-k8s-version-803027 in network mk-old-k8s-version-803027
I0317 13:45:47.661016 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | I0317 13:45:47.660945 669606 retry.go:31] will retry after 3.503451132s: waiting for domain to come up
I0317 13:45:51.167057 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:51.167496 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has current primary IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:51.167524 669182 main.go:141] libmachine: (old-k8s-version-803027) found domain IP: 192.168.61.229
I0317 13:45:51.167552 669182 main.go:141] libmachine: (old-k8s-version-803027) reserving static IP address...
I0317 13:45:51.167850 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-803027", mac: "52:54:00:c7:07:e9", ip: "192.168.61.229"} in network mk-old-k8s-version-803027
I0317 13:45:51.243022 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | Getting to WaitForSSH function...
I0317 13:45:51.243060 669182 main.go:141] libmachine: (old-k8s-version-803027) reserved static IP address 192.168.61.229 for domain old-k8s-version-803027
I0317 13:45:51.243073 669182 main.go:141] libmachine: (old-k8s-version-803027) waiting for SSH...
I0317 13:45:51.245500 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:51.245879 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027
I0317 13:45:51.245907 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | unable to find defined IP address of network mk-old-k8s-version-803027 interface with MAC address 52:54:00:c7:07:e9
I0317 13:45:51.246041 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | Using SSH client type: external
I0317 13:45:51.246070 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | Using SSH private key: /home/jenkins/minikube-integration/20539-621978/.minikube/machines/old-k8s-version-803027/id_rsa (-rw-------)
I0317 13:45:51.246105 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20539-621978/.minikube/machines/old-k8s-version-803027/id_rsa -p 22] /usr/bin/ssh <nil>}
I0317 13:45:51.246144 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | About to run SSH command:
I0317 13:45:51.246162 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | exit 0
I0317 13:45:51.249914 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | SSH cmd err, output: exit status 255:
I0317 13:45:51.249945 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0317 13:45:51.249976 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | command : exit 0
I0317 13:45:51.249995 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | err : exit status 255
I0317 13:45:51.250027 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | output :
I0317 13:45:54.250106 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | Getting to WaitForSSH function...
I0317 13:45:54.252386 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:54.252741 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:54.252766 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:54.252960 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | Using SSH client type: external
I0317 13:45:54.252982 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | Using SSH private key: /home/jenkins/minikube-integration/20539-621978/.minikube/machines/old-k8s-version-803027/id_rsa (-rw-------)
I0317 13:45:54.253004 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.229 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20539-621978/.minikube/machines/old-k8s-version-803027/id_rsa -p 22] /usr/bin/ssh <nil>}
I0317 13:45:54.253015 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | About to run SSH command:
I0317 13:45:54.253038 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | exit 0
I0317 13:45:54.375409 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | SSH cmd err, output: <nil>:
I0317 13:45:54.375718 669182 main.go:141] libmachine: (old-k8s-version-803027) KVM machine creation complete
I0317 13:45:54.376028 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetConfigRaw
I0317 13:45:54.376621 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .DriverName
I0317 13:45:54.376839 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .DriverName
I0317 13:45:54.377008 669182 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0317 13:45:54.377020 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetState
I0317 13:45:54.378269 669182 main.go:141] libmachine: Detecting operating system of created instance...
I0317 13:45:54.378281 669182 main.go:141] libmachine: Waiting for SSH to be available...
I0317 13:45:54.378291 669182 main.go:141] libmachine: Getting to WaitForSSH function...
I0317 13:45:54.378301 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHHostname
I0317 13:45:54.380591 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:54.380959 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:54.380981 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:54.381135 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHPort
I0317 13:45:54.381316 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHKeyPath
I0317 13:45:54.381479 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHKeyPath
I0317 13:45:54.381623 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHUsername
I0317 13:45:54.381788 669182 main.go:141] libmachine: Using SSH client type: native
I0317 13:45:54.382014 669182 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.229 22 <nil> <nil>}
I0317 13:45:54.382026 669182 main.go:141] libmachine: About to run SSH command:
exit 0
I0317 13:45:54.478534 669182 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0317 13:45:54.478569 669182 main.go:141] libmachine: Detecting the provisioner...
I0317 13:45:54.478586 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHHostname
I0317 13:45:54.481535 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:54.481803 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:54.481828 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:54.481974 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHPort
I0317 13:45:54.482139 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHKeyPath
I0317 13:45:54.482365 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHKeyPath
I0317 13:45:54.482555 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHUsername
I0317 13:45:54.482721 669182 main.go:141] libmachine: Using SSH client type: native
I0317 13:45:54.482920 669182 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.229 22 <nil> <nil>}
I0317 13:45:54.482957 669182 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0317 13:45:54.583789 669182 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0317 13:45:54.583877 669182 main.go:141] libmachine: found compatible host: buildroot
I0317 13:45:54.583884 669182 main.go:141] libmachine: Provisioning with buildroot...
I0317 13:45:54.583898 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetMachineName
I0317 13:45:54.584188 669182 buildroot.go:166] provisioning hostname "old-k8s-version-803027"
I0317 13:45:54.584220 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetMachineName
I0317 13:45:54.584422 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHHostname
I0317 13:45:54.586680 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:54.587143 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:54.587180 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:54.587367 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHPort
I0317 13:45:54.587557 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHKeyPath
I0317 13:45:54.587735 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHKeyPath
I0317 13:45:54.587903 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHUsername
I0317 13:45:54.588106 669182 main.go:141] libmachine: Using SSH client type: native
I0317 13:45:54.588333 669182 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.229 22 <nil> <nil>}
I0317 13:45:54.588345 669182 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-803027 && echo "old-k8s-version-803027" | sudo tee /etc/hostname
I0317 13:45:54.700090 669182 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-803027
I0317 13:45:54.700122 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHHostname
I0317 13:45:54.702728 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:54.703104 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:54.703134 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:54.703311 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHPort
I0317 13:45:54.703545 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHKeyPath
I0317 13:45:54.703679 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHKeyPath
I0317 13:45:54.703837 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHUsername
I0317 13:45:54.703976 669182 main.go:141] libmachine: Using SSH client type: native
I0317 13:45:54.704214 669182 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.229 22 <nil> <nil>}
I0317 13:45:54.704237 669182 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-803027' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-803027/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-803027' | sudo tee -a /etc/hosts;
fi
fi
I0317 13:45:54.811761 669182 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0317 13:45:54.811794 669182 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20539-621978/.minikube CaCertPath:/home/jenkins/minikube-integration/20539-621978/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20539-621978/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20539-621978/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20539-621978/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20539-621978/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20539-621978/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20539-621978/.minikube}
I0317 13:45:54.811837 669182 buildroot.go:174] setting up certificates
I0317 13:45:54.811850 669182 provision.go:84] configureAuth start
I0317 13:45:54.811864 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetMachineName
I0317 13:45:54.812197 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetIP
I0317 13:45:54.814656 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:54.815055 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:54.815087 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:54.815247 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHHostname
I0317 13:45:54.817348 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:54.817647 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:54.817673 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:54.817786 669182 provision.go:143] copyHostCerts
I0317 13:45:54.817856 669182 exec_runner.go:144] found /home/jenkins/minikube-integration/20539-621978/.minikube/ca.pem, removing ...
I0317 13:45:54.817874 669182 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20539-621978/.minikube/ca.pem
I0317 13:45:54.817944 669182 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20539-621978/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20539-621978/.minikube/ca.pem (1082 bytes)
I0317 13:45:54.818074 669182 exec_runner.go:144] found /home/jenkins/minikube-integration/20539-621978/.minikube/cert.pem, removing ...
I0317 13:45:54.818085 669182 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20539-621978/.minikube/cert.pem
I0317 13:45:54.818109 669182 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20539-621978/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20539-621978/.minikube/cert.pem (1123 bytes)
I0317 13:45:54.818184 669182 exec_runner.go:144] found /home/jenkins/minikube-integration/20539-621978/.minikube/key.pem, removing ...
I0317 13:45:54.818192 669182 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20539-621978/.minikube/key.pem
I0317 13:45:54.818210 669182 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20539-621978/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20539-621978/.minikube/key.pem (1675 bytes)
I0317 13:45:54.818266 669182 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20539-621978/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20539-621978/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20539-621978/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-803027 san=[127.0.0.1 192.168.61.229 localhost minikube old-k8s-version-803027]
I0317 13:45:54.889126 669182 provision.go:177] copyRemoteCerts
I0317 13:45:54.889186 669182 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0317 13:45:54.889221 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHHostname
I0317 13:45:54.891953 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:54.892232 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:54.892264 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:54.892474 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHPort
I0317 13:45:54.892699 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHKeyPath
I0317 13:45:54.892887 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHUsername
I0317 13:45:54.893025 669182 sshutil.go:53] new ssh client: &{IP:192.168.61.229 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20539-621978/.minikube/machines/old-k8s-version-803027/id_rsa Username:docker}
I0317 13:45:54.973309 669182 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-621978/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0317 13:45:54.996085 669182 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-621978/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0317 13:45:55.018040 669182 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-621978/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0317 13:45:55.040573 669182 provision.go:87] duration metric: took 228.70201ms to configureAuth
I0317 13:45:55.040619 669182 buildroot.go:189] setting minikube options for container-runtime
I0317 13:45:55.040824 669182 config.go:182] Loaded profile config "old-k8s-version-803027": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0317 13:45:55.040917 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHHostname
I0317 13:45:55.043628 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:55.043972 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:55.044002 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:55.044188 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHPort
I0317 13:45:55.044433 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHKeyPath
I0317 13:45:55.044632 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHKeyPath
I0317 13:45:55.044791 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHUsername
I0317 13:45:55.044972 669182 main.go:141] libmachine: Using SSH client type: native
I0317 13:45:55.045171 669182 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.229 22 <nil> <nil>}
I0317 13:45:55.045187 669182 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0317 13:45:55.255485 669182 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0317 13:45:55.255516 669182 main.go:141] libmachine: Checking connection to Docker...
I0317 13:45:55.255526 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetURL
I0317 13:45:55.256899 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | using libvirt version 6000000
I0317 13:45:55.258951 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:55.259226 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:55.259255 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:55.259416 669182 main.go:141] libmachine: Docker is up and running!
I0317 13:45:55.259435 669182 main.go:141] libmachine: Reticulating splines...
I0317 13:45:55.259443 669182 client.go:171] duration metric: took 25.612919221s to LocalClient.Create
I0317 13:45:55.259477 669182 start.go:167] duration metric: took 25.612991301s to libmachine.API.Create "old-k8s-version-803027"
I0317 13:45:55.259495 669182 start.go:293] postStartSetup for "old-k8s-version-803027" (driver="kvm2")
I0317 13:45:55.259508 669182 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0317 13:45:55.259557 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .DriverName
I0317 13:45:55.259777 669182 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0317 13:45:55.259809 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHHostname
I0317 13:45:55.261641 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:55.261966 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:55.261990 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:55.262117 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHPort
I0317 13:45:55.262271 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHKeyPath
I0317 13:45:55.262461 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHUsername
I0317 13:45:55.262622 669182 sshutil.go:53] new ssh client: &{IP:192.168.61.229 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20539-621978/.minikube/machines/old-k8s-version-803027/id_rsa Username:docker}
I0317 13:45:55.341414 669182 ssh_runner.go:195] Run: cat /etc/os-release
I0317 13:45:55.345240 669182 info.go:137] Remote host: Buildroot 2023.02.9
I0317 13:45:55.345266 669182 filesync.go:126] Scanning /home/jenkins/minikube-integration/20539-621978/.minikube/addons for local assets ...
I0317 13:45:55.345329 669182 filesync.go:126] Scanning /home/jenkins/minikube-integration/20539-621978/.minikube/files for local assets ...
I0317 13:45:55.345398 669182 filesync.go:149] local asset: /home/jenkins/minikube-integration/20539-621978/.minikube/files/etc/ssl/certs/6291882.pem -> 6291882.pem in /etc/ssl/certs
I0317 13:45:55.345551 669182 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0317 13:45:55.354548 669182 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-621978/.minikube/files/etc/ssl/certs/6291882.pem --> /etc/ssl/certs/6291882.pem (1708 bytes)
I0317 13:45:55.376343 669182 start.go:296] duration metric: took 116.829514ms for postStartSetup
I0317 13:45:55.376407 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetConfigRaw
I0317 13:45:55.377042 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetIP
I0317 13:45:55.379611 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:55.379943 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:55.379964 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:55.380341 669182 profile.go:143] Saving config to /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/config.json ...
I0317 13:45:55.380546 669182 start.go:128] duration metric: took 25.755967347s to createHost
I0317 13:45:55.380570 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHHostname
I0317 13:45:55.382921 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:55.383231 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:55.383262 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:55.383453 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHPort
I0317 13:45:55.383646 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHKeyPath
I0317 13:45:55.383814 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHKeyPath
I0317 13:45:55.383933 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHUsername
I0317 13:45:55.384090 669182 main.go:141] libmachine: Using SSH client type: native
I0317 13:45:55.384328 669182 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.229 22 <nil> <nil>}
I0317 13:45:55.384340 669182 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0317 13:45:55.484029 669182 main.go:141] libmachine: SSH cmd err, output: <nil>: 1742219155.461524795
I0317 13:45:55.484057 669182 fix.go:216] guest clock: 1742219155.461524795
I0317 13:45:55.484068 669182 fix.go:229] Guest: 2025-03-17 13:45:55.461524795 +0000 UTC Remote: 2025-03-17 13:45:55.380556744 +0000 UTC m=+52.061335954 (delta=80.968051ms)
I0317 13:45:55.484095 669182 fix.go:200] guest clock delta is within tolerance: 80.968051ms
I0317 13:45:55.484100 669182 start.go:83] releasing machines lock for "old-k8s-version-803027", held for 25.859714629s
I0317 13:45:55.484136 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .DriverName
I0317 13:45:55.484453 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetIP
I0317 13:45:55.487346 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:55.487796 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:55.487834 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:55.488025 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .DriverName
I0317 13:45:55.488573 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .DriverName
I0317 13:45:55.488782 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .DriverName
I0317 13:45:55.488845 669182 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0317 13:45:55.488902 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHHostname
I0317 13:45:55.489040 669182 ssh_runner.go:195] Run: cat /version.json
I0317 13:45:55.489068 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHHostname
I0317 13:45:55.491717 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:55.492024 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:55.492096 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:55.492121 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:55.492291 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHPort
I0317 13:45:55.492441 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHKeyPath
I0317 13:45:55.492486 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:55.492513 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:55.492636 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHUsername
I0317 13:45:55.492721 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHPort
I0317 13:45:55.492780 669182 sshutil.go:53] new ssh client: &{IP:192.168.61.229 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20539-621978/.minikube/machines/old-k8s-version-803027/id_rsa Username:docker}
I0317 13:45:55.492860 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHKeyPath
I0317 13:45:55.492992 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetSSHUsername
I0317 13:45:55.493143 669182 sshutil.go:53] new ssh client: &{IP:192.168.61.229 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20539-621978/.minikube/machines/old-k8s-version-803027/id_rsa Username:docker}
I0317 13:45:55.569642 669182 ssh_runner.go:195] Run: systemctl --version
I0317 13:45:55.590175 669182 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0317 13:45:55.747427 669182 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0317 13:45:55.755146 669182 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0317 13:45:55.755212 669182 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0317 13:45:55.771027 669182 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0317 13:45:55.771052 669182 start.go:495] detecting cgroup driver to use...
I0317 13:45:55.771121 669182 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0317 13:45:55.787897 669182 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0317 13:45:55.800319 669182 docker.go:217] disabling cri-docker service (if available) ...
I0317 13:45:55.800381 669182 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0317 13:45:55.813337 669182 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0317 13:45:55.825564 669182 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0317 13:45:55.936983 669182 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0317 13:45:56.101386 669182 docker.go:233] disabling docker service ...
I0317 13:45:56.101467 669182 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0317 13:45:56.118628 669182 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0317 13:45:56.132886 669182 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0317 13:45:56.269977 669182 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0317 13:45:56.395983 669182 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0317 13:45:56.409048 669182 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0317 13:45:56.426036 669182 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0317 13:45:56.426119 669182 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0317 13:45:56.436248 669182 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0317 13:45:56.436311 669182 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0317 13:45:56.445986 669182 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0317 13:45:56.456227 669182 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0317 13:45:56.465798 669182 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0317 13:45:56.475830 669182 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0317 13:45:56.484444 669182 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0317 13:45:56.484524 669182 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0317 13:45:56.496073 669182 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0317 13:45:56.504879 669182 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0317 13:45:56.625040 669182 ssh_runner.go:195] Run: sudo systemctl restart crio
I0317 13:45:56.713631 669182 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0317 13:45:56.713716 669182 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0317 13:45:56.718009 669182 start.go:563] Will wait 60s for crictl version
I0317 13:45:56.718073 669182 ssh_runner.go:195] Run: which crictl
I0317 13:45:56.721492 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0317 13:45:56.754725 669182 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0317 13:45:56.754802 669182 ssh_runner.go:195] Run: crio --version
I0317 13:45:56.780089 669182 ssh_runner.go:195] Run: crio --version
I0317 13:45:56.809423 669182 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0317 13:45:56.810779 669182 main.go:141] libmachine: (old-k8s-version-803027) Calling .GetIP
I0317 13:45:56.813403 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:56.813706 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c7:07:e9", ip: ""} in network mk-old-k8s-version-803027: {Iface:virbr3 ExpiryTime:2025-03-17 14:45:44 +0000 UTC Type:0 Mac:52:54:00:c7:07:e9 Iaid: IPaddr:192.168.61.229 Prefix:24 Hostname:old-k8s-version-803027 Clientid:01:52:54:00:c7:07:e9}
I0317 13:45:56.813742 669182 main.go:141] libmachine: (old-k8s-version-803027) DBG | domain old-k8s-version-803027 has defined IP address 192.168.61.229 and MAC address 52:54:00:c7:07:e9 in network mk-old-k8s-version-803027
I0317 13:45:56.813952 669182 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0317 13:45:56.818027 669182 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0317 13:45:56.830111 669182 kubeadm.go:883] updating cluster {Name:old-k8s-version-803027 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-
version-803027 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.229 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountU
ID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0317 13:45:56.830229 669182 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0317 13:45:56.830283 669182 ssh_runner.go:195] Run: sudo crictl images --output json
I0317 13:45:56.862558 669182 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0317 13:45:56.862640 669182 ssh_runner.go:195] Run: which lz4
I0317 13:45:56.866543 669182 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0317 13:45:56.870714 669182 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0317 13:45:56.870754 669182 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-621978/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0317 13:45:58.202222 669182 crio.go:462] duration metric: took 1.335699881s to copy over tarball
I0317 13:45:58.202304 669182 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0317 13:46:00.612590 669182 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.410253696s)
I0317 13:46:00.612628 669182 crio.go:469] duration metric: took 2.410371799s to extract the tarball
I0317 13:46:00.612638 669182 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0317 13:46:00.654075 669182 ssh_runner.go:195] Run: sudo crictl images --output json
I0317 13:46:00.698256 669182 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0317 13:46:00.698287 669182 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0317 13:46:00.698342 669182 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0317 13:46:00.698357 669182 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0317 13:46:00.698420 669182 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0317 13:46:00.698433 669182 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0317 13:46:00.698448 669182 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0317 13:46:00.698456 669182 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0317 13:46:00.698441 669182 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0317 13:46:00.698418 669182 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0317 13:46:00.699748 669182 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0317 13:46:00.699810 669182 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0317 13:46:00.699829 669182 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0317 13:46:00.699753 669182 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0317 13:46:00.699974 669182 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0317 13:46:00.699982 669182 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0317 13:46:00.699996 669182 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0317 13:46:00.699999 669182 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0317 13:46:00.847096 669182 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0317 13:46:00.850522 669182 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0317 13:46:00.853558 669182 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0317 13:46:00.853734 669182 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0317 13:46:00.871165 669182 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0317 13:46:00.888266 669182 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0317 13:46:00.894171 669182 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0317 13:46:00.941720 669182 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0317 13:46:00.941785 669182 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0317 13:46:00.941840 669182 ssh_runner.go:195] Run: which crictl
I0317 13:46:00.950196 669182 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0317 13:46:00.950259 669182 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0317 13:46:00.950316 669182 ssh_runner.go:195] Run: which crictl
I0317 13:46:00.967887 669182 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0317 13:46:00.967950 669182 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0317 13:46:00.967986 669182 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0317 13:46:00.968006 669182 ssh_runner.go:195] Run: which crictl
I0317 13:46:00.968025 669182 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0317 13:46:00.968078 669182 ssh_runner.go:195] Run: which crictl
I0317 13:46:00.997764 669182 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0317 13:46:00.997815 669182 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0317 13:46:00.997872 669182 ssh_runner.go:195] Run: which crictl
I0317 13:46:01.012339 669182 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0317 13:46:01.012391 669182 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0317 13:46:01.012439 669182 ssh_runner.go:195] Run: which crictl
I0317 13:46:01.013578 669182 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0317 13:46:01.013603 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0317 13:46:01.013619 669182 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0317 13:46:01.013651 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0317 13:46:01.013654 669182 ssh_runner.go:195] Run: which crictl
I0317 13:46:01.013722 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0317 13:46:01.013657 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0317 13:46:01.013730 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0317 13:46:01.021526 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0317 13:46:01.105636 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0317 13:46:01.130992 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0317 13:46:01.131047 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0317 13:46:01.131083 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0317 13:46:01.131047 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0317 13:46:01.131131 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0317 13:46:01.145563 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0317 13:46:01.213442 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0317 13:46:01.290581 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0317 13:46:01.290690 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0317 13:46:01.290713 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0317 13:46:01.290782 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0317 13:46:01.290796 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0317 13:46:01.290852 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0317 13:46:01.317298 669182 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20539-621978/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0317 13:46:01.413782 669182 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0317 13:46:01.421371 669182 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20539-621978/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0317 13:46:01.421396 669182 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20539-621978/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0317 13:46:01.426911 669182 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20539-621978/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0317 13:46:01.433554 669182 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20539-621978/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0317 13:46:01.433591 669182 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20539-621978/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0317 13:46:01.459824 669182 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20539-621978/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0317 13:46:02.410062 669182 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0317 13:46:02.557273 669182 cache_images.go:92] duration metric: took 1.858965497s to LoadCachedImages
W0317 13:46:02.557370 669182 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20539-621978/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20539-621978/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I0317 13:46:02.557387 669182 kubeadm.go:934] updating node { 192.168.61.229 8443 v1.20.0 crio true true} ...
I0317 13:46:02.557499 669182 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-803027 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.229
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-803027 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0317 13:46:02.557577 669182 ssh_runner.go:195] Run: crio config
I0317 13:46:02.608529 669182 cni.go:84] Creating CNI manager for ""
I0317 13:46:02.608557 669182 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0317 13:46:02.608568 669182 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0317 13:46:02.608586 669182 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.229 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-803027 NodeName:old-k8s-version-803027 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.229"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.229 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0317 13:46:02.608699 669182 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.229
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-803027"
kubeletExtraArgs:
node-ip: 192.168.61.229
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.229"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0317 13:46:02.608760 669182 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0317 13:46:02.618979 669182 binaries.go:44] Found k8s binaries, skipping transfer
I0317 13:46:02.619041 669182 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0317 13:46:02.628619 669182 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0317 13:46:02.644430 669182 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0317 13:46:02.663061 669182 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0317 13:46:02.682741 669182 ssh_runner.go:195] Run: grep 192.168.61.229 control-plane.minikube.internal$ /etc/hosts
I0317 13:46:02.688095 669182 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.229 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0317 13:46:02.706123 669182 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0317 13:46:02.860760 669182 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0317 13:46:02.877957 669182 certs.go:68] Setting up /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027 for IP: 192.168.61.229
I0317 13:46:02.877991 669182 certs.go:194] generating shared ca certs ...
I0317 13:46:02.878015 669182 certs.go:226] acquiring lock for ca certs: {Name:mk3605ede7f6a7f18b88f72b01e6c88954de0ac9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 13:46:02.878212 669182 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20539-621978/.minikube/ca.key
I0317 13:46:02.878276 669182 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20539-621978/.minikube/proxy-client-ca.key
I0317 13:46:02.878290 669182 certs.go:256] generating profile certs ...
I0317 13:46:02.878371 669182 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/client.key
I0317 13:46:02.878411 669182 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/client.crt with IP's: []
I0317 13:46:02.943760 669182 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/client.crt ...
I0317 13:46:02.943802 669182 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/client.crt: {Name:mk65b93f15885e6dbfc5fe81f4825ede29af84ad Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 13:46:02.944020 669182 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/client.key ...
I0317 13:46:02.944044 669182 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/client.key: {Name:mk8054b97714f5519489dbabc3adec69734611eb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 13:46:02.944179 669182 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/apiserver.key.729f1cc3
I0317 13:46:02.944208 669182 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/apiserver.crt.729f1cc3 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.229]
I0317 13:46:03.417250 669182 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/apiserver.crt.729f1cc3 ...
I0317 13:46:03.417287 669182 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/apiserver.crt.729f1cc3: {Name:mk571d80349a8579bd389bfe3a89f496b4f4b4f6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 13:46:03.456815 669182 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/apiserver.key.729f1cc3 ...
I0317 13:46:03.456863 669182 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/apiserver.key.729f1cc3: {Name:mk92ffa0b12a6ea74b4fe2acb8062b7b3ddfb45b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 13:46:03.457031 669182 certs.go:381] copying /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/apiserver.crt.729f1cc3 -> /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/apiserver.crt
I0317 13:46:03.457146 669182 certs.go:385] copying /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/apiserver.key.729f1cc3 -> /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/apiserver.key
I0317 13:46:03.457235 669182 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/proxy-client.key
I0317 13:46:03.457259 669182 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/proxy-client.crt with IP's: []
I0317 13:46:03.535835 669182 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/proxy-client.crt ...
I0317 13:46:03.535865 669182 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/proxy-client.crt: {Name:mk9430ddd69712bd5f3dd62ef4266a5b3bbca50d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 13:46:03.591292 669182 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/proxy-client.key ...
I0317 13:46:03.591343 669182 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/proxy-client.key: {Name:mkf70d4c286306fd785f19ecee89372f3d7ee79c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0317 13:46:03.591635 669182 certs.go:484] found cert: /home/jenkins/minikube-integration/20539-621978/.minikube/certs/629188.pem (1338 bytes)
W0317 13:46:03.591687 669182 certs.go:480] ignoring /home/jenkins/minikube-integration/20539-621978/.minikube/certs/629188_empty.pem, impossibly tiny 0 bytes
I0317 13:46:03.591702 669182 certs.go:484] found cert: /home/jenkins/minikube-integration/20539-621978/.minikube/certs/ca-key.pem (1675 bytes)
I0317 13:46:03.591733 669182 certs.go:484] found cert: /home/jenkins/minikube-integration/20539-621978/.minikube/certs/ca.pem (1082 bytes)
I0317 13:46:03.591764 669182 certs.go:484] found cert: /home/jenkins/minikube-integration/20539-621978/.minikube/certs/cert.pem (1123 bytes)
I0317 13:46:03.591801 669182 certs.go:484] found cert: /home/jenkins/minikube-integration/20539-621978/.minikube/certs/key.pem (1675 bytes)
I0317 13:46:03.591854 669182 certs.go:484] found cert: /home/jenkins/minikube-integration/20539-621978/.minikube/files/etc/ssl/certs/6291882.pem (1708 bytes)
I0317 13:46:03.592506 669182 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-621978/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0317 13:46:03.621945 669182 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-621978/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0317 13:46:03.646073 669182 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-621978/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0317 13:46:03.671158 669182 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-621978/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0317 13:46:03.695266 669182 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0317 13:46:03.722011 669182 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0317 13:46:03.753431 669182 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0317 13:46:03.785230 669182 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-621978/.minikube/profiles/old-k8s-version-803027/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0317 13:46:03.820225 669182 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-621978/.minikube/certs/629188.pem --> /usr/share/ca-certificates/629188.pem (1338 bytes)
I0317 13:46:03.854067 669182 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-621978/.minikube/files/etc/ssl/certs/6291882.pem --> /usr/share/ca-certificates/6291882.pem (1708 bytes)
I0317 13:46:03.878551 669182 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20539-621978/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0317 13:46:03.905438 669182 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0317 13:46:03.924750 669182 ssh_runner.go:195] Run: openssl version
I0317 13:46:03.930579 669182 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/6291882.pem && ln -fs /usr/share/ca-certificates/6291882.pem /etc/ssl/certs/6291882.pem"
I0317 13:46:03.941686 669182 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/6291882.pem
I0317 13:46:03.946192 669182 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 17 12:49 /usr/share/ca-certificates/6291882.pem
I0317 13:46:03.946259 669182 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/6291882.pem
I0317 13:46:03.952065 669182 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/6291882.pem /etc/ssl/certs/3ec20f2e.0"
I0317 13:46:03.962713 669182 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0317 13:46:03.973492 669182 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0317 13:46:03.979228 669182 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 17 12:42 /usr/share/ca-certificates/minikubeCA.pem
I0317 13:46:03.979299 669182 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0317 13:46:03.984833 669182 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0317 13:46:03.995609 669182 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/629188.pem && ln -fs /usr/share/ca-certificates/629188.pem /etc/ssl/certs/629188.pem"
I0317 13:46:04.006779 669182 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/629188.pem
I0317 13:46:04.011688 669182 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 17 12:49 /usr/share/ca-certificates/629188.pem
I0317 13:46:04.011757 669182 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/629188.pem
I0317 13:46:04.019347 669182 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/629188.pem /etc/ssl/certs/51391683.0"
I0317 13:46:04.030095 669182 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0317 13:46:04.035429 669182 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0317 13:46:04.035484 669182 kubeadm.go:392] StartCluster: {Name:old-k8s-version-803027 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-ver
sion-803027 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.229 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:
docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0317 13:46:04.035615 669182 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0317 13:46:04.035675 669182 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0317 13:46:04.080232 669182 cri.go:89] found id: ""
I0317 13:46:04.080306 669182 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0317 13:46:04.093474 669182 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0317 13:46:04.103662 669182 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0317 13:46:04.113196 669182 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0317 13:46:04.113216 669182 kubeadm.go:157] found existing configuration files:
I0317 13:46:04.113265 669182 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0317 13:46:04.122656 669182 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0317 13:46:04.122730 669182 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0317 13:46:04.132492 669182 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0317 13:46:04.141395 669182 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0317 13:46:04.141476 669182 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0317 13:46:04.150576 669182 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0317 13:46:04.159202 669182 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0317 13:46:04.159285 669182 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0317 13:46:04.169461 669182 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0317 13:46:04.178572 669182 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0317 13:46:04.178638 669182 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0317 13:46:04.188061 669182 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0317 13:46:04.290394 669182 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0317 13:46:04.290484 669182 kubeadm.go:310] [preflight] Running pre-flight checks
I0317 13:46:04.434696 669182 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0317 13:46:04.434914 669182 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0317 13:46:04.435058 669182 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0317 13:46:04.612260 669182 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0317 13:46:04.756445 669182 out.go:235] - Generating certificates and keys ...
I0317 13:46:04.756610 669182 kubeadm.go:310] [certs] Using existing ca certificate authority
I0317 13:46:04.756697 669182 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0317 13:46:04.756790 669182 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0317 13:46:04.856688 669182 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0317 13:46:05.165268 669182 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0317 13:46:05.310401 669182 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0317 13:46:05.439918 669182 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0317 13:46:05.440268 669182 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-803027] and IPs [192.168.61.229 127.0.0.1 ::1]
I0317 13:46:05.571769 669182 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0317 13:46:05.572164 669182 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-803027] and IPs [192.168.61.229 127.0.0.1 ::1]
I0317 13:46:05.701956 669182 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0317 13:46:05.960547 669182 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0317 13:46:06.073883 669182 kubeadm.go:310] [certs] Generating "sa" key and public key
I0317 13:46:06.074331 669182 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0317 13:46:06.182666 669182 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0317 13:46:06.338391 669182 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0317 13:46:06.961087 669182 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0317 13:46:07.087463 669182 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0317 13:46:07.107754 669182 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0317 13:46:07.111210 669182 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0317 13:46:07.111311 669182 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0317 13:46:07.295582 669182 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0317 13:46:07.297308 669182 out.go:235] - Booting up control plane ...
I0317 13:46:07.297457 669182 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0317 13:46:07.303807 669182 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0317 13:46:07.304846 669182 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0317 13:46:07.305666 669182 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0317 13:46:07.310548 669182 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0317 13:46:47.305622 669182 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0317 13:46:47.305797 669182 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0317 13:46:47.306075 669182 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0317 13:46:52.306393 669182 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0317 13:46:52.306711 669182 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0317 13:47:02.305398 669182 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0317 13:47:02.305696 669182 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0317 13:47:22.304527 669182 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0317 13:47:22.304842 669182 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0317 13:48:02.305672 669182 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0317 13:48:02.305911 669182 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0317 13:48:02.305962 669182 kubeadm.go:310]
I0317 13:48:02.306050 669182 kubeadm.go:310] Unfortunately, an error has occurred:
I0317 13:48:02.306105 669182 kubeadm.go:310] timed out waiting for the condition
I0317 13:48:02.306113 669182 kubeadm.go:310]
I0317 13:48:02.306162 669182 kubeadm.go:310] This error is likely caused by:
I0317 13:48:02.306201 669182 kubeadm.go:310] - The kubelet is not running
I0317 13:48:02.306359 669182 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0317 13:48:02.306375 669182 kubeadm.go:310]
I0317 13:48:02.306507 669182 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0317 13:48:02.306566 669182 kubeadm.go:310] - 'systemctl status kubelet'
I0317 13:48:02.306612 669182 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0317 13:48:02.306621 669182 kubeadm.go:310]
I0317 13:48:02.306761 669182 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0317 13:48:02.306875 669182 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0317 13:48:02.306888 669182 kubeadm.go:310]
I0317 13:48:02.306996 669182 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0317 13:48:02.307069 669182 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0317 13:48:02.307160 669182 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0317 13:48:02.307264 669182 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0317 13:48:02.307275 669182 kubeadm.go:310]
I0317 13:48:02.307576 669182 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0317 13:48:02.307680 669182 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0317 13:48:02.307755 669182 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0317 13:48:02.307930 669182 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-803027] and IPs [192.168.61.229 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-803027] and IPs [192.168.61.229 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-803027] and IPs [192.168.61.229 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-803027] and IPs [192.168.61.229 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0317 13:48:02.307984 669182 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0317 13:48:02.747455 669182 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0317 13:48:02.766089 669182 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0317 13:48:02.777862 669182 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0317 13:48:02.777887 669182 kubeadm.go:157] found existing configuration files:
I0317 13:48:02.777944 669182 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0317 13:48:02.786774 669182 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0317 13:48:02.786863 669182 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0317 13:48:02.795989 669182 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0317 13:48:02.805138 669182 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0317 13:48:02.805207 669182 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0317 13:48:02.814650 669182 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0317 13:48:02.823683 669182 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0317 13:48:02.823754 669182 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0317 13:48:02.833388 669182 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0317 13:48:02.842233 669182 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0317 13:48:02.842294 669182 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0317 13:48:02.851613 669182 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0317 13:48:02.919594 669182 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0317 13:48:02.919719 669182 kubeadm.go:310] [preflight] Running pre-flight checks
I0317 13:48:03.050970 669182 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0317 13:48:03.051227 669182 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0317 13:48:03.051371 669182 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0317 13:48:03.221100 669182 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0317 13:48:03.223572 669182 out.go:235] - Generating certificates and keys ...
I0317 13:48:03.223699 669182 kubeadm.go:310] [certs] Using existing ca certificate authority
I0317 13:48:03.223793 669182 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0317 13:48:03.223907 669182 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0317 13:48:03.224001 669182 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0317 13:48:03.224095 669182 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0317 13:48:03.224168 669182 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0317 13:48:03.224274 669182 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0317 13:48:03.224373 669182 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0317 13:48:03.226328 669182 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0317 13:48:03.226439 669182 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0317 13:48:03.226507 669182 kubeadm.go:310] [certs] Using the existing "sa" key
I0317 13:48:03.226589 669182 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0317 13:48:03.416830 669182 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0317 13:48:03.484877 669182 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0317 13:48:03.794807 669182 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0317 13:48:03.926938 669182 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0317 13:48:03.945226 669182 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0317 13:48:03.946174 669182 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0317 13:48:03.946246 669182 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0317 13:48:04.067091 669182 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0317 13:48:04.068817 669182 out.go:235] - Booting up control plane ...
I0317 13:48:04.068917 669182 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0317 13:48:04.072636 669182 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0317 13:48:04.076793 669182 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0317 13:48:04.077813 669182 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0317 13:48:04.080646 669182 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0317 13:48:44.082941 669182 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0317 13:48:44.083036 669182 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0317 13:48:44.083284 669182 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0317 13:48:49.083668 669182 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0317 13:48:49.083868 669182 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0317 13:48:59.084270 669182 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0317 13:48:59.084572 669182 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0317 13:49:19.083898 669182 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0317 13:49:19.084106 669182 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0317 13:49:59.084793 669182 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0317 13:49:59.085277 669182 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0317 13:49:59.085312 669182 kubeadm.go:310]
I0317 13:49:59.085423 669182 kubeadm.go:310] Unfortunately, an error has occurred:
I0317 13:49:59.085511 669182 kubeadm.go:310] timed out waiting for the condition
I0317 13:49:59.085521 669182 kubeadm.go:310]
I0317 13:49:59.085606 669182 kubeadm.go:310] This error is likely caused by:
I0317 13:49:59.085675 669182 kubeadm.go:310] - The kubelet is not running
I0317 13:49:59.085947 669182 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0317 13:49:59.086046 669182 kubeadm.go:310]
I0317 13:49:59.086309 669182 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0317 13:49:59.086383 669182 kubeadm.go:310] - 'systemctl status kubelet'
I0317 13:49:59.086454 669182 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0317 13:49:59.086464 669182 kubeadm.go:310]
I0317 13:49:59.086704 669182 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0317 13:49:59.086912 669182 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0317 13:49:59.086930 669182 kubeadm.go:310]
I0317 13:49:59.087171 669182 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0317 13:49:59.087360 669182 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0317 13:49:59.087636 669182 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0317 13:49:59.087820 669182 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0317 13:49:59.087856 669182 kubeadm.go:310]
I0317 13:49:59.088220 669182 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0317 13:49:59.088476 669182 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0317 13:49:59.088828 669182 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0317 13:49:59.089115 669182 kubeadm.go:394] duration metric: took 3m55.053633268s to StartCluster
I0317 13:49:59.089160 669182 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0317 13:49:59.089216 669182 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0317 13:49:59.122889 669182 cri.go:89] found id: ""
I0317 13:49:59.122924 669182 logs.go:282] 0 containers: []
W0317 13:49:59.122936 669182 logs.go:284] No container was found matching "kube-apiserver"
I0317 13:49:59.122944 669182 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0317 13:49:59.123009 669182 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0317 13:49:59.157873 669182 cri.go:89] found id: ""
I0317 13:49:59.157907 669182 logs.go:282] 0 containers: []
W0317 13:49:59.157919 669182 logs.go:284] No container was found matching "etcd"
I0317 13:49:59.157926 669182 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0317 13:49:59.158000 669182 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0317 13:49:59.194138 669182 cri.go:89] found id: ""
I0317 13:49:59.194173 669182 logs.go:282] 0 containers: []
W0317 13:49:59.194185 669182 logs.go:284] No container was found matching "coredns"
I0317 13:49:59.194193 669182 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0317 13:49:59.194294 669182 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0317 13:49:59.229517 669182 cri.go:89] found id: ""
I0317 13:49:59.229550 669182 logs.go:282] 0 containers: []
W0317 13:49:59.229568 669182 logs.go:284] No container was found matching "kube-scheduler"
I0317 13:49:59.229577 669182 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0317 13:49:59.229643 669182 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0317 13:49:59.269038 669182 cri.go:89] found id: ""
I0317 13:49:59.269071 669182 logs.go:282] 0 containers: []
W0317 13:49:59.269083 669182 logs.go:284] No container was found matching "kube-proxy"
I0317 13:49:59.269092 669182 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0317 13:49:59.269161 669182 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0317 13:49:59.317516 669182 cri.go:89] found id: ""
I0317 13:49:59.317556 669182 logs.go:282] 0 containers: []
W0317 13:49:59.317575 669182 logs.go:284] No container was found matching "kube-controller-manager"
I0317 13:49:59.317584 669182 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0317 13:49:59.317658 669182 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0317 13:49:59.361780 669182 cri.go:89] found id: ""
I0317 13:49:59.361817 669182 logs.go:282] 0 containers: []
W0317 13:49:59.361830 669182 logs.go:284] No container was found matching "kindnet"
I0317 13:49:59.361844 669182 logs.go:123] Gathering logs for kubelet ...
I0317 13:49:59.361861 669182 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0317 13:49:59.420511 669182 logs.go:123] Gathering logs for dmesg ...
I0317 13:49:59.420559 669182 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0317 13:49:59.433436 669182 logs.go:123] Gathering logs for describe nodes ...
I0317 13:49:59.433469 669182 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0317 13:49:59.543386 669182 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0317 13:49:59.543412 669182 logs.go:123] Gathering logs for CRI-O ...
I0317 13:49:59.543426 669182 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0317 13:49:59.657057 669182 logs.go:123] Gathering logs for container status ...
I0317 13:49:59.657094 669182 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0317 13:49:59.704099 669182 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0317 13:49:59.704169 669182 out.go:270] *
*
W0317 13:49:59.704224 669182 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0317 13:49:59.704284 669182 out.go:270] *
*
W0317 13:49:59.705175 669182 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0317 13:49:59.708724 669182 out.go:201]
W0317 13:49:59.709885 669182 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0317 13:49:59.709941 669182 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0317 13:49:59.709971 669182 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0317 13:49:59.711350 669182 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-803027 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-803027 -n old-k8s-version-803027
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-803027 -n old-k8s-version-803027: exit status 6 (237.975503ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0317 13:49:59.999203 672748 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-803027" does not appear in /home/jenkins/minikube-integration/20539-621978/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-803027" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (296.70s)