=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-838260 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-838260 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m34.65332598s)
-- stdout --
* [old-k8s-version-838260] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20317
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20317-361578/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20317-361578/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-838260" primary control-plane node in "old-k8s-version-838260" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0127 13:24:02.618227 420607 out.go:345] Setting OutFile to fd 1 ...
I0127 13:24:02.618454 420607 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 13:24:02.618492 420607 out.go:358] Setting ErrFile to fd 2...
I0127 13:24:02.618514 420607 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 13:24:02.618843 420607 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20317-361578/.minikube/bin
I0127 13:24:02.619739 420607 out.go:352] Setting JSON to false
I0127 13:24:02.621435 420607 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-5","uptime":21983,"bootTime":1737962260,"procs":375,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1074-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0127 13:24:02.621565 420607 start.go:139] virtualization: kvm guest
I0127 13:24:02.624366 420607 out.go:177] * [old-k8s-version-838260] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0127 13:24:02.625993 420607 notify.go:220] Checking for updates...
I0127 13:24:02.626085 420607 out.go:177] - MINIKUBE_LOCATION=20317
I0127 13:24:02.627533 420607 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0127 13:24:02.629023 420607 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20317-361578/kubeconfig
I0127 13:24:02.630447 420607 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20317-361578/.minikube
I0127 13:24:02.632144 420607 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0127 13:24:02.633548 420607 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0127 13:24:02.635632 420607 config.go:182] Loaded profile config "bridge-211629": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0127 13:24:02.635837 420607 config.go:182] Loaded profile config "enable-default-cni-211629": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0127 13:24:02.636013 420607 config.go:182] Loaded profile config "flannel-211629": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0127 13:24:02.636184 420607 driver.go:394] Setting default libvirt URI to qemu:///system
I0127 13:24:02.692480 420607 out.go:177] * Using the kvm2 driver based on user configuration
I0127 13:24:02.693827 420607 start.go:297] selected driver: kvm2
I0127 13:24:02.693846 420607 start.go:901] validating driver "kvm2" against <nil>
I0127 13:24:02.693862 420607 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0127 13:24:02.694728 420607 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0127 13:24:02.694843 420607 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20317-361578/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0127 13:24:02.714227 420607 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0127 13:24:02.714297 420607 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0127 13:24:02.714626 420607 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0127 13:24:02.714671 420607 cni.go:84] Creating CNI manager for ""
I0127 13:24:02.714742 420607 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0127 13:24:02.714758 420607 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0127 13:24:02.714828 420607 start.go:340] cluster config:
{Name:old-k8s-version-838260 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-838260 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0127 13:24:02.714951 420607 iso.go:125] acquiring lock: {Name:mkc026b8dff3b6e4d3ce1210811a36aea711f2ea Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0127 13:24:02.716777 420607 out.go:177] * Starting "old-k8s-version-838260" primary control-plane node in "old-k8s-version-838260" cluster
I0127 13:24:02.718068 420607 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0127 13:24:02.718115 420607 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20317-361578/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0127 13:24:02.718126 420607 cache.go:56] Caching tarball of preloaded images
I0127 13:24:02.718298 420607 preload.go:172] Found /home/jenkins/minikube-integration/20317-361578/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0127 13:24:02.718316 420607 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0127 13:24:02.718453 420607 profile.go:143] Saving config to /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/config.json ...
I0127 13:24:02.718478 420607 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/config.json: {Name:mka21c91528d93d7de4c2597f7776b57f61f2a18 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 13:24:02.718669 420607 start.go:360] acquireMachinesLock for old-k8s-version-838260: {Name:mke52695106e01a7135aca0aab1959f5458c23f4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0127 13:24:02.718726 420607 start.go:364] duration metric: took 35.504µs to acquireMachinesLock for "old-k8s-version-838260"
I0127 13:24:02.718751 420607 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-838260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-838260 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0127 13:24:02.718844 420607 start.go:125] createHost starting for "" (driver="kvm2")
I0127 13:24:02.721273 420607 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0127 13:24:02.721524 420607 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0127 13:24:02.721592 420607 main.go:141] libmachine: Launching plugin server for driver kvm2
I0127 13:24:02.742207 420607 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39339
I0127 13:24:02.742777 420607 main.go:141] libmachine: () Calling .GetVersion
I0127 13:24:02.743515 420607 main.go:141] libmachine: Using API Version 1
I0127 13:24:02.743538 420607 main.go:141] libmachine: () Calling .SetConfigRaw
I0127 13:24:02.744223 420607 main.go:141] libmachine: () Calling .GetMachineName
I0127 13:24:02.744445 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetMachineName
I0127 13:24:02.744627 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .DriverName
I0127 13:24:02.744805 420607 start.go:159] libmachine.API.Create for "old-k8s-version-838260" (driver="kvm2")
I0127 13:24:02.744837 420607 client.go:168] LocalClient.Create starting
I0127 13:24:02.744873 420607 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20317-361578/.minikube/certs/ca.pem
I0127 13:24:02.744915 420607 main.go:141] libmachine: Decoding PEM data...
I0127 13:24:02.744937 420607 main.go:141] libmachine: Parsing certificate...
I0127 13:24:02.745008 420607 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20317-361578/.minikube/certs/cert.pem
I0127 13:24:02.745043 420607 main.go:141] libmachine: Decoding PEM data...
I0127 13:24:02.745060 420607 main.go:141] libmachine: Parsing certificate...
I0127 13:24:02.745097 420607 main.go:141] libmachine: Running pre-create checks...
I0127 13:24:02.745111 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .PreCreateCheck
I0127 13:24:02.745460 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetConfigRaw
I0127 13:24:02.745854 420607 main.go:141] libmachine: Creating machine...
I0127 13:24:02.745867 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .Create
I0127 13:24:02.745999 420607 main.go:141] libmachine: (old-k8s-version-838260) creating KVM machine...
I0127 13:24:02.746015 420607 main.go:141] libmachine: (old-k8s-version-838260) creating network...
I0127 13:24:02.747734 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found existing default KVM network
I0127 13:24:02.749482 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:02.749284 420637 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:ee:e5:09} reservation:<nil>}
I0127 13:24:02.750893 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:02.750789 420637 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:dc:07:6e} reservation:<nil>}
I0127 13:24:02.752600 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:02.752496 420637 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000382990}
I0127 13:24:02.752626 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | created network xml:
I0127 13:24:02.752702 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | <network>
I0127 13:24:02.752723 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | <name>mk-old-k8s-version-838260</name>
I0127 13:24:02.752737 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | <dns enable='no'/>
I0127 13:24:02.752758 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG |
I0127 13:24:02.752773 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0127 13:24:02.752789 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | <dhcp>
I0127 13:24:02.752804 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0127 13:24:02.752817 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | </dhcp>
I0127 13:24:02.752827 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | </ip>
I0127 13:24:02.752835 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG |
I0127 13:24:02.752845 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | </network>
I0127 13:24:02.752856 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG |
I0127 13:24:02.762202 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | trying to create private KVM network mk-old-k8s-version-838260 192.168.61.0/24...
I0127 13:24:02.850703 420607 main.go:141] libmachine: (old-k8s-version-838260) setting up store path in /home/jenkins/minikube-integration/20317-361578/.minikube/machines/old-k8s-version-838260 ...
I0127 13:24:02.850733 420607 main.go:141] libmachine: (old-k8s-version-838260) building disk image from file:///home/jenkins/minikube-integration/20317-361578/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0127 13:24:02.850769 420607 main.go:141] libmachine: (old-k8s-version-838260) Downloading /home/jenkins/minikube-integration/20317-361578/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20317-361578/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0127 13:24:02.850931 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | private KVM network mk-old-k8s-version-838260 192.168.61.0/24 created
I0127 13:24:02.850961 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:02.847752 420637 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20317-361578/.minikube
I0127 13:24:03.182928 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:03.182762 420637 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20317-361578/.minikube/machines/old-k8s-version-838260/id_rsa...
I0127 13:24:03.306487 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:03.306293 420637 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20317-361578/.minikube/machines/old-k8s-version-838260/old-k8s-version-838260.rawdisk...
I0127 13:24:03.306675 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | Writing magic tar header
I0127 13:24:03.306699 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | Writing SSH key tar header
I0127 13:24:03.306781 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:03.306717 420637 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20317-361578/.minikube/machines/old-k8s-version-838260 ...
I0127 13:24:03.306880 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20317-361578/.minikube/machines/old-k8s-version-838260
I0127 13:24:03.306908 420607 main.go:141] libmachine: (old-k8s-version-838260) setting executable bit set on /home/jenkins/minikube-integration/20317-361578/.minikube/machines/old-k8s-version-838260 (perms=drwx------)
I0127 13:24:03.306919 420607 main.go:141] libmachine: (old-k8s-version-838260) setting executable bit set on /home/jenkins/minikube-integration/20317-361578/.minikube/machines (perms=drwxr-xr-x)
I0127 13:24:03.306936 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20317-361578/.minikube/machines
I0127 13:24:03.306949 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20317-361578/.minikube
I0127 13:24:03.306959 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20317-361578
I0127 13:24:03.306970 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0127 13:24:03.306977 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | checking permissions on dir: /home/jenkins
I0127 13:24:03.306986 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | checking permissions on dir: /home
I0127 13:24:03.306993 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | skipping /home - not owner
I0127 13:24:03.307008 420607 main.go:141] libmachine: (old-k8s-version-838260) setting executable bit set on /home/jenkins/minikube-integration/20317-361578/.minikube (perms=drwxr-xr-x)
I0127 13:24:03.307018 420607 main.go:141] libmachine: (old-k8s-version-838260) setting executable bit set on /home/jenkins/minikube-integration/20317-361578 (perms=drwxrwxr-x)
I0127 13:24:03.307028 420607 main.go:141] libmachine: (old-k8s-version-838260) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0127 13:24:03.307036 420607 main.go:141] libmachine: (old-k8s-version-838260) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0127 13:24:03.307045 420607 main.go:141] libmachine: (old-k8s-version-838260) creating domain...
I0127 13:24:03.308358 420607 main.go:141] libmachine: (old-k8s-version-838260) define libvirt domain using xml:
I0127 13:24:03.308381 420607 main.go:141] libmachine: (old-k8s-version-838260) <domain type='kvm'>
I0127 13:24:03.308391 420607 main.go:141] libmachine: (old-k8s-version-838260) <name>old-k8s-version-838260</name>
I0127 13:24:03.308399 420607 main.go:141] libmachine: (old-k8s-version-838260) <memory unit='MiB'>2200</memory>
I0127 13:24:03.308408 420607 main.go:141] libmachine: (old-k8s-version-838260) <vcpu>2</vcpu>
I0127 13:24:03.308415 420607 main.go:141] libmachine: (old-k8s-version-838260) <features>
I0127 13:24:03.308426 420607 main.go:141] libmachine: (old-k8s-version-838260) <acpi/>
I0127 13:24:03.308436 420607 main.go:141] libmachine: (old-k8s-version-838260) <apic/>
I0127 13:24:03.308458 420607 main.go:141] libmachine: (old-k8s-version-838260) <pae/>
I0127 13:24:03.308468 420607 main.go:141] libmachine: (old-k8s-version-838260)
I0127 13:24:03.308477 420607 main.go:141] libmachine: (old-k8s-version-838260) </features>
I0127 13:24:03.308487 420607 main.go:141] libmachine: (old-k8s-version-838260) <cpu mode='host-passthrough'>
I0127 13:24:03.308493 420607 main.go:141] libmachine: (old-k8s-version-838260)
I0127 13:24:03.308497 420607 main.go:141] libmachine: (old-k8s-version-838260) </cpu>
I0127 13:24:03.308502 420607 main.go:141] libmachine: (old-k8s-version-838260) <os>
I0127 13:24:03.308508 420607 main.go:141] libmachine: (old-k8s-version-838260) <type>hvm</type>
I0127 13:24:03.308513 420607 main.go:141] libmachine: (old-k8s-version-838260) <boot dev='cdrom'/>
I0127 13:24:03.308518 420607 main.go:141] libmachine: (old-k8s-version-838260) <boot dev='hd'/>
I0127 13:24:03.308523 420607 main.go:141] libmachine: (old-k8s-version-838260) <bootmenu enable='no'/>
I0127 13:24:03.308529 420607 main.go:141] libmachine: (old-k8s-version-838260) </os>
I0127 13:24:03.308534 420607 main.go:141] libmachine: (old-k8s-version-838260) <devices>
I0127 13:24:03.308541 420607 main.go:141] libmachine: (old-k8s-version-838260) <disk type='file' device='cdrom'>
I0127 13:24:03.308553 420607 main.go:141] libmachine: (old-k8s-version-838260) <source file='/home/jenkins/minikube-integration/20317-361578/.minikube/machines/old-k8s-version-838260/boot2docker.iso'/>
I0127 13:24:03.308563 420607 main.go:141] libmachine: (old-k8s-version-838260) <target dev='hdc' bus='scsi'/>
I0127 13:24:03.308572 420607 main.go:141] libmachine: (old-k8s-version-838260) <readonly/>
I0127 13:24:03.308581 420607 main.go:141] libmachine: (old-k8s-version-838260) </disk>
I0127 13:24:03.308590 420607 main.go:141] libmachine: (old-k8s-version-838260) <disk type='file' device='disk'>
I0127 13:24:03.308603 420607 main.go:141] libmachine: (old-k8s-version-838260) <driver name='qemu' type='raw' cache='default' io='threads' />
I0127 13:24:03.308623 420607 main.go:141] libmachine: (old-k8s-version-838260) <source file='/home/jenkins/minikube-integration/20317-361578/.minikube/machines/old-k8s-version-838260/old-k8s-version-838260.rawdisk'/>
I0127 13:24:03.308635 420607 main.go:141] libmachine: (old-k8s-version-838260) <target dev='hda' bus='virtio'/>
I0127 13:24:03.308645 420607 main.go:141] libmachine: (old-k8s-version-838260) </disk>
I0127 13:24:03.308656 420607 main.go:141] libmachine: (old-k8s-version-838260) <interface type='network'>
I0127 13:24:03.308670 420607 main.go:141] libmachine: (old-k8s-version-838260) <source network='mk-old-k8s-version-838260'/>
I0127 13:24:03.308680 420607 main.go:141] libmachine: (old-k8s-version-838260) <model type='virtio'/>
I0127 13:24:03.308688 420607 main.go:141] libmachine: (old-k8s-version-838260) </interface>
I0127 13:24:03.308696 420607 main.go:141] libmachine: (old-k8s-version-838260) <interface type='network'>
I0127 13:24:03.308702 420607 main.go:141] libmachine: (old-k8s-version-838260) <source network='default'/>
I0127 13:24:03.308708 420607 main.go:141] libmachine: (old-k8s-version-838260) <model type='virtio'/>
I0127 13:24:03.308713 420607 main.go:141] libmachine: (old-k8s-version-838260) </interface>
I0127 13:24:03.308720 420607 main.go:141] libmachine: (old-k8s-version-838260) <serial type='pty'>
I0127 13:24:03.308725 420607 main.go:141] libmachine: (old-k8s-version-838260) <target port='0'/>
I0127 13:24:03.308734 420607 main.go:141] libmachine: (old-k8s-version-838260) </serial>
I0127 13:24:03.308742 420607 main.go:141] libmachine: (old-k8s-version-838260) <console type='pty'>
I0127 13:24:03.308746 420607 main.go:141] libmachine: (old-k8s-version-838260) <target type='serial' port='0'/>
I0127 13:24:03.308753 420607 main.go:141] libmachine: (old-k8s-version-838260) </console>
I0127 13:24:03.308757 420607 main.go:141] libmachine: (old-k8s-version-838260) <rng model='virtio'>
I0127 13:24:03.308763 420607 main.go:141] libmachine: (old-k8s-version-838260) <backend model='random'>/dev/random</backend>
I0127 13:24:03.308769 420607 main.go:141] libmachine: (old-k8s-version-838260) </rng>
I0127 13:24:03.308773 420607 main.go:141] libmachine: (old-k8s-version-838260)
I0127 13:24:03.308777 420607 main.go:141] libmachine: (old-k8s-version-838260)
I0127 13:24:03.308781 420607 main.go:141] libmachine: (old-k8s-version-838260) </devices>
I0127 13:24:03.308785 420607 main.go:141] libmachine: (old-k8s-version-838260) </domain>
I0127 13:24:03.308792 420607 main.go:141] libmachine: (old-k8s-version-838260)
I0127 13:24:03.421811 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:f7:a1:f9 in network default
I0127 13:24:03.422714 420607 main.go:141] libmachine: (old-k8s-version-838260) starting domain...
I0127 13:24:03.422736 420607 main.go:141] libmachine: (old-k8s-version-838260) ensuring networks are active...
I0127 13:24:03.422767 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:03.423744 420607 main.go:141] libmachine: (old-k8s-version-838260) Ensuring network default is active
I0127 13:24:03.423990 420607 main.go:141] libmachine: (old-k8s-version-838260) Ensuring network mk-old-k8s-version-838260 is active
I0127 13:24:03.446625 420607 main.go:141] libmachine: (old-k8s-version-838260) getting domain XML...
I0127 13:24:03.447299 420607 main.go:141] libmachine: (old-k8s-version-838260) creating domain...
I0127 13:24:05.843947 420607 main.go:141] libmachine: (old-k8s-version-838260) waiting for IP...
I0127 13:24:05.844704 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:05.845335 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | unable to find current IP address of domain old-k8s-version-838260 in network mk-old-k8s-version-838260
I0127 13:24:05.845389 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:05.845329 420637 retry.go:31] will retry after 251.067487ms: waiting for domain to come up
I0127 13:24:06.097719 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:06.098230 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | unable to find current IP address of domain old-k8s-version-838260 in network mk-old-k8s-version-838260
I0127 13:24:06.098260 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:06.098203 420637 retry.go:31] will retry after 332.885075ms: waiting for domain to come up
I0127 13:24:06.432861 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:06.433755 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | unable to find current IP address of domain old-k8s-version-838260 in network mk-old-k8s-version-838260
I0127 13:24:06.433780 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:06.433727 420637 retry.go:31] will retry after 456.49937ms: waiting for domain to come up
I0127 13:24:06.891385 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:06.891877 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | unable to find current IP address of domain old-k8s-version-838260 in network mk-old-k8s-version-838260
I0127 13:24:06.891920 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:06.891870 420637 retry.go:31] will retry after 378.105928ms: waiting for domain to come up
I0127 13:24:07.271470 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:07.272100 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | unable to find current IP address of domain old-k8s-version-838260 in network mk-old-k8s-version-838260
I0127 13:24:07.272134 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:07.272075 420637 retry.go:31] will retry after 563.378131ms: waiting for domain to come up
I0127 13:24:07.837440 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:07.838083 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | unable to find current IP address of domain old-k8s-version-838260 in network mk-old-k8s-version-838260
I0127 13:24:07.838126 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:07.838043 420637 retry.go:31] will retry after 834.641155ms: waiting for domain to come up
I0127 13:24:08.674012 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:08.674519 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | unable to find current IP address of domain old-k8s-version-838260 in network mk-old-k8s-version-838260
I0127 13:24:08.674628 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:08.674524 420637 retry.go:31] will retry after 1.166891934s: waiting for domain to come up
I0127 13:24:09.842742 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:09.843347 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | unable to find current IP address of domain old-k8s-version-838260 in network mk-old-k8s-version-838260
I0127 13:24:09.843377 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:09.843328 420637 retry.go:31] will retry after 929.5377ms: waiting for domain to come up
I0127 13:24:10.775012 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:10.775560 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | unable to find current IP address of domain old-k8s-version-838260 in network mk-old-k8s-version-838260
I0127 13:24:10.775582 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:10.775536 420637 retry.go:31] will retry after 1.58446759s: waiting for domain to come up
I0127 13:24:12.362202 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:12.362791 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | unable to find current IP address of domain old-k8s-version-838260 in network mk-old-k8s-version-838260
I0127 13:24:12.362823 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:12.362740 420637 retry.go:31] will retry after 2.082148938s: waiting for domain to come up
I0127 13:24:14.447487 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:14.447899 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | unable to find current IP address of domain old-k8s-version-838260 in network mk-old-k8s-version-838260
I0127 13:24:14.447919 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:14.447864 420637 retry.go:31] will retry after 1.885925944s: waiting for domain to come up
I0127 13:24:16.335839 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:16.336330 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | unable to find current IP address of domain old-k8s-version-838260 in network mk-old-k8s-version-838260
I0127 13:24:16.336362 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:16.336299 420637 retry.go:31] will retry after 3.514437581s: waiting for domain to come up
I0127 13:24:19.852414 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:19.852933 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | unable to find current IP address of domain old-k8s-version-838260 in network mk-old-k8s-version-838260
I0127 13:24:19.852964 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:19.852871 420637 retry.go:31] will retry after 3.483835815s: waiting for domain to come up
I0127 13:24:23.337846 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:23.338244 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | unable to find current IP address of domain old-k8s-version-838260 in network mk-old-k8s-version-838260
I0127 13:24:23.338275 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | I0127 13:24:23.338211 420637 retry.go:31] will retry after 3.715469213s: waiting for domain to come up
I0127 13:24:27.055989 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.056556 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has current primary IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.056580 420607 main.go:141] libmachine: (old-k8s-version-838260) found domain IP: 192.168.61.159
I0127 13:24:27.056598 420607 main.go:141] libmachine: (old-k8s-version-838260) reserving static IP address...
I0127 13:24:27.056920 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-838260", mac: "52:54:00:9d:07:25", ip: "192.168.61.159"} in network mk-old-k8s-version-838260
I0127 13:24:27.136100 420607 main.go:141] libmachine: (old-k8s-version-838260) reserved static IP address 192.168.61.159 for domain old-k8s-version-838260
I0127 13:24:27.136135 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | Getting to WaitForSSH function...
I0127 13:24:27.136153 420607 main.go:141] libmachine: (old-k8s-version-838260) waiting for SSH...
I0127 13:24:27.139133 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.139608 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:minikube Clientid:01:52:54:00:9d:07:25}
I0127 13:24:27.139645 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.139816 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | Using SSH client type: external
I0127 13:24:27.139841 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | Using SSH private key: /home/jenkins/minikube-integration/20317-361578/.minikube/machines/old-k8s-version-838260/id_rsa (-rw-------)
I0127 13:24:27.139882 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.159 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20317-361578/.minikube/machines/old-k8s-version-838260/id_rsa -p 22] /usr/bin/ssh <nil>}
I0127 13:24:27.139896 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | About to run SSH command:
I0127 13:24:27.139909 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | exit 0
I0127 13:24:27.262397 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | SSH cmd err, output: <nil>:
I0127 13:24:27.262724 420607 main.go:141] libmachine: (old-k8s-version-838260) KVM machine creation complete
I0127 13:24:27.263056 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetConfigRaw
I0127 13:24:27.263628 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .DriverName
I0127 13:24:27.263856 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .DriverName
I0127 13:24:27.264047 420607 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0127 13:24:27.264080 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetState
I0127 13:24:27.265356 420607 main.go:141] libmachine: Detecting operating system of created instance...
I0127 13:24:27.265381 420607 main.go:141] libmachine: Waiting for SSH to be available...
I0127 13:24:27.265388 420607 main.go:141] libmachine: Getting to WaitForSSH function...
I0127 13:24:27.265400 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHHostname
I0127 13:24:27.267850 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.268213 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:old-k8s-version-838260 Clientid:01:52:54:00:9d:07:25}
I0127 13:24:27.268237 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.268414 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHPort
I0127 13:24:27.268604 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHKeyPath
I0127 13:24:27.268763 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHKeyPath
I0127 13:24:27.268899 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHUsername
I0127 13:24:27.269033 420607 main.go:141] libmachine: Using SSH client type: native
I0127 13:24:27.269223 420607 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.159 22 <nil> <nil>}
I0127 13:24:27.269234 420607 main.go:141] libmachine: About to run SSH command:
exit 0
I0127 13:24:27.369683 420607 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0127 13:24:27.369712 420607 main.go:141] libmachine: Detecting the provisioner...
I0127 13:24:27.369723 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHHostname
I0127 13:24:27.372416 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.372780 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:old-k8s-version-838260 Clientid:01:52:54:00:9d:07:25}
I0127 13:24:27.372811 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.372917 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHPort
I0127 13:24:27.373085 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHKeyPath
I0127 13:24:27.373239 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHKeyPath
I0127 13:24:27.373421 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHUsername
I0127 13:24:27.373628 420607 main.go:141] libmachine: Using SSH client type: native
I0127 13:24:27.373795 420607 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.159 22 <nil> <nil>}
I0127 13:24:27.373806 420607 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0127 13:24:27.479134 420607 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0127 13:24:27.479236 420607 main.go:141] libmachine: found compatible host: buildroot
I0127 13:24:27.479248 420607 main.go:141] libmachine: Provisioning with buildroot...
I0127 13:24:27.479256 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetMachineName
I0127 13:24:27.479545 420607 buildroot.go:166] provisioning hostname "old-k8s-version-838260"
I0127 13:24:27.479578 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetMachineName
I0127 13:24:27.479768 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHHostname
I0127 13:24:27.482484 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.482904 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:old-k8s-version-838260 Clientid:01:52:54:00:9d:07:25}
I0127 13:24:27.482935 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.483055 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHPort
I0127 13:24:27.483241 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHKeyPath
I0127 13:24:27.483377 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHKeyPath
I0127 13:24:27.483531 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHUsername
I0127 13:24:27.483679 420607 main.go:141] libmachine: Using SSH client type: native
I0127 13:24:27.483846 420607 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.159 22 <nil> <nil>}
I0127 13:24:27.483864 420607 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-838260 && echo "old-k8s-version-838260" | sudo tee /etc/hostname
I0127 13:24:27.603630 420607 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-838260
I0127 13:24:27.603675 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHHostname
I0127 13:24:27.606748 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.607091 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:old-k8s-version-838260 Clientid:01:52:54:00:9d:07:25}
I0127 13:24:27.607137 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.607268 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHPort
I0127 13:24:27.607455 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHKeyPath
I0127 13:24:27.607598 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHKeyPath
I0127 13:24:27.607712 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHUsername
I0127 13:24:27.607869 420607 main.go:141] libmachine: Using SSH client type: native
I0127 13:24:27.608095 420607 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.159 22 <nil> <nil>}
I0127 13:24:27.608113 420607 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-838260' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-838260/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-838260' | sudo tee -a /etc/hosts;
fi
fi
I0127 13:24:27.724725 420607 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0127 13:24:27.724776 420607 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20317-361578/.minikube CaCertPath:/home/jenkins/minikube-integration/20317-361578/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20317-361578/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20317-361578/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20317-361578/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20317-361578/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20317-361578/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20317-361578/.minikube}
I0127 13:24:27.724823 420607 buildroot.go:174] setting up certificates
I0127 13:24:27.724842 420607 provision.go:84] configureAuth start
I0127 13:24:27.724862 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetMachineName
I0127 13:24:27.725177 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetIP
I0127 13:24:27.728220 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.728662 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:old-k8s-version-838260 Clientid:01:52:54:00:9d:07:25}
I0127 13:24:27.728683 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.728889 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHHostname
I0127 13:24:27.731274 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.731609 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:old-k8s-version-838260 Clientid:01:52:54:00:9d:07:25}
I0127 13:24:27.731646 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.731731 420607 provision.go:143] copyHostCerts
I0127 13:24:27.731806 420607 exec_runner.go:144] found /home/jenkins/minikube-integration/20317-361578/.minikube/key.pem, removing ...
I0127 13:24:27.731819 420607 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20317-361578/.minikube/key.pem
I0127 13:24:27.731895 420607 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20317-361578/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20317-361578/.minikube/key.pem (1675 bytes)
I0127 13:24:27.732001 420607 exec_runner.go:144] found /home/jenkins/minikube-integration/20317-361578/.minikube/ca.pem, removing ...
I0127 13:24:27.732012 420607 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20317-361578/.minikube/ca.pem
I0127 13:24:27.732055 420607 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20317-361578/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20317-361578/.minikube/ca.pem (1078 bytes)
I0127 13:24:27.732132 420607 exec_runner.go:144] found /home/jenkins/minikube-integration/20317-361578/.minikube/cert.pem, removing ...
I0127 13:24:27.732143 420607 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20317-361578/.minikube/cert.pem
I0127 13:24:27.732176 420607 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20317-361578/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20317-361578/.minikube/cert.pem (1123 bytes)
I0127 13:24:27.732241 420607 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20317-361578/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20317-361578/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20317-361578/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-838260 san=[127.0.0.1 192.168.61.159 localhost minikube old-k8s-version-838260]
I0127 13:24:27.972453 420607 provision.go:177] copyRemoteCerts
I0127 13:24:27.972534 420607 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0127 13:24:27.972570 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHHostname
I0127 13:24:27.975443 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.975823 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:old-k8s-version-838260 Clientid:01:52:54:00:9d:07:25}
I0127 13:24:27.975851 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:27.976026 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHPort
I0127 13:24:27.976276 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHKeyPath
I0127 13:24:27.976462 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHUsername
I0127 13:24:27.976610 420607 sshutil.go:53] new ssh client: &{IP:192.168.61.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20317-361578/.minikube/machines/old-k8s-version-838260/id_rsa Username:docker}
I0127 13:24:28.057835 420607 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20317-361578/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0127 13:24:28.086623 420607 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20317-361578/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0127 13:24:28.115490 420607 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20317-361578/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0127 13:24:28.151097 420607 provision.go:87] duration metric: took 426.234142ms to configureAuth
I0127 13:24:28.151146 420607 buildroot.go:189] setting minikube options for container-runtime
I0127 13:24:28.151380 420607 config.go:182] Loaded profile config "old-k8s-version-838260": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0127 13:24:28.151486 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHHostname
I0127 13:24:28.155401 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:28.155710 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:old-k8s-version-838260 Clientid:01:52:54:00:9d:07:25}
I0127 13:24:28.155777 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:28.155949 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHPort
I0127 13:24:28.156212 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHKeyPath
I0127 13:24:28.156441 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHKeyPath
I0127 13:24:28.156649 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHUsername
I0127 13:24:28.156960 420607 main.go:141] libmachine: Using SSH client type: native
I0127 13:24:28.157227 420607 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.159 22 <nil> <nil>}
I0127 13:24:28.157264 420607 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0127 13:24:28.418763 420607 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0127 13:24:28.418843 420607 main.go:141] libmachine: Checking connection to Docker...
I0127 13:24:28.418856 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetURL
I0127 13:24:28.420158 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | using libvirt version 6000000
I0127 13:24:28.422675 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:28.423133 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:old-k8s-version-838260 Clientid:01:52:54:00:9d:07:25}
I0127 13:24:28.423170 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:28.423374 420607 main.go:141] libmachine: Docker is up and running!
I0127 13:24:28.423392 420607 main.go:141] libmachine: Reticulating splines...
I0127 13:24:28.423400 420607 client.go:171] duration metric: took 25.678553548s to LocalClient.Create
I0127 13:24:28.423426 420607 start.go:167] duration metric: took 25.678641229s to libmachine.API.Create "old-k8s-version-838260"
I0127 13:24:28.423440 420607 start.go:293] postStartSetup for "old-k8s-version-838260" (driver="kvm2")
I0127 13:24:28.423455 420607 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0127 13:24:28.423483 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .DriverName
I0127 13:24:28.423736 420607 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0127 13:24:28.423770 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHHostname
I0127 13:24:28.425999 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:28.426300 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:old-k8s-version-838260 Clientid:01:52:54:00:9d:07:25}
I0127 13:24:28.426332 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:28.426465 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHPort
I0127 13:24:28.426674 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHKeyPath
I0127 13:24:28.426823 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHUsername
I0127 13:24:28.426946 420607 sshutil.go:53] new ssh client: &{IP:192.168.61.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20317-361578/.minikube/machines/old-k8s-version-838260/id_rsa Username:docker}
I0127 13:24:28.511765 420607 ssh_runner.go:195] Run: cat /etc/os-release
I0127 13:24:28.516739 420607 info.go:137] Remote host: Buildroot 2023.02.9
I0127 13:24:28.516773 420607 filesync.go:126] Scanning /home/jenkins/minikube-integration/20317-361578/.minikube/addons for local assets ...
I0127 13:24:28.516860 420607 filesync.go:126] Scanning /home/jenkins/minikube-integration/20317-361578/.minikube/files for local assets ...
I0127 13:24:28.516976 420607 filesync.go:149] local asset: /home/jenkins/minikube-integration/20317-361578/.minikube/files/etc/ssl/certs/3689462.pem -> 3689462.pem in /etc/ssl/certs
I0127 13:24:28.517111 420607 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0127 13:24:28.527732 420607 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20317-361578/.minikube/files/etc/ssl/certs/3689462.pem --> /etc/ssl/certs/3689462.pem (1708 bytes)
I0127 13:24:28.558130 420607 start.go:296] duration metric: took 134.670403ms for postStartSetup
I0127 13:24:28.558202 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetConfigRaw
I0127 13:24:28.558916 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetIP
I0127 13:24:28.561729 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:28.562099 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:old-k8s-version-838260 Clientid:01:52:54:00:9d:07:25}
I0127 13:24:28.562139 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:28.562398 420607 profile.go:143] Saving config to /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/config.json ...
I0127 13:24:28.562619 420607 start.go:128] duration metric: took 25.84376017s to createHost
I0127 13:24:28.562646 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHHostname
I0127 13:24:28.564854 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:28.565154 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:old-k8s-version-838260 Clientid:01:52:54:00:9d:07:25}
I0127 13:24:28.565189 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:28.565308 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHPort
I0127 13:24:28.565510 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHKeyPath
I0127 13:24:28.565693 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHKeyPath
I0127 13:24:28.565827 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHUsername
I0127 13:24:28.566005 420607 main.go:141] libmachine: Using SSH client type: native
I0127 13:24:28.566185 420607 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.61.159 22 <nil> <nil>}
I0127 13:24:28.566198 420607 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0127 13:24:28.668232 420607 main.go:141] libmachine: SSH cmd err, output: <nil>: 1737984268.640573987
I0127 13:24:28.668258 420607 fix.go:216] guest clock: 1737984268.640573987
I0127 13:24:28.668266 420607 fix.go:229] Guest: 2025-01-27 13:24:28.640573987 +0000 UTC Remote: 2025-01-27 13:24:28.562633065 +0000 UTC m=+26.020537052 (delta=77.940922ms)
I0127 13:24:28.668321 420607 fix.go:200] guest clock delta is within tolerance: 77.940922ms
I0127 13:24:28.668329 420607 start.go:83] releasing machines lock for "old-k8s-version-838260", held for 25.94958992s
I0127 13:24:28.668364 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .DriverName
I0127 13:24:28.669236 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetIP
I0127 13:24:28.673033 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:28.673542 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:old-k8s-version-838260 Clientid:01:52:54:00:9d:07:25}
I0127 13:24:28.673572 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:28.673784 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .DriverName
I0127 13:24:28.674290 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .DriverName
I0127 13:24:28.674477 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .DriverName
I0127 13:24:28.674561 420607 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0127 13:24:28.674628 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHHostname
I0127 13:24:28.674735 420607 ssh_runner.go:195] Run: cat /version.json
I0127 13:24:28.674755 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHHostname
I0127 13:24:28.677708 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:28.677944 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:28.678256 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:old-k8s-version-838260 Clientid:01:52:54:00:9d:07:25}
I0127 13:24:28.678295 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:28.678440 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHPort
I0127 13:24:28.678565 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:old-k8s-version-838260 Clientid:01:52:54:00:9d:07:25}
I0127 13:24:28.678646 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHKeyPath
I0127 13:24:28.678756 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:28.678853 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHUsername
I0127 13:24:28.678858 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHPort
I0127 13:24:28.679014 420607 sshutil.go:53] new ssh client: &{IP:192.168.61.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20317-361578/.minikube/machines/old-k8s-version-838260/id_rsa Username:docker}
I0127 13:24:28.679343 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHKeyPath
I0127 13:24:28.679553 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetSSHUsername
I0127 13:24:28.679726 420607 sshutil.go:53] new ssh client: &{IP:192.168.61.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20317-361578/.minikube/machines/old-k8s-version-838260/id_rsa Username:docker}
I0127 13:24:28.789172 420607 ssh_runner.go:195] Run: systemctl --version
I0127 13:24:28.799421 420607 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0127 13:24:28.972514 420607 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0127 13:24:28.980375 420607 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0127 13:24:28.980479 420607 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0127 13:24:28.999735 420607 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0127 13:24:28.999764 420607 start.go:495] detecting cgroup driver to use...
I0127 13:24:28.999845 420607 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0127 13:24:29.018526 420607 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0127 13:24:29.034812 420607 docker.go:217] disabling cri-docker service (if available) ...
I0127 13:24:29.034931 420607 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0127 13:24:29.050336 420607 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0127 13:24:29.071845 420607 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0127 13:24:29.196352 420607 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0127 13:24:29.394323 420607 docker.go:233] disabling docker service ...
I0127 13:24:29.394421 420607 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0127 13:24:29.414502 420607 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0127 13:24:29.429522 420607 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0127 13:24:29.607407 420607 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0127 13:24:29.772911 420607 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0127 13:24:29.787934 420607 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0127 13:24:29.809283 420607 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0127 13:24:29.809348 420607 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0127 13:24:29.820342 420607 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0127 13:24:29.820405 420607 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0127 13:24:29.834340 420607 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0127 13:24:29.848637 420607 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0127 13:24:29.863138 420607 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0127 13:24:29.874802 420607 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0127 13:24:29.884661 420607 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0127 13:24:29.884718 420607 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0127 13:24:29.899184 420607 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0127 13:24:29.909409 420607 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 13:24:30.056394 420607 ssh_runner.go:195] Run: sudo systemctl restart crio
I0127 13:24:30.180952 420607 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0127 13:24:30.181031 420607 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0127 13:24:30.187847 420607 start.go:563] Will wait 60s for crictl version
I0127 13:24:30.187913 420607 ssh_runner.go:195] Run: which crictl
I0127 13:24:30.192335 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0127 13:24:30.234999 420607 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0127 13:24:30.235098 420607 ssh_runner.go:195] Run: crio --version
I0127 13:24:30.271995 420607 ssh_runner.go:195] Run: crio --version
I0127 13:24:30.310366 420607 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0127 13:24:30.311442 420607 main.go:141] libmachine: (old-k8s-version-838260) Calling .GetIP
I0127 13:24:30.321461 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:30.321936 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:9d:07:25", ip: ""} in network mk-old-k8s-version-838260: {Iface:virbr1 ExpiryTime:2025-01-27 14:24:20 +0000 UTC Type:0 Mac:52:54:00:9d:07:25 Iaid: IPaddr:192.168.61.159 Prefix:24 Hostname:old-k8s-version-838260 Clientid:01:52:54:00:9d:07:25}
I0127 13:24:30.321974 420607 main.go:141] libmachine: (old-k8s-version-838260) DBG | domain old-k8s-version-838260 has defined IP address 192.168.61.159 and MAC address 52:54:00:9d:07:25 in network mk-old-k8s-version-838260
I0127 13:24:30.322478 420607 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0127 13:24:30.329885 420607 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 13:24:30.354991 420607 kubeadm.go:883] updating cluster {Name:old-k8s-version-838260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-838260 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.159 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:
DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0127 13:24:30.355169 420607 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0127 13:24:30.355242 420607 ssh_runner.go:195] Run: sudo crictl images --output json
I0127 13:24:30.408536 420607 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0127 13:24:30.408606 420607 ssh_runner.go:195] Run: which lz4
I0127 13:24:30.414109 420607 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0127 13:24:30.419831 420607 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0127 13:24:30.419859 420607 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20317-361578/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0127 13:24:32.362021 420607 crio.go:462] duration metric: took 1.947941266s to copy over tarball
I0127 13:24:32.362131 420607 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0127 13:24:35.434335 420607 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.072160742s)
I0127 13:24:35.434376 420607 crio.go:469] duration metric: took 3.072315622s to extract the tarball
I0127 13:24:35.434388 420607 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0127 13:24:35.490623 420607 ssh_runner.go:195] Run: sudo crictl images --output json
I0127 13:24:35.555742 420607 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0127 13:24:35.555772 420607 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0127 13:24:35.555855 420607 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 13:24:35.555888 420607 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0127 13:24:35.555870 420607 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0127 13:24:35.555975 420607 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 13:24:35.556139 420607 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 13:24:35.556160 420607 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0127 13:24:35.556291 420607 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0127 13:24:35.556385 420607 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0127 13:24:35.557452 420607 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 13:24:35.557498 420607 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 13:24:35.558173 420607 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0127 13:24:35.558194 420607 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 13:24:35.558353 420607 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0127 13:24:35.558379 420607 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0127 13:24:35.558482 420607 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0127 13:24:35.558490 420607 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0127 13:24:35.702474 420607 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0127 13:24:35.703209 420607 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0127 13:24:35.712937 420607 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0127 13:24:35.716252 420607 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0127 13:24:35.725772 420607 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0127 13:24:35.726214 420607 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0127 13:24:35.727557 420607 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0127 13:24:35.889505 420607 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0127 13:24:35.889591 420607 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 13:24:35.889645 420607 ssh_runner.go:195] Run: which crictl
I0127 13:24:35.908226 420607 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0127 13:24:35.908283 420607 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0127 13:24:35.908340 420607 ssh_runner.go:195] Run: which crictl
I0127 13:24:35.934119 420607 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0127 13:24:35.934183 420607 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 13:24:35.934236 420607 ssh_runner.go:195] Run: which crictl
I0127 13:24:35.948359 420607 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0127 13:24:35.948453 420607 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 13:24:35.948461 420607 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0127 13:24:35.948494 420607 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0127 13:24:35.948507 420607 ssh_runner.go:195] Run: which crictl
I0127 13:24:35.948391 420607 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0127 13:24:35.948535 420607 ssh_runner.go:195] Run: which crictl
I0127 13:24:35.948549 420607 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0127 13:24:35.948590 420607 ssh_runner.go:195] Run: which crictl
I0127 13:24:35.960148 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 13:24:35.960199 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 13:24:35.960228 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 13:24:35.960229 420607 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0127 13:24:35.960301 420607 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0127 13:24:35.960302 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 13:24:35.960344 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 13:24:35.960345 420607 ssh_runner.go:195] Run: which crictl
I0127 13:24:35.960393 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 13:24:36.108048 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 13:24:36.108058 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 13:24:36.108158 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 13:24:36.108204 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 13:24:36.108136 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 13:24:36.108235 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 13:24:36.110642 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 13:24:36.256690 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 13:24:36.275750 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 13:24:36.275841 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 13:24:36.280760 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 13:24:36.280804 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 13:24:36.280864 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 13:24:36.290636 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 13:24:36.368481 420607 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20317-361578/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0127 13:24:36.438979 420607 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20317-361578/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0127 13:24:36.439084 420607 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 13:24:36.439099 420607 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20317-361578/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0127 13:24:36.443679 420607 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20317-361578/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0127 13:24:36.443685 420607 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20317-361578/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0127 13:24:36.443729 420607 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20317-361578/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0127 13:24:36.477256 420607 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20317-361578/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0127 13:24:37.825156 420607 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0127 13:24:37.973801 420607 cache_images.go:92] duration metric: took 2.418005308s to LoadCachedImages
W0127 13:24:37.973901 420607 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20317-361578/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20317-361578/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I0127 13:24:37.973918 420607 kubeadm.go:934] updating node { 192.168.61.159 8443 v1.20.0 crio true true} ...
I0127 13:24:37.974051 420607 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-838260 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.159
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-838260 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0127 13:24:37.974148 420607 ssh_runner.go:195] Run: crio config
I0127 13:24:38.026402 420607 cni.go:84] Creating CNI manager for ""
I0127 13:24:38.026429 420607 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0127 13:24:38.026439 420607 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0127 13:24:38.026459 420607 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.159 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-838260 NodeName:old-k8s-version-838260 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.159"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.159 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0127 13:24:38.026685 420607 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.159
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-838260"
kubeletExtraArgs:
node-ip: 192.168.61.159
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.159"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0127 13:24:38.026761 420607 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0127 13:24:38.037407 420607 binaries.go:44] Found k8s binaries, skipping transfer
I0127 13:24:38.037473 420607 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0127 13:24:38.048413 420607 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0127 13:24:38.065462 420607 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0127 13:24:38.083062 420607 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0127 13:24:38.101073 420607 ssh_runner.go:195] Run: grep 192.168.61.159 control-plane.minikube.internal$ /etc/hosts
I0127 13:24:38.105111 420607 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.159 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 13:24:38.119288 420607 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 13:24:38.255234 420607 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0127 13:24:38.273168 420607 certs.go:68] Setting up /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260 for IP: 192.168.61.159
I0127 13:24:38.273198 420607 certs.go:194] generating shared ca certs ...
I0127 13:24:38.273221 420607 certs.go:226] acquiring lock for ca certs: {Name:mk2a8ecd4a7a58a165d570ba2e64a4e6bda7627c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 13:24:38.273440 420607 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20317-361578/.minikube/ca.key
I0127 13:24:38.273510 420607 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20317-361578/.minikube/proxy-client-ca.key
I0127 13:24:38.273524 420607 certs.go:256] generating profile certs ...
I0127 13:24:38.273583 420607 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/client.key
I0127 13:24:38.273607 420607 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/client.crt with IP's: []
I0127 13:24:38.395700 420607 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/client.crt ...
I0127 13:24:38.395754 420607 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/client.crt: {Name:mkd9cd57a853c2423609266e0d05f12c31d16cc8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 13:24:38.430731 420607 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/client.key ...
I0127 13:24:38.430773 420607 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/client.key: {Name:mk7834cf564158b6a066d4c40ece7b4cfcc88eae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 13:24:38.430926 420607 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/apiserver.key.552336b8
I0127 13:24:38.430944 420607 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/apiserver.crt.552336b8 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.159]
I0127 13:24:38.662278 420607 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/apiserver.crt.552336b8 ...
I0127 13:24:38.662309 420607 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/apiserver.crt.552336b8: {Name:mk5a69aae2da5a3eef8b75eefd4643a0ad632fcb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 13:24:38.663347 420607 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/apiserver.key.552336b8 ...
I0127 13:24:38.663382 420607 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/apiserver.key.552336b8: {Name:mkd75dfacab1f989b7472e022f662bf5b4df17f2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 13:24:38.663528 420607 certs.go:381] copying /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/apiserver.crt.552336b8 -> /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/apiserver.crt
I0127 13:24:38.663647 420607 certs.go:385] copying /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/apiserver.key.552336b8 -> /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/apiserver.key
I0127 13:24:38.663732 420607 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/proxy-client.key
I0127 13:24:38.663755 420607 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/proxy-client.crt with IP's: []
I0127 13:24:38.949813 420607 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/proxy-client.crt ...
I0127 13:24:38.949864 420607 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/proxy-client.crt: {Name:mkf81c2270b9dd311d517b85bc1a486a3408d195 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 13:24:38.950067 420607 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/proxy-client.key ...
I0127 13:24:38.950089 420607 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/proxy-client.key: {Name:mkcd18a1500a5437e1d6e150e3ca9596dad63049 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 13:24:38.950328 420607 certs.go:484] found cert: /home/jenkins/minikube-integration/20317-361578/.minikube/certs/368946.pem (1338 bytes)
W0127 13:24:38.950381 420607 certs.go:480] ignoring /home/jenkins/minikube-integration/20317-361578/.minikube/certs/368946_empty.pem, impossibly tiny 0 bytes
I0127 13:24:38.950403 420607 certs.go:484] found cert: /home/jenkins/minikube-integration/20317-361578/.minikube/certs/ca-key.pem (1679 bytes)
I0127 13:24:38.950440 420607 certs.go:484] found cert: /home/jenkins/minikube-integration/20317-361578/.minikube/certs/ca.pem (1078 bytes)
I0127 13:24:38.950472 420607 certs.go:484] found cert: /home/jenkins/minikube-integration/20317-361578/.minikube/certs/cert.pem (1123 bytes)
I0127 13:24:38.950503 420607 certs.go:484] found cert: /home/jenkins/minikube-integration/20317-361578/.minikube/certs/key.pem (1675 bytes)
I0127 13:24:38.950571 420607 certs.go:484] found cert: /home/jenkins/minikube-integration/20317-361578/.minikube/files/etc/ssl/certs/3689462.pem (1708 bytes)
I0127 13:24:38.951385 420607 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20317-361578/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0127 13:24:38.986336 420607 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20317-361578/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0127 13:24:39.015856 420607 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20317-361578/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0127 13:24:39.048577 420607 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20317-361578/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0127 13:24:39.077740 420607 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0127 13:24:39.108380 420607 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0127 13:24:39.149177 420607 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0127 13:24:39.178232 420607 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20317-361578/.minikube/profiles/old-k8s-version-838260/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0127 13:24:39.218281 420607 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20317-361578/.minikube/files/etc/ssl/certs/3689462.pem --> /usr/share/ca-certificates/3689462.pem (1708 bytes)
I0127 13:24:39.269496 420607 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20317-361578/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0127 13:24:39.293209 420607 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20317-361578/.minikube/certs/368946.pem --> /usr/share/ca-certificates/368946.pem (1338 bytes)
I0127 13:24:39.316812 420607 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0127 13:24:39.332965 420607 ssh_runner.go:195] Run: openssl version
I0127 13:24:39.338784 420607 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/368946.pem && ln -fs /usr/share/ca-certificates/368946.pem /etc/ssl/certs/368946.pem"
I0127 13:24:39.349476 420607 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/368946.pem
I0127 13:24:39.353924 420607 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jan 27 12:22 /usr/share/ca-certificates/368946.pem
I0127 13:24:39.353971 420607 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/368946.pem
I0127 13:24:39.359752 420607 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/368946.pem /etc/ssl/certs/51391683.0"
I0127 13:24:39.370264 420607 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3689462.pem && ln -fs /usr/share/ca-certificates/3689462.pem /etc/ssl/certs/3689462.pem"
I0127 13:24:39.380886 420607 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3689462.pem
I0127 13:24:39.385372 420607 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jan 27 12:22 /usr/share/ca-certificates/3689462.pem
I0127 13:24:39.385416 420607 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3689462.pem
I0127 13:24:39.391910 420607 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3689462.pem /etc/ssl/certs/3ec20f2e.0"
I0127 13:24:39.403525 420607 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0127 13:24:39.418473 420607 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0127 13:24:39.424137 420607 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jan 27 12:13 /usr/share/ca-certificates/minikubeCA.pem
I0127 13:24:39.424196 420607 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0127 13:24:39.431449 420607 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0127 13:24:39.444854 420607 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0127 13:24:39.448927 420607 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0127 13:24:39.448984 420607 kubeadm.go:392] StartCluster: {Name:old-k8s-version-838260 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-838260 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.159 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Dis
ableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0127 13:24:39.449059 420607 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0127 13:24:39.449129 420607 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0127 13:24:39.490600 420607 cri.go:89] found id: ""
I0127 13:24:39.490669 420607 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0127 13:24:39.501148 420607 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0127 13:24:39.511231 420607 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0127 13:24:39.521053 420607 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0127 13:24:39.521077 420607 kubeadm.go:157] found existing configuration files:
I0127 13:24:39.521124 420607 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0127 13:24:39.531794 420607 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0127 13:24:39.531840 420607 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0127 13:24:39.541111 420607 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0127 13:24:39.551577 420607 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0127 13:24:39.551637 420607 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0127 13:24:39.561428 420607 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0127 13:24:39.570990 420607 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0127 13:24:39.571050 420607 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0127 13:24:39.583057 420607 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0127 13:24:39.596421 420607 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0127 13:24:39.596482 420607 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0127 13:24:39.610366 420607 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0127 13:24:39.748723 420607 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0127 13:24:39.748870 420607 kubeadm.go:310] [preflight] Running pre-flight checks
I0127 13:24:39.924239 420607 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0127 13:24:39.924396 420607 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0127 13:24:39.924534 420607 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0127 13:24:40.152463 420607 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0127 13:24:40.154382 420607 out.go:235] - Generating certificates and keys ...
I0127 13:24:40.154495 420607 kubeadm.go:310] [certs] Using existing ca certificate authority
I0127 13:24:40.154603 420607 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0127 13:24:40.287249 420607 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0127 13:24:40.591181 420607 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0127 13:24:40.956998 420607 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0127 13:24:41.128379 420607 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0127 13:24:41.262960 420607 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0127 13:24:41.263169 420607 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-838260] and IPs [192.168.61.159 127.0.0.1 ::1]
I0127 13:24:41.309383 420607 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0127 13:24:41.309690 420607 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-838260] and IPs [192.168.61.159 127.0.0.1 ::1]
I0127 13:24:41.379630 420607 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0127 13:24:41.628240 420607 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0127 13:24:41.808916 420607 kubeadm.go:310] [certs] Generating "sa" key and public key
I0127 13:24:41.809272 420607 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0127 13:24:42.421944 420607 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0127 13:24:42.788497 420607 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0127 13:24:42.947115 420607 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0127 13:24:43.022801 420607 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0127 13:24:43.038375 420607 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0127 13:24:43.039493 420607 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0127 13:24:43.039551 420607 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0127 13:24:43.175108 420607 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0127 13:24:43.176558 420607 out.go:235] - Booting up control plane ...
I0127 13:24:43.176703 420607 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0127 13:24:43.188671 420607 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0127 13:24:43.189774 420607 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0127 13:24:43.190598 420607 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0127 13:24:43.200121 420607 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0127 13:25:23.195671 420607 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0127 13:25:23.196658 420607 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 13:25:23.196938 420607 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 13:25:28.196907 420607 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 13:25:28.197132 420607 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 13:25:38.196573 420607 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 13:25:38.196910 420607 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 13:25:58.196264 420607 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 13:25:58.196655 420607 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 13:26:38.199169 420607 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 13:26:38.199359 420607 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 13:26:38.199390 420607 kubeadm.go:310]
I0127 13:26:38.199479 420607 kubeadm.go:310] Unfortunately, an error has occurred:
I0127 13:26:38.199552 420607 kubeadm.go:310] timed out waiting for the condition
I0127 13:26:38.199567 420607 kubeadm.go:310]
I0127 13:26:38.199610 420607 kubeadm.go:310] This error is likely caused by:
I0127 13:26:38.199663 420607 kubeadm.go:310] - The kubelet is not running
I0127 13:26:38.199810 420607 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0127 13:26:38.199828 420607 kubeadm.go:310]
I0127 13:26:38.199965 420607 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0127 13:26:38.200003 420607 kubeadm.go:310] - 'systemctl status kubelet'
I0127 13:26:38.200053 420607 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0127 13:26:38.200063 420607 kubeadm.go:310]
I0127 13:26:38.200213 420607 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0127 13:26:38.200353 420607 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0127 13:26:38.200369 420607 kubeadm.go:310]
I0127 13:26:38.200498 420607 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0127 13:26:38.200619 420607 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0127 13:26:38.200749 420607 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0127 13:26:38.200860 420607 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0127 13:26:38.200874 420607 kubeadm.go:310]
I0127 13:26:38.201457 420607 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0127 13:26:38.201578 420607 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0127 13:26:38.201707 420607 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0127 13:26:38.201871 420607 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-838260] and IPs [192.168.61.159 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-838260] and IPs [192.168.61.159 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-838260] and IPs [192.168.61.159 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-838260] and IPs [192.168.61.159 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0127 13:26:38.201917 420607 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0127 13:26:39.300940 420607 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.098984276s)
I0127 13:26:39.301047 420607 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0127 13:26:39.322204 420607 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0127 13:26:39.336675 420607 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0127 13:26:39.336701 420607 kubeadm.go:157] found existing configuration files:
I0127 13:26:39.336753 420607 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0127 13:26:39.350557 420607 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0127 13:26:39.350635 420607 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0127 13:26:39.365256 420607 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0127 13:26:39.378984 420607 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0127 13:26:39.379063 420607 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0127 13:26:39.393176 420607 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0127 13:26:39.406715 420607 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0127 13:26:39.406784 420607 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0127 13:26:39.419521 420607 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0127 13:26:39.430726 420607 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0127 13:26:39.430802 420607 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0127 13:26:39.444623 420607 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0127 13:26:39.533693 420607 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0127 13:26:39.533786 420607 kubeadm.go:310] [preflight] Running pre-flight checks
I0127 13:26:39.677894 420607 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0127 13:26:39.678055 420607 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0127 13:26:39.678223 420607 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0127 13:26:39.868220 420607 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0127 13:26:39.870791 420607 out.go:235] - Generating certificates and keys ...
I0127 13:26:39.870868 420607 kubeadm.go:310] [certs] Using existing ca certificate authority
I0127 13:26:39.870955 420607 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0127 13:26:39.871065 420607 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0127 13:26:39.871157 420607 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0127 13:26:39.871253 420607 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0127 13:26:39.871304 420607 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0127 13:26:39.871361 420607 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0127 13:26:39.871413 420607 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0127 13:26:39.871521 420607 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0127 13:26:39.871641 420607 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0127 13:26:39.871695 420607 kubeadm.go:310] [certs] Using the existing "sa" key
I0127 13:26:39.871776 420607 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0127 13:26:40.041473 420607 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0127 13:26:40.087320 420607 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0127 13:26:40.211153 420607 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0127 13:26:40.477182 420607 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0127 13:26:40.491843 420607 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0127 13:26:40.492891 420607 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0127 13:26:40.492994 420607 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0127 13:26:40.620119 420607 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0127 13:26:40.621843 420607 out.go:235] - Booting up control plane ...
I0127 13:26:40.621935 420607 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0127 13:26:40.632499 420607 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0127 13:26:40.634566 420607 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0127 13:26:40.637801 420607 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0127 13:26:40.641329 420607 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0127 13:27:20.644434 420607 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0127 13:27:20.644812 420607 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 13:27:20.645056 420607 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 13:27:25.645734 420607 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 13:27:25.645958 420607 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 13:27:35.646618 420607 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 13:27:35.646873 420607 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 13:27:55.646176 420607 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 13:27:55.646498 420607 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 13:28:35.646080 420607 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 13:28:35.646367 420607 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 13:28:35.646382 420607 kubeadm.go:310]
I0127 13:28:35.646432 420607 kubeadm.go:310] Unfortunately, an error has occurred:
I0127 13:28:35.646522 420607 kubeadm.go:310] timed out waiting for the condition
I0127 13:28:35.646571 420607 kubeadm.go:310]
I0127 13:28:35.646625 420607 kubeadm.go:310] This error is likely caused by:
I0127 13:28:35.646676 420607 kubeadm.go:310] - The kubelet is not running
I0127 13:28:35.646818 420607 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0127 13:28:35.646829 420607 kubeadm.go:310]
I0127 13:28:35.646976 420607 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0127 13:28:35.647023 420607 kubeadm.go:310] - 'systemctl status kubelet'
I0127 13:28:35.647068 420607 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0127 13:28:35.647078 420607 kubeadm.go:310]
I0127 13:28:35.647217 420607 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0127 13:28:35.647356 420607 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0127 13:28:35.647377 420607 kubeadm.go:310]
I0127 13:28:35.647550 420607 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0127 13:28:35.647686 420607 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0127 13:28:35.647792 420607 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0127 13:28:35.647886 420607 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0127 13:28:35.647898 420607 kubeadm.go:310]
I0127 13:28:35.648510 420607 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0127 13:28:35.648644 420607 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0127 13:28:35.648804 420607 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0127 13:28:35.648820 420607 kubeadm.go:394] duration metric: took 3m56.199840701s to StartCluster
I0127 13:28:35.648872 420607 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0127 13:28:35.648929 420607 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0127 13:28:35.702724 420607 cri.go:89] found id: ""
I0127 13:28:35.702753 420607 logs.go:282] 0 containers: []
W0127 13:28:35.702764 420607 logs.go:284] No container was found matching "kube-apiserver"
I0127 13:28:35.702776 420607 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0127 13:28:35.702841 420607 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0127 13:28:35.745198 420607 cri.go:89] found id: ""
I0127 13:28:35.745227 420607 logs.go:282] 0 containers: []
W0127 13:28:35.745238 420607 logs.go:284] No container was found matching "etcd"
I0127 13:28:35.745245 420607 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0127 13:28:35.745299 420607 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0127 13:28:35.785520 420607 cri.go:89] found id: ""
I0127 13:28:35.785551 420607 logs.go:282] 0 containers: []
W0127 13:28:35.785562 420607 logs.go:284] No container was found matching "coredns"
I0127 13:28:35.785570 420607 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0127 13:28:35.785631 420607 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0127 13:28:35.827633 420607 cri.go:89] found id: ""
I0127 13:28:35.827699 420607 logs.go:282] 0 containers: []
W0127 13:28:35.827746 420607 logs.go:284] No container was found matching "kube-scheduler"
I0127 13:28:35.827761 420607 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0127 13:28:35.827837 420607 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0127 13:28:35.874126 420607 cri.go:89] found id: ""
I0127 13:28:35.874166 420607 logs.go:282] 0 containers: []
W0127 13:28:35.874180 420607 logs.go:284] No container was found matching "kube-proxy"
I0127 13:28:35.874189 420607 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0127 13:28:35.874263 420607 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0127 13:28:35.923624 420607 cri.go:89] found id: ""
I0127 13:28:35.923659 420607 logs.go:282] 0 containers: []
W0127 13:28:35.923670 420607 logs.go:284] No container was found matching "kube-controller-manager"
I0127 13:28:35.923678 420607 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0127 13:28:35.923752 420607 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0127 13:28:35.973601 420607 cri.go:89] found id: ""
I0127 13:28:35.973632 420607 logs.go:282] 0 containers: []
W0127 13:28:35.973645 420607 logs.go:284] No container was found matching "kindnet"
I0127 13:28:35.973660 420607 logs.go:123] Gathering logs for container status ...
I0127 13:28:35.973680 420607 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0127 13:28:36.047818 420607 logs.go:123] Gathering logs for kubelet ...
I0127 13:28:36.047861 420607 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0127 13:28:36.105676 420607 logs.go:123] Gathering logs for dmesg ...
I0127 13:28:36.105713 420607 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0127 13:28:36.120263 420607 logs.go:123] Gathering logs for describe nodes ...
I0127 13:28:36.120299 420607 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0127 13:28:36.256772 420607 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0127 13:28:36.256802 420607 logs.go:123] Gathering logs for CRI-O ...
I0127 13:28:36.256819 420607 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
W0127 13:28:36.363299 420607 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 13:28:36.363399 420607 out.go:270] *
*
W0127 13:28:36.363476 420607 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 13:28:36.363494 420607 out.go:270] *
*
W0127 13:28:36.364268 420607 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0127 13:28:36.735787 420607 out.go:201]
W0127 13:28:37.020719 420607 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 13:28:37.020782 420607 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0127 13:28:37.020821 420607 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0127 13:28:37.058152 420607 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-838260 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-838260 -n old-k8s-version-838260
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-838260 -n old-k8s-version-838260: exit status 6 (254.165997ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0127 13:28:37.488642 426446 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-838260" does not appear in /home/jenkins/minikube-integration/20317-361578/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-838260" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (274.97s)