=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-839656 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-839656 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m51.82433844s)
-- stdout --
* [old-k8s-version-839656] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19501
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19501-99403/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19501-99403/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-839656" primary control-plane node in "old-k8s-version-839656" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0826 11:58:54.191707 148739 out.go:345] Setting OutFile to fd 1 ...
I0826 11:58:54.191828 148739 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0826 11:58:54.191837 148739 out.go:358] Setting ErrFile to fd 2...
I0826 11:58:54.191847 148739 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0826 11:58:54.192032 148739 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19501-99403/.minikube/bin
I0826 11:58:54.192656 148739 out.go:352] Setting JSON to false
I0826 11:58:54.193655 148739 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-9","uptime":6075,"bootTime":1724667459,"procs":216,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1067-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0826 11:58:54.193729 148739 start.go:139] virtualization: kvm guest
I0826 11:58:54.196243 148739 out.go:177] * [old-k8s-version-839656] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0826 11:58:54.197776 148739 out.go:177] - MINIKUBE_LOCATION=19501
I0826 11:58:54.197856 148739 notify.go:220] Checking for updates...
I0826 11:58:54.200097 148739 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0826 11:58:54.201539 148739 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19501-99403/kubeconfig
I0826 11:58:54.202817 148739 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19501-99403/.minikube
I0826 11:58:54.204380 148739 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0826 11:58:54.205878 148739 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0826 11:58:54.207736 148739 config.go:182] Loaded profile config "cert-expiration-156240": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0826 11:58:54.207842 148739 config.go:182] Loaded profile config "kubernetes-upgrade-117510": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0826 11:58:54.207934 148739 config.go:182] Loaded profile config "pause-585941": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0826 11:58:54.208031 148739 driver.go:392] Setting default libvirt URI to qemu:///system
I0826 11:58:54.248483 148739 out.go:177] * Using the kvm2 driver based on user configuration
I0826 11:58:54.249702 148739 start.go:297] selected driver: kvm2
I0826 11:58:54.249717 148739 start.go:901] validating driver "kvm2" against <nil>
I0826 11:58:54.249729 148739 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0826 11:58:54.250415 148739 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0826 11:58:54.250497 148739 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19501-99403/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0826 11:58:54.267689 148739 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0826 11:58:54.267756 148739 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0826 11:58:54.267988 148739 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0826 11:58:54.268055 148739 cni.go:84] Creating CNI manager for ""
I0826 11:58:54.268071 148739 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0826 11:58:54.268081 148739 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0826 11:58:54.268134 148739 start.go:340] cluster config:
{Name:old-k8s-version-839656 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724062045-19478@sha256:18a6788f22059eb28b337d2ac1f60d157ba1f4188844194d9df40beae3c7e41b Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-839656 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0826 11:58:54.268227 148739 iso.go:125] acquiring lock: {Name:mkbcdec5f9bc9f35782823301ebec92449f1b0eb Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0826 11:58:54.270239 148739 out.go:177] * Starting "old-k8s-version-839656" primary control-plane node in "old-k8s-version-839656" cluster
I0826 11:58:54.271586 148739 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0826 11:58:54.271634 148739 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19501-99403/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0826 11:58:54.271646 148739 cache.go:56] Caching tarball of preloaded images
I0826 11:58:54.271734 148739 preload.go:172] Found /home/jenkins/minikube-integration/19501-99403/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0826 11:58:54.271750 148739 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0826 11:58:54.271902 148739 profile.go:143] Saving config to /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/config.json ...
I0826 11:58:54.271933 148739 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/config.json: {Name:mke00e01c3af222e02a01a5227ede4e50e8a2af4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0826 11:58:54.272122 148739 start.go:360] acquireMachinesLock for old-k8s-version-839656: {Name:mk4886b5ecbc273cdbec9438c757b373d75bc166 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0826 11:59:13.884052 148739 start.go:364] duration metric: took 19.611882572s to acquireMachinesLock for "old-k8s-version-839656"
I0826 11:59:13.884142 148739 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-839656 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724062045-19478@sha256:18a6788f22059eb28b337d2ac1f60d157ba1f4188844194d9df40beae3c7e41b Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-839656 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0826 11:59:13.884288 148739 start.go:125] createHost starting for "" (driver="kvm2")
I0826 11:59:13.886663 148739 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0826 11:59:13.886909 148739 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0826 11:59:13.886945 148739 main.go:141] libmachine: Launching plugin server for driver kvm2
I0826 11:59:13.904416 148739 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44133
I0826 11:59:13.904846 148739 main.go:141] libmachine: () Calling .GetVersion
I0826 11:59:13.905432 148739 main.go:141] libmachine: Using API Version 1
I0826 11:59:13.905460 148739 main.go:141] libmachine: () Calling .SetConfigRaw
I0826 11:59:13.905832 148739 main.go:141] libmachine: () Calling .GetMachineName
I0826 11:59:13.906086 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetMachineName
I0826 11:59:13.906248 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .DriverName
I0826 11:59:13.906423 148739 start.go:159] libmachine.API.Create for "old-k8s-version-839656" (driver="kvm2")
I0826 11:59:13.906450 148739 client.go:168] LocalClient.Create starting
I0826 11:59:13.906490 148739 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19501-99403/.minikube/certs/ca.pem
I0826 11:59:13.906535 148739 main.go:141] libmachine: Decoding PEM data...
I0826 11:59:13.906554 148739 main.go:141] libmachine: Parsing certificate...
I0826 11:59:13.906609 148739 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19501-99403/.minikube/certs/cert.pem
I0826 11:59:13.906627 148739 main.go:141] libmachine: Decoding PEM data...
I0826 11:59:13.906639 148739 main.go:141] libmachine: Parsing certificate...
I0826 11:59:13.906665 148739 main.go:141] libmachine: Running pre-create checks...
I0826 11:59:13.906679 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .PreCreateCheck
I0826 11:59:13.907048 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetConfigRaw
I0826 11:59:13.907469 148739 main.go:141] libmachine: Creating machine...
I0826 11:59:13.907484 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .Create
I0826 11:59:13.907615 148739 main.go:141] libmachine: (old-k8s-version-839656) Creating KVM machine...
I0826 11:59:13.908891 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found existing default KVM network
I0826 11:59:13.910738 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:13.910577 148867 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:3a:6b:e4} reservation:<nil>}
I0826 11:59:13.911699 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:13.911606 148867 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:90:77:33} reservation:<nil>}
I0826 11:59:13.912611 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:13.912526 148867 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:28:b5:d2} reservation:<nil>}
I0826 11:59:13.913839 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:13.913752 148867 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002abdd0}
I0826 11:59:13.913876 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | created network xml:
I0826 11:59:13.913889 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | <network>
I0826 11:59:13.913899 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | <name>mk-old-k8s-version-839656</name>
I0826 11:59:13.913905 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | <dns enable='no'/>
I0826 11:59:13.913913 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG |
I0826 11:59:13.913918 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0826 11:59:13.913930 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | <dhcp>
I0826 11:59:13.913936 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0826 11:59:13.913945 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | </dhcp>
I0826 11:59:13.913959 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | </ip>
I0826 11:59:13.913972 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG |
I0826 11:59:13.913981 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | </network>
I0826 11:59:13.913988 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG |
I0826 11:59:13.919379 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | trying to create private KVM network mk-old-k8s-version-839656 192.168.72.0/24...
I0826 11:59:13.994303 148739 main.go:141] libmachine: (old-k8s-version-839656) Setting up store path in /home/jenkins/minikube-integration/19501-99403/.minikube/machines/old-k8s-version-839656 ...
I0826 11:59:13.994338 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | private KVM network mk-old-k8s-version-839656 192.168.72.0/24 created
I0826 11:59:13.994349 148739 main.go:141] libmachine: (old-k8s-version-839656) Building disk image from file:///home/jenkins/minikube-integration/19501-99403/.minikube/cache/iso/amd64/minikube-v1.33.1-1723740674-19452-amd64.iso
I0826 11:59:13.994371 148739 main.go:141] libmachine: (old-k8s-version-839656) Downloading /home/jenkins/minikube-integration/19501-99403/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19501-99403/.minikube/cache/iso/amd64/minikube-v1.33.1-1723740674-19452-amd64.iso...
I0826 11:59:13.994384 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:13.993226 148867 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19501-99403/.minikube
I0826 11:59:14.253492 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:14.253379 148867 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19501-99403/.minikube/machines/old-k8s-version-839656/id_rsa...
I0826 11:59:14.462260 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:14.462144 148867 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19501-99403/.minikube/machines/old-k8s-version-839656/old-k8s-version-839656.rawdisk...
I0826 11:59:14.462290 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | Writing magic tar header
I0826 11:59:14.462304 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | Writing SSH key tar header
I0826 11:59:14.462318 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:14.462263 148867 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19501-99403/.minikube/machines/old-k8s-version-839656 ...
I0826 11:59:14.462409 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19501-99403/.minikube/machines/old-k8s-version-839656
I0826 11:59:14.462443 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19501-99403/.minikube/machines
I0826 11:59:14.462456 148739 main.go:141] libmachine: (old-k8s-version-839656) Setting executable bit set on /home/jenkins/minikube-integration/19501-99403/.minikube/machines/old-k8s-version-839656 (perms=drwx------)
I0826 11:59:14.462466 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19501-99403/.minikube
I0826 11:59:14.462478 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19501-99403
I0826 11:59:14.462487 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0826 11:59:14.462502 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | Checking permissions on dir: /home/jenkins
I0826 11:59:14.462518 148739 main.go:141] libmachine: (old-k8s-version-839656) Setting executable bit set on /home/jenkins/minikube-integration/19501-99403/.minikube/machines (perms=drwxr-xr-x)
I0826 11:59:14.462530 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | Checking permissions on dir: /home
I0826 11:59:14.462543 148739 main.go:141] libmachine: (old-k8s-version-839656) Setting executable bit set on /home/jenkins/minikube-integration/19501-99403/.minikube (perms=drwxr-xr-x)
I0826 11:59:14.462552 148739 main.go:141] libmachine: (old-k8s-version-839656) Setting executable bit set on /home/jenkins/minikube-integration/19501-99403 (perms=drwxrwxr-x)
I0826 11:59:14.462566 148739 main.go:141] libmachine: (old-k8s-version-839656) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0826 11:59:14.462580 148739 main.go:141] libmachine: (old-k8s-version-839656) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0826 11:59:14.462592 148739 main.go:141] libmachine: (old-k8s-version-839656) Creating domain...
I0826 11:59:14.462604 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | Skipping /home - not owner
I0826 11:59:14.463840 148739 main.go:141] libmachine: (old-k8s-version-839656) define libvirt domain using xml:
I0826 11:59:14.463867 148739 main.go:141] libmachine: (old-k8s-version-839656) <domain type='kvm'>
I0826 11:59:14.463878 148739 main.go:141] libmachine: (old-k8s-version-839656) <name>old-k8s-version-839656</name>
I0826 11:59:14.463886 148739 main.go:141] libmachine: (old-k8s-version-839656) <memory unit='MiB'>2200</memory>
I0826 11:59:14.463898 148739 main.go:141] libmachine: (old-k8s-version-839656) <vcpu>2</vcpu>
I0826 11:59:14.463905 148739 main.go:141] libmachine: (old-k8s-version-839656) <features>
I0826 11:59:14.463914 148739 main.go:141] libmachine: (old-k8s-version-839656) <acpi/>
I0826 11:59:14.463926 148739 main.go:141] libmachine: (old-k8s-version-839656) <apic/>
I0826 11:59:14.463939 148739 main.go:141] libmachine: (old-k8s-version-839656) <pae/>
I0826 11:59:14.463949 148739 main.go:141] libmachine: (old-k8s-version-839656)
I0826 11:59:14.463976 148739 main.go:141] libmachine: (old-k8s-version-839656) </features>
I0826 11:59:14.463991 148739 main.go:141] libmachine: (old-k8s-version-839656) <cpu mode='host-passthrough'>
I0826 11:59:14.463999 148739 main.go:141] libmachine: (old-k8s-version-839656)
I0826 11:59:14.464010 148739 main.go:141] libmachine: (old-k8s-version-839656) </cpu>
I0826 11:59:14.464018 148739 main.go:141] libmachine: (old-k8s-version-839656) <os>
I0826 11:59:14.464029 148739 main.go:141] libmachine: (old-k8s-version-839656) <type>hvm</type>
I0826 11:59:14.464040 148739 main.go:141] libmachine: (old-k8s-version-839656) <boot dev='cdrom'/>
I0826 11:59:14.464054 148739 main.go:141] libmachine: (old-k8s-version-839656) <boot dev='hd'/>
I0826 11:59:14.464084 148739 main.go:141] libmachine: (old-k8s-version-839656) <bootmenu enable='no'/>
I0826 11:59:14.464108 148739 main.go:141] libmachine: (old-k8s-version-839656) </os>
I0826 11:59:14.464122 148739 main.go:141] libmachine: (old-k8s-version-839656) <devices>
I0826 11:59:14.464134 148739 main.go:141] libmachine: (old-k8s-version-839656) <disk type='file' device='cdrom'>
I0826 11:59:14.464155 148739 main.go:141] libmachine: (old-k8s-version-839656) <source file='/home/jenkins/minikube-integration/19501-99403/.minikube/machines/old-k8s-version-839656/boot2docker.iso'/>
I0826 11:59:14.464168 148739 main.go:141] libmachine: (old-k8s-version-839656) <target dev='hdc' bus='scsi'/>
I0826 11:59:14.464178 148739 main.go:141] libmachine: (old-k8s-version-839656) <readonly/>
I0826 11:59:14.464190 148739 main.go:141] libmachine: (old-k8s-version-839656) </disk>
I0826 11:59:14.464204 148739 main.go:141] libmachine: (old-k8s-version-839656) <disk type='file' device='disk'>
I0826 11:59:14.464219 148739 main.go:141] libmachine: (old-k8s-version-839656) <driver name='qemu' type='raw' cache='default' io='threads' />
I0826 11:59:14.464240 148739 main.go:141] libmachine: (old-k8s-version-839656) <source file='/home/jenkins/minikube-integration/19501-99403/.minikube/machines/old-k8s-version-839656/old-k8s-version-839656.rawdisk'/>
I0826 11:59:14.464248 148739 main.go:141] libmachine: (old-k8s-version-839656) <target dev='hda' bus='virtio'/>
I0826 11:59:14.464259 148739 main.go:141] libmachine: (old-k8s-version-839656) </disk>
I0826 11:59:14.464268 148739 main.go:141] libmachine: (old-k8s-version-839656) <interface type='network'>
I0826 11:59:14.464281 148739 main.go:141] libmachine: (old-k8s-version-839656) <source network='mk-old-k8s-version-839656'/>
I0826 11:59:14.464289 148739 main.go:141] libmachine: (old-k8s-version-839656) <model type='virtio'/>
I0826 11:59:14.464300 148739 main.go:141] libmachine: (old-k8s-version-839656) </interface>
I0826 11:59:14.464315 148739 main.go:141] libmachine: (old-k8s-version-839656) <interface type='network'>
I0826 11:59:14.464327 148739 main.go:141] libmachine: (old-k8s-version-839656) <source network='default'/>
I0826 11:59:14.464338 148739 main.go:141] libmachine: (old-k8s-version-839656) <model type='virtio'/>
I0826 11:59:14.464350 148739 main.go:141] libmachine: (old-k8s-version-839656) </interface>
I0826 11:59:14.464361 148739 main.go:141] libmachine: (old-k8s-version-839656) <serial type='pty'>
I0826 11:59:14.464375 148739 main.go:141] libmachine: (old-k8s-version-839656) <target port='0'/>
I0826 11:59:14.464388 148739 main.go:141] libmachine: (old-k8s-version-839656) </serial>
I0826 11:59:14.464402 148739 main.go:141] libmachine: (old-k8s-version-839656) <console type='pty'>
I0826 11:59:14.464413 148739 main.go:141] libmachine: (old-k8s-version-839656) <target type='serial' port='0'/>
I0826 11:59:14.464434 148739 main.go:141] libmachine: (old-k8s-version-839656) </console>
I0826 11:59:14.464446 148739 main.go:141] libmachine: (old-k8s-version-839656) <rng model='virtio'>
I0826 11:59:14.464475 148739 main.go:141] libmachine: (old-k8s-version-839656) <backend model='random'>/dev/random</backend>
I0826 11:59:14.464503 148739 main.go:141] libmachine: (old-k8s-version-839656) </rng>
I0826 11:59:14.464516 148739 main.go:141] libmachine: (old-k8s-version-839656)
I0826 11:59:14.464526 148739 main.go:141] libmachine: (old-k8s-version-839656)
I0826 11:59:14.464535 148739 main.go:141] libmachine: (old-k8s-version-839656) </devices>
I0826 11:59:14.464544 148739 main.go:141] libmachine: (old-k8s-version-839656) </domain>
I0826 11:59:14.464554 148739 main.go:141] libmachine: (old-k8s-version-839656)
I0826 11:59:14.469084 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:a2:0d:78 in network default
I0826 11:59:14.469748 148739 main.go:141] libmachine: (old-k8s-version-839656) Ensuring networks are active...
I0826 11:59:14.469769 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:14.470597 148739 main.go:141] libmachine: (old-k8s-version-839656) Ensuring network default is active
I0826 11:59:14.471075 148739 main.go:141] libmachine: (old-k8s-version-839656) Ensuring network mk-old-k8s-version-839656 is active
I0826 11:59:14.471613 148739 main.go:141] libmachine: (old-k8s-version-839656) Getting domain xml...
I0826 11:59:14.472333 148739 main.go:141] libmachine: (old-k8s-version-839656) Creating domain...
I0826 11:59:15.900859 148739 main.go:141] libmachine: (old-k8s-version-839656) Waiting to get IP...
I0826 11:59:15.902031 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:15.902610 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | unable to find current IP address of domain old-k8s-version-839656 in network mk-old-k8s-version-839656
I0826 11:59:15.902709 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:15.902605 148867 retry.go:31] will retry after 306.7144ms: waiting for machine to come up
I0826 11:59:16.211508 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:16.212228 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | unable to find current IP address of domain old-k8s-version-839656 in network mk-old-k8s-version-839656
I0826 11:59:16.212260 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:16.212166 148867 retry.go:31] will retry after 243.011281ms: waiting for machine to come up
I0826 11:59:16.457440 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:16.458142 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | unable to find current IP address of domain old-k8s-version-839656 in network mk-old-k8s-version-839656
I0826 11:59:16.458179 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:16.458059 148867 retry.go:31] will retry after 482.53788ms: waiting for machine to come up
I0826 11:59:16.941752 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:16.942244 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | unable to find current IP address of domain old-k8s-version-839656 in network mk-old-k8s-version-839656
I0826 11:59:16.942281 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:16.942196 148867 retry.go:31] will retry after 386.513975ms: waiting for machine to come up
I0826 11:59:17.330977 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:17.331513 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | unable to find current IP address of domain old-k8s-version-839656 in network mk-old-k8s-version-839656
I0826 11:59:17.331537 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:17.331481 148867 retry.go:31] will retry after 503.77536ms: waiting for machine to come up
I0826 11:59:17.837310 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:17.837931 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | unable to find current IP address of domain old-k8s-version-839656 in network mk-old-k8s-version-839656
I0826 11:59:17.837968 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:17.837877 148867 retry.go:31] will retry after 740.73817ms: waiting for machine to come up
I0826 11:59:18.580111 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:18.580700 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | unable to find current IP address of domain old-k8s-version-839656 in network mk-old-k8s-version-839656
I0826 11:59:18.580727 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:18.580661 148867 retry.go:31] will retry after 909.418281ms: waiting for machine to come up
I0826 11:59:19.491397 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:19.492011 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | unable to find current IP address of domain old-k8s-version-839656 in network mk-old-k8s-version-839656
I0826 11:59:19.492038 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:19.491968 148867 retry.go:31] will retry after 952.915517ms: waiting for machine to come up
I0826 11:59:20.446735 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:20.447345 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | unable to find current IP address of domain old-k8s-version-839656 in network mk-old-k8s-version-839656
I0826 11:59:20.447374 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:20.447297 148867 retry.go:31] will retry after 1.134965688s: waiting for machine to come up
I0826 11:59:21.583888 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:21.584440 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | unable to find current IP address of domain old-k8s-version-839656 in network mk-old-k8s-version-839656
I0826 11:59:21.584473 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:21.584390 148867 retry.go:31] will retry after 1.919697026s: waiting for machine to come up
I0826 11:59:23.505517 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:23.506092 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | unable to find current IP address of domain old-k8s-version-839656 in network mk-old-k8s-version-839656
I0826 11:59:23.506120 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:23.506044 148867 retry.go:31] will retry after 2.66738007s: waiting for machine to come up
I0826 11:59:26.176678 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:26.177312 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | unable to find current IP address of domain old-k8s-version-839656 in network mk-old-k8s-version-839656
I0826 11:59:26.177339 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:26.177251 148867 retry.go:31] will retry after 2.681608291s: waiting for machine to come up
I0826 11:59:28.861304 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:28.861872 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | unable to find current IP address of domain old-k8s-version-839656 in network mk-old-k8s-version-839656
I0826 11:59:28.861894 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:28.861823 148867 retry.go:31] will retry after 4.373682686s: waiting for machine to come up
I0826 11:59:33.240846 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:33.241308 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | unable to find current IP address of domain old-k8s-version-839656 in network mk-old-k8s-version-839656
I0826 11:59:33.241332 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | I0826 11:59:33.241262 148867 retry.go:31] will retry after 5.414774682s: waiting for machine to come up
I0826 11:59:38.660855 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:38.661463 148739 main.go:141] libmachine: (old-k8s-version-839656) Found IP for machine: 192.168.72.136
I0826 11:59:38.661493 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has current primary IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:38.661502 148739 main.go:141] libmachine: (old-k8s-version-839656) Reserving static IP address...
I0826 11:59:38.662004 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-839656", mac: "52:54:00:c2:da:28", ip: "192.168.72.136"} in network mk-old-k8s-version-839656
I0826 11:59:38.744000 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | Getting to WaitForSSH function...
I0826 11:59:38.744038 148739 main.go:141] libmachine: (old-k8s-version-839656) Reserved static IP address: 192.168.72.136
I0826 11:59:38.744054 148739 main.go:141] libmachine: (old-k8s-version-839656) Waiting for SSH to be available...
I0826 11:59:38.747094 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:38.747511 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:minikube Clientid:01:52:54:00:c2:da:28}
I0826 11:59:38.747540 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:38.747626 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | Using SSH client type: external
I0826 11:59:38.747655 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | Using SSH private key: /home/jenkins/minikube-integration/19501-99403/.minikube/machines/old-k8s-version-839656/id_rsa (-rw-------)
I0826 11:59:38.747687 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.136 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19501-99403/.minikube/machines/old-k8s-version-839656/id_rsa -p 22] /usr/bin/ssh <nil>}
I0826 11:59:38.747698 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | About to run SSH command:
I0826 11:59:38.747711 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | exit 0
I0826 11:59:38.875645 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | SSH cmd err, output: <nil>:
I0826 11:59:38.876065 148739 main.go:141] libmachine: (old-k8s-version-839656) KVM machine creation complete!
I0826 11:59:38.876447 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetConfigRaw
I0826 11:59:38.877042 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .DriverName
I0826 11:59:38.877264 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .DriverName
I0826 11:59:38.877467 148739 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0826 11:59:38.877493 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetState
I0826 11:59:38.879105 148739 main.go:141] libmachine: Detecting operating system of created instance...
I0826 11:59:38.879119 148739 main.go:141] libmachine: Waiting for SSH to be available...
I0826 11:59:38.879130 148739 main.go:141] libmachine: Getting to WaitForSSH function...
I0826 11:59:38.879139 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHHostname
I0826 11:59:38.882434 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:38.883004 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:old-k8s-version-839656 Clientid:01:52:54:00:c2:da:28}
I0826 11:59:38.883029 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:38.883224 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHPort
I0826 11:59:38.883421 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHKeyPath
I0826 11:59:38.883653 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHKeyPath
I0826 11:59:38.883912 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHUsername
I0826 11:59:38.884117 148739 main.go:141] libmachine: Using SSH client type: native
I0826 11:59:38.884373 148739 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.136 22 <nil> <nil>}
I0826 11:59:38.884391 148739 main.go:141] libmachine: About to run SSH command:
exit 0
I0826 11:59:38.998023 148739 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0826 11:59:38.998047 148739 main.go:141] libmachine: Detecting the provisioner...
I0826 11:59:38.998056 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHHostname
I0826 11:59:39.001237 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.001603 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:old-k8s-version-839656 Clientid:01:52:54:00:c2:da:28}
I0826 11:59:39.001636 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.001828 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHPort
I0826 11:59:39.002072 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHKeyPath
I0826 11:59:39.002281 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHKeyPath
I0826 11:59:39.002433 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHUsername
I0826 11:59:39.002628 148739 main.go:141] libmachine: Using SSH client type: native
I0826 11:59:39.002875 148739 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.136 22 <nil> <nil>}
I0826 11:59:39.002894 148739 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0826 11:59:39.111730 148739 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0826 11:59:39.111887 148739 main.go:141] libmachine: found compatible host: buildroot
I0826 11:59:39.111907 148739 main.go:141] libmachine: Provisioning with buildroot...
I0826 11:59:39.111920 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetMachineName
I0826 11:59:39.112195 148739 buildroot.go:166] provisioning hostname "old-k8s-version-839656"
I0826 11:59:39.112224 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetMachineName
I0826 11:59:39.112428 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHHostname
I0826 11:59:39.115603 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.115963 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:old-k8s-version-839656 Clientid:01:52:54:00:c2:da:28}
I0826 11:59:39.115987 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.116133 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHPort
I0826 11:59:39.116320 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHKeyPath
I0826 11:59:39.116482 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHKeyPath
I0826 11:59:39.116613 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHUsername
I0826 11:59:39.116763 148739 main.go:141] libmachine: Using SSH client type: native
I0826 11:59:39.116960 148739 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.136 22 <nil> <nil>}
I0826 11:59:39.116972 148739 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-839656 && echo "old-k8s-version-839656" | sudo tee /etc/hostname
I0826 11:59:39.245488 148739 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-839656
I0826 11:59:39.245522 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHHostname
I0826 11:59:39.248494 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.248961 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:old-k8s-version-839656 Clientid:01:52:54:00:c2:da:28}
I0826 11:59:39.248997 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.249195 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHPort
I0826 11:59:39.249398 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHKeyPath
I0826 11:59:39.249585 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHKeyPath
I0826 11:59:39.249773 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHUsername
I0826 11:59:39.249965 148739 main.go:141] libmachine: Using SSH client type: native
I0826 11:59:39.250129 148739 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.136 22 <nil> <nil>}
I0826 11:59:39.250145 148739 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-839656' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-839656/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-839656' | sudo tee -a /etc/hosts;
fi
fi
I0826 11:59:39.368986 148739 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0826 11:59:39.369024 148739 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19501-99403/.minikube CaCertPath:/home/jenkins/minikube-integration/19501-99403/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19501-99403/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19501-99403/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19501-99403/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19501-99403/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19501-99403/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19501-99403/.minikube}
I0826 11:59:39.369065 148739 buildroot.go:174] setting up certificates
I0826 11:59:39.369082 148739 provision.go:84] configureAuth start
I0826 11:59:39.369105 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetMachineName
I0826 11:59:39.369464 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetIP
I0826 11:59:39.372566 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.372998 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:old-k8s-version-839656 Clientid:01:52:54:00:c2:da:28}
I0826 11:59:39.373030 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.373236 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHHostname
I0826 11:59:39.376043 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.376499 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:old-k8s-version-839656 Clientid:01:52:54:00:c2:da:28}
I0826 11:59:39.376525 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.376766 148739 provision.go:143] copyHostCerts
I0826 11:59:39.376832 148739 exec_runner.go:144] found /home/jenkins/minikube-integration/19501-99403/.minikube/key.pem, removing ...
I0826 11:59:39.376881 148739 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19501-99403/.minikube/key.pem
I0826 11:59:39.376979 148739 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19501-99403/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19501-99403/.minikube/key.pem (1679 bytes)
I0826 11:59:39.377103 148739 exec_runner.go:144] found /home/jenkins/minikube-integration/19501-99403/.minikube/ca.pem, removing ...
I0826 11:59:39.377115 148739 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19501-99403/.minikube/ca.pem
I0826 11:59:39.377149 148739 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19501-99403/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19501-99403/.minikube/ca.pem (1078 bytes)
I0826 11:59:39.377232 148739 exec_runner.go:144] found /home/jenkins/minikube-integration/19501-99403/.minikube/cert.pem, removing ...
I0826 11:59:39.377242 148739 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19501-99403/.minikube/cert.pem
I0826 11:59:39.377270 148739 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19501-99403/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19501-99403/.minikube/cert.pem (1123 bytes)
I0826 11:59:39.377343 148739 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19501-99403/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19501-99403/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19501-99403/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-839656 san=[127.0.0.1 192.168.72.136 localhost minikube old-k8s-version-839656]
I0826 11:59:39.461230 148739 provision.go:177] copyRemoteCerts
I0826 11:59:39.461289 148739 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0826 11:59:39.461314 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHHostname
I0826 11:59:39.464269 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.464671 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:old-k8s-version-839656 Clientid:01:52:54:00:c2:da:28}
I0826 11:59:39.464705 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.464908 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHPort
I0826 11:59:39.465142 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHKeyPath
I0826 11:59:39.465336 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHUsername
I0826 11:59:39.465516 148739 sshutil.go:53] new ssh client: &{IP:192.168.72.136 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19501-99403/.minikube/machines/old-k8s-version-839656/id_rsa Username:docker}
I0826 11:59:39.554225 148739 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19501-99403/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0826 11:59:39.581627 148739 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19501-99403/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0826 11:59:39.606008 148739 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19501-99403/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0826 11:59:39.629316 148739 provision.go:87] duration metric: took 260.217612ms to configureAuth
I0826 11:59:39.629359 148739 buildroot.go:189] setting minikube options for container-runtime
I0826 11:59:39.629546 148739 config.go:182] Loaded profile config "old-k8s-version-839656": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0826 11:59:39.629623 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHHostname
I0826 11:59:39.632566 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.632955 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:old-k8s-version-839656 Clientid:01:52:54:00:c2:da:28}
I0826 11:59:39.632993 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.633206 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHPort
I0826 11:59:39.633405 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHKeyPath
I0826 11:59:39.633555 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHKeyPath
I0826 11:59:39.633671 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHUsername
I0826 11:59:39.633849 148739 main.go:141] libmachine: Using SSH client type: native
I0826 11:59:39.634062 148739 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.136 22 <nil> <nil>}
I0826 11:59:39.634085 148739 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0826 11:59:39.907100 148739 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0826 11:59:39.907134 148739 main.go:141] libmachine: Checking connection to Docker...
I0826 11:59:39.907152 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetURL
I0826 11:59:39.908785 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | Using libvirt version 6000000
I0826 11:59:39.911374 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.912038 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:old-k8s-version-839656 Clientid:01:52:54:00:c2:da:28}
I0826 11:59:39.912076 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.912267 148739 main.go:141] libmachine: Docker is up and running!
I0826 11:59:39.912284 148739 main.go:141] libmachine: Reticulating splines...
I0826 11:59:39.912291 148739 client.go:171] duration metric: took 26.005831234s to LocalClient.Create
I0826 11:59:39.912317 148739 start.go:167] duration metric: took 26.005894368s to libmachine.API.Create "old-k8s-version-839656"
I0826 11:59:39.912331 148739 start.go:293] postStartSetup for "old-k8s-version-839656" (driver="kvm2")
I0826 11:59:39.912343 148739 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0826 11:59:39.912366 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .DriverName
I0826 11:59:39.912638 148739 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0826 11:59:39.912664 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHHostname
I0826 11:59:39.915869 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.916707 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:old-k8s-version-839656 Clientid:01:52:54:00:c2:da:28}
I0826 11:59:39.916738 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:39.916963 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHPort
I0826 11:59:39.917179 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHKeyPath
I0826 11:59:39.917402 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHUsername
I0826 11:59:39.917572 148739 sshutil.go:53] new ssh client: &{IP:192.168.72.136 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19501-99403/.minikube/machines/old-k8s-version-839656/id_rsa Username:docker}
I0826 11:59:40.001394 148739 ssh_runner.go:195] Run: cat /etc/os-release
I0826 11:59:40.006332 148739 info.go:137] Remote host: Buildroot 2023.02.9
I0826 11:59:40.006361 148739 filesync.go:126] Scanning /home/jenkins/minikube-integration/19501-99403/.minikube/addons for local assets ...
I0826 11:59:40.006437 148739 filesync.go:126] Scanning /home/jenkins/minikube-integration/19501-99403/.minikube/files for local assets ...
I0826 11:59:40.006544 148739 filesync.go:149] local asset: /home/jenkins/minikube-integration/19501-99403/.minikube/files/etc/ssl/certs/1065982.pem -> 1065982.pem in /etc/ssl/certs
I0826 11:59:40.006709 148739 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0826 11:59:40.016594 148739 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19501-99403/.minikube/files/etc/ssl/certs/1065982.pem --> /etc/ssl/certs/1065982.pem (1708 bytes)
I0826 11:59:40.044164 148739 start.go:296] duration metric: took 131.815832ms for postStartSetup
I0826 11:59:40.044228 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetConfigRaw
I0826 11:59:40.044908 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetIP
I0826 11:59:40.047911 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:40.048309 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:old-k8s-version-839656 Clientid:01:52:54:00:c2:da:28}
I0826 11:59:40.048357 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:40.048558 148739 profile.go:143] Saving config to /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/config.json ...
I0826 11:59:40.048831 148739 start.go:128] duration metric: took 26.164527769s to createHost
I0826 11:59:40.048857 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHHostname
I0826 11:59:40.051254 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:40.051630 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:old-k8s-version-839656 Clientid:01:52:54:00:c2:da:28}
I0826 11:59:40.051661 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:40.051850 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHPort
I0826 11:59:40.052203 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHKeyPath
I0826 11:59:40.052396 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHKeyPath
I0826 11:59:40.052620 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHUsername
I0826 11:59:40.052836 148739 main.go:141] libmachine: Using SSH client type: native
I0826 11:59:40.053052 148739 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.136 22 <nil> <nil>}
I0826 11:59:40.053067 148739 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0826 11:59:40.163377 148739 main.go:141] libmachine: SSH cmd err, output: <nil>: 1724673580.140884793
I0826 11:59:40.163407 148739 fix.go:216] guest clock: 1724673580.140884793
I0826 11:59:40.163416 148739 fix.go:229] Guest: 2024-08-26 11:59:40.140884793 +0000 UTC Remote: 2024-08-26 11:59:40.048846335 +0000 UTC m=+45.899387764 (delta=92.038458ms)
I0826 11:59:40.163441 148739 fix.go:200] guest clock delta is within tolerance: 92.038458ms
I0826 11:59:40.163448 148739 start.go:83] releasing machines lock for "old-k8s-version-839656", held for 26.279347318s
I0826 11:59:40.163480 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .DriverName
I0826 11:59:40.163818 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetIP
I0826 11:59:40.167044 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:40.167479 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:old-k8s-version-839656 Clientid:01:52:54:00:c2:da:28}
I0826 11:59:40.167509 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:40.167707 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .DriverName
I0826 11:59:40.168275 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .DriverName
I0826 11:59:40.168498 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .DriverName
I0826 11:59:40.168600 148739 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0826 11:59:40.168645 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHHostname
I0826 11:59:40.168751 148739 ssh_runner.go:195] Run: cat /version.json
I0826 11:59:40.168778 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHHostname
I0826 11:59:40.171912 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:40.172201 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:40.172272 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:old-k8s-version-839656 Clientid:01:52:54:00:c2:da:28}
I0826 11:59:40.172300 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:40.172510 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHPort
I0826 11:59:40.172628 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:old-k8s-version-839656 Clientid:01:52:54:00:c2:da:28}
I0826 11:59:40.172659 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:40.172812 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHKeyPath
I0826 11:59:40.173012 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHPort
I0826 11:59:40.173019 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHUsername
I0826 11:59:40.173205 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHKeyPath
I0826 11:59:40.173224 148739 sshutil.go:53] new ssh client: &{IP:192.168.72.136 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19501-99403/.minikube/machines/old-k8s-version-839656/id_rsa Username:docker}
I0826 11:59:40.173328 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetSSHUsername
I0826 11:59:40.173509 148739 sshutil.go:53] new ssh client: &{IP:192.168.72.136 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19501-99403/.minikube/machines/old-k8s-version-839656/id_rsa Username:docker}
I0826 11:59:40.290699 148739 ssh_runner.go:195] Run: systemctl --version
I0826 11:59:40.297097 148739 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0826 11:59:40.457052 148739 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0826 11:59:40.463234 148739 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0826 11:59:40.463323 148739 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0826 11:59:40.481131 148739 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0826 11:59:40.481167 148739 start.go:495] detecting cgroup driver to use...
I0826 11:59:40.481256 148739 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0826 11:59:40.498748 148739 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0826 11:59:40.513606 148739 docker.go:217] disabling cri-docker service (if available) ...
I0826 11:59:40.513673 148739 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0826 11:59:40.528381 148739 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0826 11:59:40.544125 148739 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0826 11:59:40.671181 148739 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0826 11:59:40.840254 148739 docker.go:233] disabling docker service ...
I0826 11:59:40.840317 148739 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0826 11:59:40.865936 148739 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0826 11:59:40.881060 148739 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0826 11:59:41.008850 148739 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0826 11:59:41.152185 148739 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0826 11:59:41.166739 148739 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0826 11:59:41.187201 148739 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0826 11:59:41.187266 148739 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0826 11:59:41.198118 148739 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0826 11:59:41.198194 148739 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0826 11:59:41.210447 148739 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0826 11:59:41.221641 148739 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0826 11:59:41.234066 148739 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0826 11:59:41.245872 148739 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0826 11:59:41.256790 148739 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0826 11:59:41.256863 148739 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0826 11:59:41.271457 148739 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0826 11:59:41.281531 148739 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0826 11:59:41.401548 148739 ssh_runner.go:195] Run: sudo systemctl restart crio
I0826 11:59:41.564874 148739 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0826 11:59:41.564956 148739 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0826 11:59:41.570718 148739 start.go:563] Will wait 60s for crictl version
I0826 11:59:41.570783 148739 ssh_runner.go:195] Run: which crictl
I0826 11:59:41.574562 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0826 11:59:41.619139 148739 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0826 11:59:41.619236 148739 ssh_runner.go:195] Run: crio --version
I0826 11:59:41.648043 148739 ssh_runner.go:195] Run: crio --version
I0826 11:59:41.680140 148739 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0826 11:59:41.681396 148739 main.go:141] libmachine: (old-k8s-version-839656) Calling .GetIP
I0826 11:59:41.684640 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:41.685094 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c2:da:28", ip: ""} in network mk-old-k8s-version-839656: {Iface:virbr4 ExpiryTime:2024-08-26 12:59:28 +0000 UTC Type:0 Mac:52:54:00:c2:da:28 Iaid: IPaddr:192.168.72.136 Prefix:24 Hostname:old-k8s-version-839656 Clientid:01:52:54:00:c2:da:28}
I0826 11:59:41.685132 148739 main.go:141] libmachine: (old-k8s-version-839656) DBG | domain old-k8s-version-839656 has defined IP address 192.168.72.136 and MAC address 52:54:00:c2:da:28 in network mk-old-k8s-version-839656
I0826 11:59:41.685368 148739 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0826 11:59:41.690014 148739 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0826 11:59:41.702597 148739 kubeadm.go:883] updating cluster {Name:old-k8s-version-839656 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724062045-19478@sha256:18a6788f22059eb28b337d2ac1f60d157ba1f4188844194d9df40beae3c7e41b Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-839656 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.136 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0826 11:59:41.702738 148739 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0826 11:59:41.702793 148739 ssh_runner.go:195] Run: sudo crictl images --output json
I0826 11:59:41.737906 148739 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0826 11:59:41.737989 148739 ssh_runner.go:195] Run: which lz4
I0826 11:59:41.742277 148739 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0826 11:59:41.746921 148739 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0826 11:59:41.746963 148739 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19501-99403/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0826 11:59:43.312881 148739 crio.go:462] duration metric: took 1.570634094s to copy over tarball
I0826 11:59:43.312972 148739 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0826 11:59:46.057377 148739 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.744367161s)
I0826 11:59:46.057418 148739 crio.go:469] duration metric: took 2.744503795s to extract the tarball
I0826 11:59:46.057430 148739 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0826 11:59:46.102755 148739 ssh_runner.go:195] Run: sudo crictl images --output json
I0826 11:59:46.150349 148739 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0826 11:59:46.150380 148739 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0826 11:59:46.150454 148739 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0826 11:59:46.150480 148739 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0826 11:59:46.150491 148739 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0826 11:59:46.150506 148739 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0826 11:59:46.150546 148739 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0826 11:59:46.150462 148739 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0826 11:59:46.150460 148739 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0826 11:59:46.150493 148739 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0826 11:59:46.152293 148739 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0826 11:59:46.152368 148739 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0826 11:59:46.152381 148739 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0826 11:59:46.152385 148739 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0826 11:59:46.152368 148739 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0826 11:59:46.152385 148739 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0826 11:59:46.152419 148739 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0826 11:59:46.152494 148739 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0826 11:59:46.390674 148739 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0826 11:59:46.420950 148739 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0826 11:59:46.426440 148739 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0826 11:59:46.444528 148739 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0826 11:59:46.445048 148739 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0826 11:59:46.445095 148739 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0826 11:59:46.445141 148739 ssh_runner.go:195] Run: which crictl
I0826 11:59:46.445971 148739 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0826 11:59:46.450076 148739 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0826 11:59:46.464842 148739 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0826 11:59:46.534572 148739 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0826 11:59:46.534622 148739 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0826 11:59:46.534675 148739 ssh_runner.go:195] Run: which crictl
I0826 11:59:46.578199 148739 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0826 11:59:46.578238 148739 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0826 11:59:46.578266 148739 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0826 11:59:46.578279 148739 ssh_runner.go:195] Run: which crictl
I0826 11:59:46.578287 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0826 11:59:46.578300 148739 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0826 11:59:46.578338 148739 ssh_runner.go:195] Run: which crictl
I0826 11:59:46.578352 148739 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0826 11:59:46.578407 148739 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0826 11:59:46.578443 148739 ssh_runner.go:195] Run: which crictl
I0826 11:59:46.602673 148739 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0826 11:59:46.602729 148739 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0826 11:59:46.602785 148739 ssh_runner.go:195] Run: which crictl
I0826 11:59:46.610509 148739 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0826 11:59:46.610624 148739 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0826 11:59:46.610675 148739 ssh_runner.go:195] Run: which crictl
I0826 11:59:46.610561 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0826 11:59:46.610579 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0826 11:59:46.636960 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0826 11:59:46.637010 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0826 11:59:46.637035 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0826 11:59:46.637094 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0826 11:59:46.676755 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0826 11:59:46.676941 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0826 11:59:46.764320 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0826 11:59:46.801521 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0826 11:59:46.801638 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0826 11:59:46.801672 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0826 11:59:46.801743 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0826 11:59:46.840448 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0826 11:59:46.840490 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0826 11:59:46.863294 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0826 11:59:46.923498 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0826 11:59:46.972917 148739 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19501-99403/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0826 11:59:46.972960 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0826 11:59:46.976730 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0826 11:59:46.992274 148739 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19501-99403/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0826 11:59:46.992285 148739 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0826 11:59:46.992525 148739 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19501-99403/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0826 11:59:47.017759 148739 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19501-99403/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0826 11:59:47.020023 148739 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0826 11:59:47.072024 148739 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19501-99403/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0826 11:59:47.077653 148739 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19501-99403/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0826 11:59:47.077740 148739 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19501-99403/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0826 11:59:47.198291 148739 cache_images.go:92] duration metric: took 1.047892119s to LoadCachedImages
W0826 11:59:47.198416 148739 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19501-99403/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19501-99403/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0826 11:59:47.198437 148739 kubeadm.go:934] updating node { 192.168.72.136 8443 v1.20.0 crio true true} ...
I0826 11:59:47.198564 148739 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-839656 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.136
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-839656 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0826 11:59:47.198652 148739 ssh_runner.go:195] Run: crio config
I0826 11:59:47.247941 148739 cni.go:84] Creating CNI manager for ""
I0826 11:59:47.247976 148739 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0826 11:59:47.247990 148739 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0826 11:59:47.248018 148739 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.136 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-839656 NodeName:old-k8s-version-839656 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.136"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.136 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0826 11:59:47.248215 148739 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.136
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-839656"
kubeletExtraArgs:
node-ip: 192.168.72.136
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.136"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0826 11:59:47.248299 148739 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0826 11:59:47.259147 148739 binaries.go:44] Found k8s binaries, skipping transfer
I0826 11:59:47.259235 148739 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0826 11:59:47.269855 148739 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0826 11:59:47.288362 148739 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0826 11:59:47.305772 148739 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0826 11:59:47.323125 148739 ssh_runner.go:195] Run: grep 192.168.72.136 control-plane.minikube.internal$ /etc/hosts
I0826 11:59:47.328102 148739 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.136 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0826 11:59:47.342455 148739 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0826 11:59:47.466757 148739 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0826 11:59:47.488351 148739 certs.go:68] Setting up /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656 for IP: 192.168.72.136
I0826 11:59:47.488378 148739 certs.go:194] generating shared ca certs ...
I0826 11:59:47.488395 148739 certs.go:226] acquiring lock for ca certs: {Name:mk196d80d16d57be334e9216621ba36f5c556af3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0826 11:59:47.488635 148739 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19501-99403/.minikube/ca.key
I0826 11:59:47.488693 148739 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19501-99403/.minikube/proxy-client-ca.key
I0826 11:59:47.488707 148739 certs.go:256] generating profile certs ...
I0826 11:59:47.488777 148739 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/client.key
I0826 11:59:47.488802 148739 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/client.crt with IP's: []
I0826 11:59:47.660478 148739 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/client.crt ...
I0826 11:59:47.660531 148739 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/client.crt: {Name:mk7ff28cb8c7a6546a6e017efa1bb3a4718828f4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0826 11:59:47.660814 148739 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/client.key ...
I0826 11:59:47.660851 148739 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/client.key: {Name:mk9ceaebd860cec1526e9c7d651b3e1adc448995 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0826 11:59:47.661017 148739 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/apiserver.key.bc731261
I0826 11:59:47.661053 148739 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/apiserver.crt.bc731261 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.136]
I0826 11:59:47.848545 148739 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/apiserver.crt.bc731261 ...
I0826 11:59:47.848578 148739 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/apiserver.crt.bc731261: {Name:mk5f04bd9d3bedb3c82bd327b6b49abdcc7f5ee2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0826 11:59:47.848768 148739 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/apiserver.key.bc731261 ...
I0826 11:59:47.848791 148739 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/apiserver.key.bc731261: {Name:mk9a55f240988d7fda7d4d5e49d80b2d0b859090 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0826 11:59:47.848891 148739 certs.go:381] copying /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/apiserver.crt.bc731261 -> /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/apiserver.crt
I0826 11:59:47.848986 148739 certs.go:385] copying /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/apiserver.key.bc731261 -> /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/apiserver.key
I0826 11:59:47.849064 148739 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/proxy-client.key
I0826 11:59:47.849088 148739 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/proxy-client.crt with IP's: []
I0826 11:59:48.093649 148739 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/proxy-client.crt ...
I0826 11:59:48.093687 148739 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/proxy-client.crt: {Name:mk8da095321a9982321c7a69478548e840e755c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0826 11:59:48.093864 148739 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/proxy-client.key ...
I0826 11:59:48.093879 148739 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/proxy-client.key: {Name:mkc12b144a4f7e7dfc8d0b0f44b2cd1c2fa09037 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0826 11:59:48.094048 148739 certs.go:484] found cert: /home/jenkins/minikube-integration/19501-99403/.minikube/certs/106598.pem (1338 bytes)
W0826 11:59:48.094085 148739 certs.go:480] ignoring /home/jenkins/minikube-integration/19501-99403/.minikube/certs/106598_empty.pem, impossibly tiny 0 bytes
I0826 11:59:48.094095 148739 certs.go:484] found cert: /home/jenkins/minikube-integration/19501-99403/.minikube/certs/ca-key.pem (1675 bytes)
I0826 11:59:48.094119 148739 certs.go:484] found cert: /home/jenkins/minikube-integration/19501-99403/.minikube/certs/ca.pem (1078 bytes)
I0826 11:59:48.094141 148739 certs.go:484] found cert: /home/jenkins/minikube-integration/19501-99403/.minikube/certs/cert.pem (1123 bytes)
I0826 11:59:48.094162 148739 certs.go:484] found cert: /home/jenkins/minikube-integration/19501-99403/.minikube/certs/key.pem (1679 bytes)
I0826 11:59:48.094196 148739 certs.go:484] found cert: /home/jenkins/minikube-integration/19501-99403/.minikube/files/etc/ssl/certs/1065982.pem (1708 bytes)
I0826 11:59:48.094750 148739 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19501-99403/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0826 11:59:48.125499 148739 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19501-99403/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0826 11:59:48.149681 148739 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19501-99403/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0826 11:59:48.176653 148739 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19501-99403/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0826 11:59:48.200520 148739 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0826 11:59:48.229899 148739 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0826 11:59:48.334596 148739 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0826 11:59:48.388045 148739 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19501-99403/.minikube/profiles/old-k8s-version-839656/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0826 11:59:48.417849 148739 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19501-99403/.minikube/certs/106598.pem --> /usr/share/ca-certificates/106598.pem (1338 bytes)
I0826 11:59:48.447950 148739 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19501-99403/.minikube/files/etc/ssl/certs/1065982.pem --> /usr/share/ca-certificates/1065982.pem (1708 bytes)
I0826 11:59:48.487800 148739 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19501-99403/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0826 11:59:48.511262 148739 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0826 11:59:48.529409 148739 ssh_runner.go:195] Run: openssl version
I0826 11:59:48.535333 148739 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0826 11:59:48.546712 148739 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0826 11:59:48.551802 148739 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 26 10:47 /usr/share/ca-certificates/minikubeCA.pem
I0826 11:59:48.551891 148739 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0826 11:59:48.557886 148739 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0826 11:59:48.570389 148739 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/106598.pem && ln -fs /usr/share/ca-certificates/106598.pem /etc/ssl/certs/106598.pem"
I0826 11:59:48.583081 148739 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/106598.pem
I0826 11:59:48.587687 148739 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Aug 26 10:59 /usr/share/ca-certificates/106598.pem
I0826 11:59:48.587765 148739 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/106598.pem
I0826 11:59:48.593528 148739 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/106598.pem /etc/ssl/certs/51391683.0"
I0826 11:59:48.605104 148739 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1065982.pem && ln -fs /usr/share/ca-certificates/1065982.pem /etc/ssl/certs/1065982.pem"
I0826 11:59:48.617813 148739 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1065982.pem
I0826 11:59:48.623076 148739 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Aug 26 10:59 /usr/share/ca-certificates/1065982.pem
I0826 11:59:48.623179 148739 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1065982.pem
I0826 11:59:48.629542 148739 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/1065982.pem /etc/ssl/certs/3ec20f2e.0"
I0826 11:59:48.641174 148739 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0826 11:59:48.646423 148739 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0826 11:59:48.646498 148739 kubeadm.go:392] StartCluster: {Name:old-k8s-version-839656 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19452/minikube-v1.33.1-1723740674-19452-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724062045-19478@sha256:18a6788f22059eb28b337d2ac1f60d157ba1f4188844194d9df40beae3c7e41b Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-839656 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.136 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0826 11:59:48.646701 148739 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0826 11:59:48.646895 148739 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0826 11:59:48.684854 148739 cri.go:89] found id: ""
I0826 11:59:48.684947 148739 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0826 11:59:48.698234 148739 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0826 11:59:48.711179 148739 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0826 11:59:48.721740 148739 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0826 11:59:48.721770 148739 kubeadm.go:157] found existing configuration files:
I0826 11:59:48.721835 148739 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0826 11:59:48.731230 148739 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0826 11:59:48.731309 148739 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0826 11:59:48.742234 148739 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0826 11:59:48.752879 148739 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0826 11:59:48.752978 148739 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0826 11:59:48.769061 148739 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0826 11:59:48.783537 148739 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0826 11:59:48.783622 148739 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0826 11:59:48.794121 148739 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0826 11:59:48.804552 148739 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0826 11:59:48.804622 148739 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0826 11:59:48.815335 148739 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0826 11:59:48.946183 148739 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0826 11:59:48.946255 148739 kubeadm.go:310] [preflight] Running pre-flight checks
I0826 11:59:49.109630 148739 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0826 11:59:49.109781 148739 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0826 11:59:49.109899 148739 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0826 11:59:49.360129 148739 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0826 11:59:49.490720 148739 out.go:235] - Generating certificates and keys ...
I0826 11:59:49.490896 148739 kubeadm.go:310] [certs] Using existing ca certificate authority
I0826 11:59:49.490997 148739 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0826 11:59:49.750724 148739 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0826 11:59:49.845753 148739 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0826 11:59:50.151010 148739 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0826 11:59:50.226214 148739 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0826 11:59:50.401053 148739 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0826 11:59:50.401300 148739 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-839656] and IPs [192.168.72.136 127.0.0.1 ::1]
I0826 11:59:50.490589 148739 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0826 11:59:50.491434 148739 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-839656] and IPs [192.168.72.136 127.0.0.1 ::1]
I0826 11:59:50.626212 148739 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0826 11:59:50.856439 148739 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0826 11:59:51.017747 148739 kubeadm.go:310] [certs] Generating "sa" key and public key
I0826 11:59:51.018141 148739 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0826 11:59:51.232229 148739 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0826 11:59:51.467917 148739 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0826 11:59:51.566840 148739 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0826 11:59:52.091137 148739 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0826 11:59:52.106973 148739 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0826 11:59:52.108686 148739 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0826 11:59:52.108777 148739 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0826 11:59:52.243008 148739 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0826 11:59:52.245150 148739 out.go:235] - Booting up control plane ...
I0826 11:59:52.245301 148739 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0826 11:59:52.249827 148739 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0826 11:59:52.252045 148739 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0826 11:59:52.252875 148739 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0826 11:59:52.257653 148739 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0826 12:00:32.252079 148739 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0826 12:00:32.252758 148739 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0826 12:00:32.253052 148739 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0826 12:00:37.253183 148739 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0826 12:00:37.253478 148739 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0826 12:00:47.252801 148739 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0826 12:00:47.253068 148739 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0826 12:01:07.252575 148739 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0826 12:01:07.252805 148739 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0826 12:01:47.254244 148739 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0826 12:01:47.254518 148739 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0826 12:01:47.254543 148739 kubeadm.go:310]
I0826 12:01:47.254604 148739 kubeadm.go:310] Unfortunately, an error has occurred:
I0826 12:01:47.254651 148739 kubeadm.go:310] timed out waiting for the condition
I0826 12:01:47.254657 148739 kubeadm.go:310]
I0826 12:01:47.254719 148739 kubeadm.go:310] This error is likely caused by:
I0826 12:01:47.254780 148739 kubeadm.go:310] - The kubelet is not running
I0826 12:01:47.254919 148739 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0826 12:01:47.254935 148739 kubeadm.go:310]
I0826 12:01:47.255078 148739 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0826 12:01:47.255121 148739 kubeadm.go:310] - 'systemctl status kubelet'
I0826 12:01:47.255171 148739 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0826 12:01:47.255179 148739 kubeadm.go:310]
I0826 12:01:47.255340 148739 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0826 12:01:47.255462 148739 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0826 12:01:47.255473 148739 kubeadm.go:310]
I0826 12:01:47.255624 148739 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0826 12:01:47.255763 148739 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0826 12:01:47.255888 148739 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0826 12:01:47.255990 148739 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0826 12:01:47.256000 148739 kubeadm.go:310]
I0826 12:01:47.256622 148739 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0826 12:01:47.256735 148739 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0826 12:01:47.256814 148739 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0826 12:01:47.256953 148739 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-839656] and IPs [192.168.72.136 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-839656] and IPs [192.168.72.136 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-839656] and IPs [192.168.72.136 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-839656] and IPs [192.168.72.136 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0826 12:01:47.257004 148739 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0826 12:01:48.646875 148739 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.389816899s)
I0826 12:01:48.646996 148739 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0826 12:01:48.663221 148739 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0826 12:01:48.674702 148739 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0826 12:01:48.674732 148739 kubeadm.go:157] found existing configuration files:
I0826 12:01:48.674806 148739 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0826 12:01:48.684733 148739 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0826 12:01:48.684813 148739 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0826 12:01:48.695133 148739 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0826 12:01:48.705191 148739 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0826 12:01:48.705273 148739 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0826 12:01:48.718880 148739 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0826 12:01:48.728647 148739 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0826 12:01:48.728730 148739 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0826 12:01:48.739491 148739 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0826 12:01:48.750200 148739 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0826 12:01:48.750281 148739 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0826 12:01:48.761003 148739 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0826 12:01:48.994818 148739 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0826 12:03:45.173175 148739 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0826 12:03:45.173299 148739 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0826 12:03:45.175262 148739 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0826 12:03:45.175346 148739 kubeadm.go:310] [preflight] Running pre-flight checks
I0826 12:03:45.175432 148739 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0826 12:03:45.175524 148739 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0826 12:03:45.175636 148739 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0826 12:03:45.175832 148739 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0826 12:03:45.178232 148739 out.go:235] - Generating certificates and keys ...
I0826 12:03:45.178335 148739 kubeadm.go:310] [certs] Using existing ca certificate authority
I0826 12:03:45.178418 148739 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0826 12:03:45.178531 148739 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0826 12:03:45.178629 148739 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0826 12:03:45.178725 148739 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0826 12:03:45.178812 148739 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0826 12:03:45.178912 148739 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0826 12:03:45.179001 148739 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0826 12:03:45.179108 148739 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0826 12:03:45.179212 148739 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0826 12:03:45.179283 148739 kubeadm.go:310] [certs] Using the existing "sa" key
I0826 12:03:45.179381 148739 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0826 12:03:45.179449 148739 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0826 12:03:45.179496 148739 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0826 12:03:45.179581 148739 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0826 12:03:45.179660 148739 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0826 12:03:45.179837 148739 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0826 12:03:45.179943 148739 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0826 12:03:45.179994 148739 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0826 12:03:45.180110 148739 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0826 12:03:45.181693 148739 out.go:235] - Booting up control plane ...
I0826 12:03:45.181786 148739 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0826 12:03:45.181852 148739 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0826 12:03:45.181908 148739 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0826 12:03:45.181993 148739 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0826 12:03:45.182198 148739 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0826 12:03:45.182278 148739 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0826 12:03:45.182372 148739 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0826 12:03:45.182612 148739 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0826 12:03:45.182730 148739 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0826 12:03:45.182978 148739 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0826 12:03:45.183096 148739 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0826 12:03:45.183349 148739 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0826 12:03:45.183465 148739 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0826 12:03:45.183707 148739 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0826 12:03:45.183794 148739 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0826 12:03:45.184040 148739 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0826 12:03:45.184056 148739 kubeadm.go:310]
I0826 12:03:45.184104 148739 kubeadm.go:310] Unfortunately, an error has occurred:
I0826 12:03:45.184155 148739 kubeadm.go:310] timed out waiting for the condition
I0826 12:03:45.184164 148739 kubeadm.go:310]
I0826 12:03:45.184210 148739 kubeadm.go:310] This error is likely caused by:
I0826 12:03:45.184253 148739 kubeadm.go:310] - The kubelet is not running
I0826 12:03:45.184376 148739 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0826 12:03:45.184392 148739 kubeadm.go:310]
I0826 12:03:45.184512 148739 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0826 12:03:45.184558 148739 kubeadm.go:310] - 'systemctl status kubelet'
I0826 12:03:45.184601 148739 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0826 12:03:45.184612 148739 kubeadm.go:310]
I0826 12:03:45.184738 148739 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0826 12:03:45.184846 148739 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0826 12:03:45.184858 148739 kubeadm.go:310]
I0826 12:03:45.184984 148739 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0826 12:03:45.185090 148739 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0826 12:03:45.185185 148739 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0826 12:03:45.185274 148739 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0826 12:03:45.185363 148739 kubeadm.go:394] duration metric: took 3m56.538870728s to StartCluster
I0826 12:03:45.185427 148739 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0826 12:03:45.185502 148739 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0826 12:03:45.185585 148739 kubeadm.go:310]
I0826 12:03:45.240851 148739 cri.go:89] found id: ""
I0826 12:03:45.240896 148739 logs.go:276] 0 containers: []
W0826 12:03:45.240913 148739 logs.go:278] No container was found matching "kube-apiserver"
I0826 12:03:45.240921 148739 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0826 12:03:45.240993 148739 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0826 12:03:45.283139 148739 cri.go:89] found id: ""
I0826 12:03:45.283172 148739 logs.go:276] 0 containers: []
W0826 12:03:45.283182 148739 logs.go:278] No container was found matching "etcd"
I0826 12:03:45.283189 148739 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0826 12:03:45.283245 148739 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0826 12:03:45.326215 148739 cri.go:89] found id: ""
I0826 12:03:45.326246 148739 logs.go:276] 0 containers: []
W0826 12:03:45.326258 148739 logs.go:278] No container was found matching "coredns"
I0826 12:03:45.326265 148739 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0826 12:03:45.326331 148739 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0826 12:03:45.368830 148739 cri.go:89] found id: ""
I0826 12:03:45.368860 148739 logs.go:276] 0 containers: []
W0826 12:03:45.368870 148739 logs.go:278] No container was found matching "kube-scheduler"
I0826 12:03:45.368885 148739 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0826 12:03:45.368956 148739 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0826 12:03:45.418534 148739 cri.go:89] found id: ""
I0826 12:03:45.418611 148739 logs.go:276] 0 containers: []
W0826 12:03:45.418636 148739 logs.go:278] No container was found matching "kube-proxy"
I0826 12:03:45.418645 148739 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0826 12:03:45.418712 148739 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0826 12:03:45.460331 148739 cri.go:89] found id: ""
I0826 12:03:45.460363 148739 logs.go:276] 0 containers: []
W0826 12:03:45.460375 148739 logs.go:278] No container was found matching "kube-controller-manager"
I0826 12:03:45.460384 148739 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0826 12:03:45.460451 148739 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0826 12:03:45.519295 148739 cri.go:89] found id: ""
I0826 12:03:45.519332 148739 logs.go:276] 0 containers: []
W0826 12:03:45.519344 148739 logs.go:278] No container was found matching "kindnet"
I0826 12:03:45.519358 148739 logs.go:123] Gathering logs for dmesg ...
I0826 12:03:45.519375 148739 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0826 12:03:45.546613 148739 logs.go:123] Gathering logs for describe nodes ...
I0826 12:03:45.546663 148739 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0826 12:03:45.729116 148739 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0826 12:03:45.729148 148739 logs.go:123] Gathering logs for CRI-O ...
I0826 12:03:45.729165 148739 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0826 12:03:45.848703 148739 logs.go:123] Gathering logs for container status ...
I0826 12:03:45.848757 148739 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0826 12:03:45.897108 148739 logs.go:123] Gathering logs for kubelet ...
I0826 12:03:45.897148 148739 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0826 12:03:45.956262 148739 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0826 12:03:45.956383 148739 out.go:270] *
*
W0826 12:03:45.956446 148739 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0826 12:03:45.956461 148739 out.go:270] *
*
W0826 12:03:45.957246 148739 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0826 12:03:45.960244 148739 out.go:201]
W0826 12:03:45.961542 148739 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0826 12:03:45.961581 148739 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0826 12:03:45.961602 148739 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0826 12:03:45.963274 148739 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-839656 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-839656 -n old-k8s-version-839656
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-839656 -n old-k8s-version-839656: exit status 6 (245.266688ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0826 12:03:46.262294 151878 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-839656" does not appear in /home/jenkins/minikube-integration/19501-99403/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-839656" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (292.14s)