=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-843298 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-843298 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m49.356824719s)
-- stdout --
* [old-k8s-version-843298] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19576
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19576-6021/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19576-6021/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-843298" primary control-plane node in "old-k8s-version-843298" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0906 19:54:28.076404 65729 out.go:345] Setting OutFile to fd 1 ...
I0906 19:54:28.076559 65729 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0906 19:54:28.076576 65729 out.go:358] Setting ErrFile to fd 2...
I0906 19:54:28.076584 65729 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0906 19:54:28.076899 65729 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19576-6021/.minikube/bin
I0906 19:54:28.077680 65729 out.go:352] Setting JSON to false
I0906 19:54:28.079143 65729 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":5817,"bootTime":1725646651,"procs":304,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1067-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0906 19:54:28.079234 65729 start.go:139] virtualization: kvm guest
I0906 19:54:28.081346 65729 out.go:177] * [old-k8s-version-843298] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I0906 19:54:28.082886 65729 notify.go:220] Checking for updates...
I0906 19:54:28.083523 65729 out.go:177] - MINIKUBE_LOCATION=19576
I0906 19:54:28.084922 65729 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0906 19:54:28.086065 65729 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19576-6021/kubeconfig
I0906 19:54:28.087606 65729 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19576-6021/.minikube
I0906 19:54:28.090834 65729 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0906 19:54:28.092262 65729 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0906 19:54:28.094418 65729 config.go:182] Loaded profile config "bridge-603826": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0906 19:54:28.094563 65729 config.go:182] Loaded profile config "enable-default-cni-603826": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0906 19:54:28.094695 65729 config.go:182] Loaded profile config "flannel-603826": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.0
I0906 19:54:28.094819 65729 driver.go:394] Setting default libvirt URI to qemu:///system
I0906 19:54:28.141936 65729 out.go:177] * Using the kvm2 driver based on user configuration
I0906 19:54:28.146036 65729 start.go:297] selected driver: kvm2
I0906 19:54:28.146066 65729 start.go:901] validating driver "kvm2" against <nil>
I0906 19:54:28.146079 65729 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0906 19:54:28.146838 65729 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0906 19:54:28.146917 65729 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19576-6021/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0906 19:54:28.166768 65729 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0
I0906 19:54:28.166827 65729 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0906 19:54:28.167127 65729 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0906 19:54:28.167217 65729 cni.go:84] Creating CNI manager for ""
I0906 19:54:28.167244 65729 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0906 19:54:28.167258 65729 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0906 19:54:28.167328 65729 start.go:340] cluster config:
{Name:old-k8s-version-843298 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-843298 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0906 19:54:28.167478 65729 iso.go:125] acquiring lock: {Name:mk1321fa8899c9f525734390a9e3f83f593ffe5e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0906 19:54:28.169143 65729 out.go:177] * Starting "old-k8s-version-843298" primary control-plane node in "old-k8s-version-843298" cluster
I0906 19:54:28.170181 65729 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0906 19:54:28.170234 65729 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19576-6021/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0906 19:54:28.170245 65729 cache.go:56] Caching tarball of preloaded images
I0906 19:54:28.170366 65729 preload.go:172] Found /home/jenkins/minikube-integration/19576-6021/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0906 19:54:28.170383 65729 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0906 19:54:28.170526 65729 profile.go:143] Saving config to /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/config.json ...
I0906 19:54:28.170556 65729 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/config.json: {Name:mk2da3f8e8571ee4b6aefae1c2fec3d1e193d0cc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 19:54:28.170768 65729 start.go:360] acquireMachinesLock for old-k8s-version-843298: {Name:mke525adc748d173f02ea523120da3d310b4505f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0906 19:54:43.902171 65729 start.go:364] duration metric: took 15.731372839s to acquireMachinesLock for "old-k8s-version-843298"
I0906 19:54:43.902239 65729 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-843298 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-843298 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0906 19:54:43.902369 65729 start.go:125] createHost starting for "" (driver="kvm2")
I0906 19:54:43.904259 65729 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0906 19:54:43.904465 65729 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0906 19:54:43.904520 65729 main.go:141] libmachine: Launching plugin server for driver kvm2
I0906 19:54:43.926453 65729 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43191
I0906 19:54:43.927068 65729 main.go:141] libmachine: () Calling .GetVersion
I0906 19:54:43.927854 65729 main.go:141] libmachine: Using API Version 1
I0906 19:54:43.927890 65729 main.go:141] libmachine: () Calling .SetConfigRaw
I0906 19:54:43.928350 65729 main.go:141] libmachine: () Calling .GetMachineName
I0906 19:54:43.928654 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetMachineName
I0906 19:54:43.928926 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .DriverName
I0906 19:54:43.929186 65729 start.go:159] libmachine.API.Create for "old-k8s-version-843298" (driver="kvm2")
I0906 19:54:43.929221 65729 client.go:168] LocalClient.Create starting
I0906 19:54:43.929256 65729 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19576-6021/.minikube/certs/ca.pem
I0906 19:54:43.929293 65729 main.go:141] libmachine: Decoding PEM data...
I0906 19:54:43.929332 65729 main.go:141] libmachine: Parsing certificate...
I0906 19:54:43.929408 65729 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19576-6021/.minikube/certs/cert.pem
I0906 19:54:43.929449 65729 main.go:141] libmachine: Decoding PEM data...
I0906 19:54:43.929462 65729 main.go:141] libmachine: Parsing certificate...
I0906 19:54:43.929492 65729 main.go:141] libmachine: Running pre-create checks...
I0906 19:54:43.929512 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .PreCreateCheck
I0906 19:54:43.930010 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetConfigRaw
I0906 19:54:43.930537 65729 main.go:141] libmachine: Creating machine...
I0906 19:54:43.930554 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .Create
I0906 19:54:43.931204 65729 main.go:141] libmachine: (old-k8s-version-843298) Creating KVM machine...
I0906 19:54:43.932206 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found existing default KVM network
I0906 19:54:43.937745 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:43.933828 66260 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:c9:0c:ac} reservation:<nil>}
I0906 19:54:43.937776 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:43.935216 66260 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:53:7b:4e} reservation:<nil>}
I0906 19:54:43.937812 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:43.936165 66260 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:f5:76:c9} reservation:<nil>}
I0906 19:54:43.937832 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:43.937549 66260 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002f9160}
I0906 19:54:43.937846 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | created network xml:
I0906 19:54:43.937854 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | <network>
I0906 19:54:43.937865 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | <name>mk-old-k8s-version-843298</name>
I0906 19:54:43.937873 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | <dns enable='no'/>
I0906 19:54:43.937882 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG |
I0906 19:54:43.937891 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0906 19:54:43.937900 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | <dhcp>
I0906 19:54:43.937909 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0906 19:54:43.937924 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | </dhcp>
I0906 19:54:43.937932 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | </ip>
I0906 19:54:43.937941 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG |
I0906 19:54:43.937948 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | </network>
I0906 19:54:43.937958 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG |
I0906 19:54:43.945423 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | trying to create private KVM network mk-old-k8s-version-843298 192.168.72.0/24...
I0906 19:54:44.036559 65729 main.go:141] libmachine: (old-k8s-version-843298) Setting up store path in /home/jenkins/minikube-integration/19576-6021/.minikube/machines/old-k8s-version-843298 ...
I0906 19:54:44.036590 65729 main.go:141] libmachine: (old-k8s-version-843298) Building disk image from file:///home/jenkins/minikube-integration/19576-6021/.minikube/cache/iso/amd64/minikube-v1.34.0-amd64.iso
I0906 19:54:44.036629 65729 main.go:141] libmachine: (old-k8s-version-843298) Downloading /home/jenkins/minikube-integration/19576-6021/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19576-6021/.minikube/cache/iso/amd64/minikube-v1.34.0-amd64.iso...
I0906 19:54:44.036648 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | private KVM network mk-old-k8s-version-843298 192.168.72.0/24 created
I0906 19:54:44.036673 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:44.033673 66260 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19576-6021/.minikube
I0906 19:54:44.328523 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:44.328400 66260 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19576-6021/.minikube/machines/old-k8s-version-843298/id_rsa...
I0906 19:54:44.542007 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:44.541897 66260 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19576-6021/.minikube/machines/old-k8s-version-843298/old-k8s-version-843298.rawdisk...
I0906 19:54:44.542034 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Writing magic tar header
I0906 19:54:44.542057 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Writing SSH key tar header
I0906 19:54:44.542077 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:44.542046 66260 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19576-6021/.minikube/machines/old-k8s-version-843298 ...
I0906 19:54:44.542188 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19576-6021/.minikube/machines/old-k8s-version-843298
I0906 19:54:44.542220 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19576-6021/.minikube/machines
I0906 19:54:44.542243 65729 main.go:141] libmachine: (old-k8s-version-843298) Setting executable bit set on /home/jenkins/minikube-integration/19576-6021/.minikube/machines/old-k8s-version-843298 (perms=drwx------)
I0906 19:54:44.542257 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19576-6021/.minikube
I0906 19:54:44.542283 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19576-6021
I0906 19:54:44.542297 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0906 19:54:44.542312 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Checking permissions on dir: /home/jenkins
I0906 19:54:44.542322 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Checking permissions on dir: /home
I0906 19:54:44.542333 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Skipping /home - not owner
I0906 19:54:44.542347 65729 main.go:141] libmachine: (old-k8s-version-843298) Setting executable bit set on /home/jenkins/minikube-integration/19576-6021/.minikube/machines (perms=drwxr-xr-x)
I0906 19:54:44.542362 65729 main.go:141] libmachine: (old-k8s-version-843298) Setting executable bit set on /home/jenkins/minikube-integration/19576-6021/.minikube (perms=drwxr-xr-x)
I0906 19:54:44.542373 65729 main.go:141] libmachine: (old-k8s-version-843298) Setting executable bit set on /home/jenkins/minikube-integration/19576-6021 (perms=drwxrwxr-x)
I0906 19:54:44.542385 65729 main.go:141] libmachine: (old-k8s-version-843298) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0906 19:54:44.542397 65729 main.go:141] libmachine: (old-k8s-version-843298) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0906 19:54:44.542411 65729 main.go:141] libmachine: (old-k8s-version-843298) Creating domain...
I0906 19:54:44.543342 65729 main.go:141] libmachine: (old-k8s-version-843298) define libvirt domain using xml:
I0906 19:54:44.543367 65729 main.go:141] libmachine: (old-k8s-version-843298) <domain type='kvm'>
I0906 19:54:44.543379 65729 main.go:141] libmachine: (old-k8s-version-843298) <name>old-k8s-version-843298</name>
I0906 19:54:44.543387 65729 main.go:141] libmachine: (old-k8s-version-843298) <memory unit='MiB'>2200</memory>
I0906 19:54:44.543396 65729 main.go:141] libmachine: (old-k8s-version-843298) <vcpu>2</vcpu>
I0906 19:54:44.543404 65729 main.go:141] libmachine: (old-k8s-version-843298) <features>
I0906 19:54:44.543420 65729 main.go:141] libmachine: (old-k8s-version-843298) <acpi/>
I0906 19:54:44.543427 65729 main.go:141] libmachine: (old-k8s-version-843298) <apic/>
I0906 19:54:44.543435 65729 main.go:141] libmachine: (old-k8s-version-843298) <pae/>
I0906 19:54:44.543446 65729 main.go:141] libmachine: (old-k8s-version-843298)
I0906 19:54:44.543455 65729 main.go:141] libmachine: (old-k8s-version-843298) </features>
I0906 19:54:44.543463 65729 main.go:141] libmachine: (old-k8s-version-843298) <cpu mode='host-passthrough'>
I0906 19:54:44.543471 65729 main.go:141] libmachine: (old-k8s-version-843298)
I0906 19:54:44.543477 65729 main.go:141] libmachine: (old-k8s-version-843298) </cpu>
I0906 19:54:44.543485 65729 main.go:141] libmachine: (old-k8s-version-843298) <os>
I0906 19:54:44.543493 65729 main.go:141] libmachine: (old-k8s-version-843298) <type>hvm</type>
I0906 19:54:44.543502 65729 main.go:141] libmachine: (old-k8s-version-843298) <boot dev='cdrom'/>
I0906 19:54:44.543511 65729 main.go:141] libmachine: (old-k8s-version-843298) <boot dev='hd'/>
I0906 19:54:44.543535 65729 main.go:141] libmachine: (old-k8s-version-843298) <bootmenu enable='no'/>
I0906 19:54:44.543549 65729 main.go:141] libmachine: (old-k8s-version-843298) </os>
I0906 19:54:44.543567 65729 main.go:141] libmachine: (old-k8s-version-843298) <devices>
I0906 19:54:44.543577 65729 main.go:141] libmachine: (old-k8s-version-843298) <disk type='file' device='cdrom'>
I0906 19:54:44.543590 65729 main.go:141] libmachine: (old-k8s-version-843298) <source file='/home/jenkins/minikube-integration/19576-6021/.minikube/machines/old-k8s-version-843298/boot2docker.iso'/>
I0906 19:54:44.543603 65729 main.go:141] libmachine: (old-k8s-version-843298) <target dev='hdc' bus='scsi'/>
I0906 19:54:44.543622 65729 main.go:141] libmachine: (old-k8s-version-843298) <readonly/>
I0906 19:54:44.543633 65729 main.go:141] libmachine: (old-k8s-version-843298) </disk>
I0906 19:54:44.543643 65729 main.go:141] libmachine: (old-k8s-version-843298) <disk type='file' device='disk'>
I0906 19:54:44.543653 65729 main.go:141] libmachine: (old-k8s-version-843298) <driver name='qemu' type='raw' cache='default' io='threads' />
I0906 19:54:44.543669 65729 main.go:141] libmachine: (old-k8s-version-843298) <source file='/home/jenkins/minikube-integration/19576-6021/.minikube/machines/old-k8s-version-843298/old-k8s-version-843298.rawdisk'/>
I0906 19:54:44.543677 65729 main.go:141] libmachine: (old-k8s-version-843298) <target dev='hda' bus='virtio'/>
I0906 19:54:44.543685 65729 main.go:141] libmachine: (old-k8s-version-843298) </disk>
I0906 19:54:44.543692 65729 main.go:141] libmachine: (old-k8s-version-843298) <interface type='network'>
I0906 19:54:44.543702 65729 main.go:141] libmachine: (old-k8s-version-843298) <source network='mk-old-k8s-version-843298'/>
I0906 19:54:44.543710 65729 main.go:141] libmachine: (old-k8s-version-843298) <model type='virtio'/>
I0906 19:54:44.543722 65729 main.go:141] libmachine: (old-k8s-version-843298) </interface>
I0906 19:54:44.543730 65729 main.go:141] libmachine: (old-k8s-version-843298) <interface type='network'>
I0906 19:54:44.543740 65729 main.go:141] libmachine: (old-k8s-version-843298) <source network='default'/>
I0906 19:54:44.543747 65729 main.go:141] libmachine: (old-k8s-version-843298) <model type='virtio'/>
I0906 19:54:44.543755 65729 main.go:141] libmachine: (old-k8s-version-843298) </interface>
I0906 19:54:44.543762 65729 main.go:141] libmachine: (old-k8s-version-843298) <serial type='pty'>
I0906 19:54:44.543770 65729 main.go:141] libmachine: (old-k8s-version-843298) <target port='0'/>
I0906 19:54:44.543776 65729 main.go:141] libmachine: (old-k8s-version-843298) </serial>
I0906 19:54:44.543784 65729 main.go:141] libmachine: (old-k8s-version-843298) <console type='pty'>
I0906 19:54:44.543793 65729 main.go:141] libmachine: (old-k8s-version-843298) <target type='serial' port='0'/>
I0906 19:54:44.543800 65729 main.go:141] libmachine: (old-k8s-version-843298) </console>
I0906 19:54:44.543807 65729 main.go:141] libmachine: (old-k8s-version-843298) <rng model='virtio'>
I0906 19:54:44.543817 65729 main.go:141] libmachine: (old-k8s-version-843298) <backend model='random'>/dev/random</backend>
I0906 19:54:44.543825 65729 main.go:141] libmachine: (old-k8s-version-843298) </rng>
I0906 19:54:44.543833 65729 main.go:141] libmachine: (old-k8s-version-843298)
I0906 19:54:44.543839 65729 main.go:141] libmachine: (old-k8s-version-843298)
I0906 19:54:44.543847 65729 main.go:141] libmachine: (old-k8s-version-843298) </devices>
I0906 19:54:44.543854 65729 main.go:141] libmachine: (old-k8s-version-843298) </domain>
I0906 19:54:44.543865 65729 main.go:141] libmachine: (old-k8s-version-843298)
I0906 19:54:44.548288 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:d1:3c:92 in network default
I0906 19:54:44.548912 65729 main.go:141] libmachine: (old-k8s-version-843298) Ensuring networks are active...
I0906 19:54:44.548933 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:54:44.549584 65729 main.go:141] libmachine: (old-k8s-version-843298) Ensuring network default is active
I0906 19:54:44.549987 65729 main.go:141] libmachine: (old-k8s-version-843298) Ensuring network mk-old-k8s-version-843298 is active
I0906 19:54:44.550819 65729 main.go:141] libmachine: (old-k8s-version-843298) Getting domain xml...
I0906 19:54:44.552922 65729 main.go:141] libmachine: (old-k8s-version-843298) Creating domain...
I0906 19:54:46.133597 65729 main.go:141] libmachine: (old-k8s-version-843298) Waiting to get IP...
I0906 19:54:46.134537 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:54:46.135082 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find current IP address of domain old-k8s-version-843298 in network mk-old-k8s-version-843298
I0906 19:54:46.135115 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:46.135058 66260 retry.go:31] will retry after 250.223405ms: waiting for machine to come up
I0906 19:54:46.386821 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:54:46.387440 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find current IP address of domain old-k8s-version-843298 in network mk-old-k8s-version-843298
I0906 19:54:46.387472 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:46.387355 66260 retry.go:31] will retry after 245.474985ms: waiting for machine to come up
I0906 19:54:46.635150 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:54:46.635751 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find current IP address of domain old-k8s-version-843298 in network mk-old-k8s-version-843298
I0906 19:54:46.635779 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:46.635703 66260 retry.go:31] will retry after 328.165713ms: waiting for machine to come up
I0906 19:54:46.965772 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:54:46.966128 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find current IP address of domain old-k8s-version-843298 in network mk-old-k8s-version-843298
I0906 19:54:46.966145 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:46.966053 66260 retry.go:31] will retry after 526.384709ms: waiting for machine to come up
I0906 19:54:47.494004 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:54:47.494615 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find current IP address of domain old-k8s-version-843298 in network mk-old-k8s-version-843298
I0906 19:54:47.494646 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:47.494572 66260 retry.go:31] will retry after 594.927459ms: waiting for machine to come up
I0906 19:54:48.091188 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:54:48.091752 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find current IP address of domain old-k8s-version-843298 in network mk-old-k8s-version-843298
I0906 19:54:48.091779 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:48.091727 66260 retry.go:31] will retry after 819.364786ms: waiting for machine to come up
I0906 19:54:48.912592 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:54:48.913109 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find current IP address of domain old-k8s-version-843298 in network mk-old-k8s-version-843298
I0906 19:54:48.913138 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:48.913042 66260 retry.go:31] will retry after 902.011192ms: waiting for machine to come up
I0906 19:54:49.816998 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:54:49.817602 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find current IP address of domain old-k8s-version-843298 in network mk-old-k8s-version-843298
I0906 19:54:49.817630 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:49.817564 66260 retry.go:31] will retry after 946.978217ms: waiting for machine to come up
I0906 19:54:50.765646 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:54:50.766251 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find current IP address of domain old-k8s-version-843298 in network mk-old-k8s-version-843298
I0906 19:54:50.766293 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:50.766188 66260 retry.go:31] will retry after 1.187186144s: waiting for machine to come up
I0906 19:54:52.560553 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:54:52.561611 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find current IP address of domain old-k8s-version-843298 in network mk-old-k8s-version-843298
I0906 19:54:52.561638 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:52.561572 66260 retry.go:31] will retry after 2.157865222s: waiting for machine to come up
I0906 19:54:54.721307 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:54:54.721844 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find current IP address of domain old-k8s-version-843298 in network mk-old-k8s-version-843298
I0906 19:54:54.721871 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:54.721756 66260 retry.go:31] will retry after 2.3832993s: waiting for machine to come up
I0906 19:54:57.106620 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:54:57.107229 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find current IP address of domain old-k8s-version-843298 in network mk-old-k8s-version-843298
I0906 19:54:57.107265 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:54:57.107186 66260 retry.go:31] will retry after 3.123797287s: waiting for machine to come up
I0906 19:55:00.232656 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:00.233223 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find current IP address of domain old-k8s-version-843298 in network mk-old-k8s-version-843298
I0906 19:55:00.233254 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:55:00.233187 66260 retry.go:31] will retry after 2.836771705s: waiting for machine to come up
I0906 19:55:03.073183 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:03.073726 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find current IP address of domain old-k8s-version-843298 in network mk-old-k8s-version-843298
I0906 19:55:03.073749 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | I0906 19:55:03.073687 66260 retry.go:31] will retry after 3.776190846s: waiting for machine to come up
I0906 19:55:06.853335 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:06.853895 65729 main.go:141] libmachine: (old-k8s-version-843298) Found IP for machine: 192.168.72.30
I0906 19:55:06.853928 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has current primary IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:06.853937 65729 main.go:141] libmachine: (old-k8s-version-843298) Reserving static IP address...
I0906 19:55:06.854221 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-843298", mac: "52:54:00:35:91:5e", ip: "192.168.72.30"} in network mk-old-k8s-version-843298
I0906 19:55:06.936500 65729 main.go:141] libmachine: (old-k8s-version-843298) Reserved static IP address: 192.168.72.30
I0906 19:55:06.936533 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Getting to WaitForSSH function...
I0906 19:55:06.936542 65729 main.go:141] libmachine: (old-k8s-version-843298) Waiting for SSH to be available...
I0906 19:55:06.939920 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:06.940301 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298
I0906 19:55:06.940329 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | unable to find defined IP address of network mk-old-k8s-version-843298 interface with MAC address 52:54:00:35:91:5e
I0906 19:55:06.940560 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Using SSH client type: external
I0906 19:55:06.940584 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Using SSH private key: /home/jenkins/minikube-integration/19576-6021/.minikube/machines/old-k8s-version-843298/id_rsa (-rw-------)
I0906 19:55:06.940627 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19576-6021/.minikube/machines/old-k8s-version-843298/id_rsa -p 22] /usr/bin/ssh <nil>}
I0906 19:55:06.940641 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | About to run SSH command:
I0906 19:55:06.940659 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | exit 0
I0906 19:55:06.946432 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | SSH cmd err, output: exit status 255:
I0906 19:55:06.946459 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0906 19:55:06.946470 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | command : exit 0
I0906 19:55:06.946484 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | err : exit status 255
I0906 19:55:06.946497 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | output :
I0906 19:55:09.946688 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Getting to WaitForSSH function...
I0906 19:55:09.949427 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:09.949924 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:09.949958 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:09.950030 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Using SSH client type: external
I0906 19:55:09.950058 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Using SSH private key: /home/jenkins/minikube-integration/19576-6021/.minikube/machines/old-k8s-version-843298/id_rsa (-rw-------)
I0906 19:55:09.950085 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.30 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19576-6021/.minikube/machines/old-k8s-version-843298/id_rsa -p 22] /usr/bin/ssh <nil>}
I0906 19:55:09.950117 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | About to run SSH command:
I0906 19:55:09.950132 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | exit 0
I0906 19:55:10.078073 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | SSH cmd err, output: <nil>:
I0906 19:55:10.078302 65729 main.go:141] libmachine: (old-k8s-version-843298) KVM machine creation complete!
I0906 19:55:10.078700 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetConfigRaw
I0906 19:55:10.079277 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .DriverName
I0906 19:55:10.079514 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .DriverName
I0906 19:55:10.079695 65729 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0906 19:55:10.079708 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetState
I0906 19:55:10.081175 65729 main.go:141] libmachine: Detecting operating system of created instance...
I0906 19:55:10.081192 65729 main.go:141] libmachine: Waiting for SSH to be available...
I0906 19:55:10.081200 65729 main.go:141] libmachine: Getting to WaitForSSH function...
I0906 19:55:10.081209 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHHostname
I0906 19:55:10.083780 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:10.084205 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:10.084235 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:10.084383 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHPort
I0906 19:55:10.084564 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHKeyPath
I0906 19:55:10.084877 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHKeyPath
I0906 19:55:10.085096 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHUsername
I0906 19:55:10.085283 65729 main.go:141] libmachine: Using SSH client type: native
I0906 19:55:10.085465 65729 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.30 22 <nil> <nil>}
I0906 19:55:10.085476 65729 main.go:141] libmachine: About to run SSH command:
exit 0
I0906 19:55:10.192463 65729 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0906 19:55:10.192489 65729 main.go:141] libmachine: Detecting the provisioner...
I0906 19:55:10.192497 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHHostname
I0906 19:55:10.195263 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:10.195557 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:10.195583 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:10.195782 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHPort
I0906 19:55:10.195982 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHKeyPath
I0906 19:55:10.196109 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHKeyPath
I0906 19:55:10.196213 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHUsername
I0906 19:55:10.196313 65729 main.go:141] libmachine: Using SSH client type: native
I0906 19:55:10.196517 65729 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.30 22 <nil> <nil>}
I0906 19:55:10.196531 65729 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0906 19:55:10.301700 65729 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0906 19:55:10.301804 65729 main.go:141] libmachine: found compatible host: buildroot
I0906 19:55:10.301819 65729 main.go:141] libmachine: Provisioning with buildroot...
I0906 19:55:10.301835 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetMachineName
I0906 19:55:10.302108 65729 buildroot.go:166] provisioning hostname "old-k8s-version-843298"
I0906 19:55:10.302135 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetMachineName
I0906 19:55:10.302314 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHHostname
I0906 19:55:10.304775 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:10.305108 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:10.305137 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:10.305261 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHPort
I0906 19:55:10.305466 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHKeyPath
I0906 19:55:10.305629 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHKeyPath
I0906 19:55:10.305770 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHUsername
I0906 19:55:10.305967 65729 main.go:141] libmachine: Using SSH client type: native
I0906 19:55:10.306153 65729 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.30 22 <nil> <nil>}
I0906 19:55:10.306169 65729 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-843298 && echo "old-k8s-version-843298" | sudo tee /etc/hostname
I0906 19:55:10.426585 65729 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-843298
I0906 19:55:10.426612 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHHostname
I0906 19:55:10.429289 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:10.429629 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:10.429654 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:10.429919 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHPort
I0906 19:55:10.430116 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHKeyPath
I0906 19:55:10.430313 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHKeyPath
I0906 19:55:10.430472 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHUsername
I0906 19:55:10.430659 65729 main.go:141] libmachine: Using SSH client type: native
I0906 19:55:10.430859 65729 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.30 22 <nil> <nil>}
I0906 19:55:10.430885 65729 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-843298' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-843298/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-843298' | sudo tee -a /etc/hosts;
fi
fi
I0906 19:55:10.541580 65729 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0906 19:55:10.541607 65729 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19576-6021/.minikube CaCertPath:/home/jenkins/minikube-integration/19576-6021/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19576-6021/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19576-6021/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19576-6021/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19576-6021/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19576-6021/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19576-6021/.minikube}
I0906 19:55:10.541624 65729 buildroot.go:174] setting up certificates
I0906 19:55:10.541634 65729 provision.go:84] configureAuth start
I0906 19:55:10.541642 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetMachineName
I0906 19:55:10.541932 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetIP
I0906 19:55:10.544786 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:10.545163 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:10.545193 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:10.545471 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHHostname
I0906 19:55:10.547836 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:10.548141 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:10.548165 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:10.548334 65729 provision.go:143] copyHostCerts
I0906 19:55:10.548395 65729 exec_runner.go:144] found /home/jenkins/minikube-integration/19576-6021/.minikube/ca.pem, removing ...
I0906 19:55:10.548411 65729 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19576-6021/.minikube/ca.pem
I0906 19:55:10.548476 65729 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19576-6021/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19576-6021/.minikube/ca.pem (1078 bytes)
I0906 19:55:10.548601 65729 exec_runner.go:144] found /home/jenkins/minikube-integration/19576-6021/.minikube/cert.pem, removing ...
I0906 19:55:10.548621 65729 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19576-6021/.minikube/cert.pem
I0906 19:55:10.548646 65729 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19576-6021/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19576-6021/.minikube/cert.pem (1123 bytes)
I0906 19:55:10.548725 65729 exec_runner.go:144] found /home/jenkins/minikube-integration/19576-6021/.minikube/key.pem, removing ...
I0906 19:55:10.548733 65729 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19576-6021/.minikube/key.pem
I0906 19:55:10.548755 65729 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19576-6021/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19576-6021/.minikube/key.pem (1675 bytes)
I0906 19:55:10.548821 65729 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19576-6021/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19576-6021/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19576-6021/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-843298 san=[127.0.0.1 192.168.72.30 localhost minikube old-k8s-version-843298]
I0906 19:55:10.837290 65729 provision.go:177] copyRemoteCerts
I0906 19:55:10.837353 65729 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0906 19:55:10.837409 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHHostname
I0906 19:55:10.839998 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:10.840329 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:10.840359 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:10.840550 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHPort
I0906 19:55:10.840726 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHKeyPath
I0906 19:55:10.840871 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHUsername
I0906 19:55:10.841018 65729 sshutil.go:53] new ssh client: &{IP:192.168.72.30 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19576-6021/.minikube/machines/old-k8s-version-843298/id_rsa Username:docker}
I0906 19:55:10.924124 65729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-6021/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0906 19:55:10.949333 65729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-6021/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0906 19:55:10.973417 65729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-6021/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0906 19:55:10.999199 65729 provision.go:87] duration metric: took 457.554993ms to configureAuth
I0906 19:55:10.999226 65729 buildroot.go:189] setting minikube options for container-runtime
I0906 19:55:10.999380 65729 config.go:182] Loaded profile config "old-k8s-version-843298": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0906 19:55:10.999461 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHHostname
I0906 19:55:11.002025 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:11.002394 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:11.002425 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:11.002655 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHPort
I0906 19:55:11.002864 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHKeyPath
I0906 19:55:11.003038 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHKeyPath
I0906 19:55:11.003189 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHUsername
I0906 19:55:11.003333 65729 main.go:141] libmachine: Using SSH client type: native
I0906 19:55:11.003507 65729 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.30 22 <nil> <nil>}
I0906 19:55:11.003522 65729 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0906 19:55:11.232212 65729 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0906 19:55:11.232249 65729 main.go:141] libmachine: Checking connection to Docker...
I0906 19:55:11.232260 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetURL
I0906 19:55:11.233663 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | Using libvirt version 6000000
I0906 19:55:11.235817 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:11.236184 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:11.236220 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:11.236451 65729 main.go:141] libmachine: Docker is up and running!
I0906 19:55:11.236468 65729 main.go:141] libmachine: Reticulating splines...
I0906 19:55:11.236476 65729 client.go:171] duration metric: took 27.307246875s to LocalClient.Create
I0906 19:55:11.236502 65729 start.go:167] duration metric: took 27.307318248s to libmachine.API.Create "old-k8s-version-843298"
I0906 19:55:11.236512 65729 start.go:293] postStartSetup for "old-k8s-version-843298" (driver="kvm2")
I0906 19:55:11.236524 65729 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0906 19:55:11.236549 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .DriverName
I0906 19:55:11.236827 65729 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0906 19:55:11.236851 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHHostname
I0906 19:55:11.239102 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:11.239455 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:11.239486 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:11.239606 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHPort
I0906 19:55:11.239800 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHKeyPath
I0906 19:55:11.239961 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHUsername
I0906 19:55:11.240105 65729 sshutil.go:53] new ssh client: &{IP:192.168.72.30 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19576-6021/.minikube/machines/old-k8s-version-843298/id_rsa Username:docker}
I0906 19:55:11.328138 65729 ssh_runner.go:195] Run: cat /etc/os-release
I0906 19:55:11.332524 65729 info.go:137] Remote host: Buildroot 2023.02.9
I0906 19:55:11.332557 65729 filesync.go:126] Scanning /home/jenkins/minikube-integration/19576-6021/.minikube/addons for local assets ...
I0906 19:55:11.332626 65729 filesync.go:126] Scanning /home/jenkins/minikube-integration/19576-6021/.minikube/files for local assets ...
I0906 19:55:11.332724 65729 filesync.go:149] local asset: /home/jenkins/minikube-integration/19576-6021/.minikube/files/etc/ssl/certs/131782.pem -> 131782.pem in /etc/ssl/certs
I0906 19:55:11.332843 65729 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0906 19:55:11.345570 65729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-6021/.minikube/files/etc/ssl/certs/131782.pem --> /etc/ssl/certs/131782.pem (1708 bytes)
I0906 19:55:11.372222 65729 start.go:296] duration metric: took 135.696548ms for postStartSetup
I0906 19:55:11.372293 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetConfigRaw
I0906 19:55:11.372971 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetIP
I0906 19:55:11.375606 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:11.375990 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:11.376019 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:11.376315 65729 profile.go:143] Saving config to /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/config.json ...
I0906 19:55:11.376575 65729 start.go:128] duration metric: took 27.47419227s to createHost
I0906 19:55:11.376600 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHHostname
I0906 19:55:11.378871 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:11.379222 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:11.379251 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:11.379411 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHPort
I0906 19:55:11.379589 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHKeyPath
I0906 19:55:11.379724 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHKeyPath
I0906 19:55:11.379856 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHUsername
I0906 19:55:11.379987 65729 main.go:141] libmachine: Using SSH client type: native
I0906 19:55:11.380175 65729 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82f9c0] 0x832720 <nil> [] 0s} 192.168.72.30 22 <nil> <nil>}
I0906 19:55:11.380187 65729 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0906 19:55:11.481688 65729 main.go:141] libmachine: SSH cmd err, output: <nil>: 1725652511.456992887
I0906 19:55:11.481715 65729 fix.go:216] guest clock: 1725652511.456992887
I0906 19:55:11.481727 65729 fix.go:229] Guest: 2024-09-06 19:55:11.456992887 +0000 UTC Remote: 2024-09-06 19:55:11.376588149 +0000 UTC m=+43.348787073 (delta=80.404738ms)
I0906 19:55:11.481756 65729 fix.go:200] guest clock delta is within tolerance: 80.404738ms
I0906 19:55:11.481763 65729 start.go:83] releasing machines lock for "old-k8s-version-843298", held for 27.57955527s
I0906 19:55:11.481803 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .DriverName
I0906 19:55:11.482114 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetIP
I0906 19:55:11.485040 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:11.485374 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:11.485418 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:11.485526 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .DriverName
I0906 19:55:11.486008 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .DriverName
I0906 19:55:11.486190 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .DriverName
I0906 19:55:11.486287 65729 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0906 19:55:11.486329 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHHostname
I0906 19:55:11.486419 65729 ssh_runner.go:195] Run: cat /version.json
I0906 19:55:11.486445 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHHostname
I0906 19:55:11.489194 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:11.489430 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:11.489589 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:11.489617 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:11.489771 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHPort
I0906 19:55:11.489852 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:11.489878 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:11.489959 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHKeyPath
I0906 19:55:11.490071 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHPort
I0906 19:55:11.490130 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHUsername
I0906 19:55:11.490215 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHKeyPath
I0906 19:55:11.490289 65729 sshutil.go:53] new ssh client: &{IP:192.168.72.30 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19576-6021/.minikube/machines/old-k8s-version-843298/id_rsa Username:docker}
I0906 19:55:11.490376 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetSSHUsername
I0906 19:55:11.490508 65729 sshutil.go:53] new ssh client: &{IP:192.168.72.30 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19576-6021/.minikube/machines/old-k8s-version-843298/id_rsa Username:docker}
I0906 19:55:11.588992 65729 ssh_runner.go:195] Run: systemctl --version
I0906 19:55:11.598226 65729 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0906 19:55:11.765044 65729 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0906 19:55:11.771602 65729 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0906 19:55:11.771676 65729 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0906 19:55:11.789865 65729 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0906 19:55:11.789894 65729 start.go:495] detecting cgroup driver to use...
I0906 19:55:11.789958 65729 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0906 19:55:11.813177 65729 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0906 19:55:11.828257 65729 docker.go:217] disabling cri-docker service (if available) ...
I0906 19:55:11.828326 65729 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0906 19:55:11.842582 65729 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0906 19:55:11.857099 65729 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0906 19:55:11.974670 65729 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0906 19:55:12.140449 65729 docker.go:233] disabling docker service ...
I0906 19:55:12.140526 65729 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0906 19:55:12.155562 65729 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0906 19:55:12.168678 65729 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0906 19:55:12.304121 65729 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0906 19:55:12.437664 65729 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0906 19:55:12.456690 65729 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0906 19:55:12.475802 65729 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0906 19:55:12.475859 65729 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0906 19:55:12.489344 65729 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0906 19:55:12.489404 65729 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0906 19:55:12.500918 65729 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0906 19:55:12.512554 65729 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0906 19:55:12.523800 65729 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0906 19:55:12.534965 65729 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0906 19:55:12.545126 65729 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0906 19:55:12.545185 65729 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0906 19:55:12.561932 65729 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0906 19:55:12.571818 65729 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0906 19:55:12.694676 65729 ssh_runner.go:195] Run: sudo systemctl restart crio
I0906 19:55:12.795451 65729 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0906 19:55:12.795525 65729 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0906 19:55:12.800344 65729 start.go:563] Will wait 60s for crictl version
I0906 19:55:12.800401 65729 ssh_runner.go:195] Run: which crictl
I0906 19:55:12.804646 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0906 19:55:12.853474 65729 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0906 19:55:12.853567 65729 ssh_runner.go:195] Run: crio --version
I0906 19:55:12.887717 65729 ssh_runner.go:195] Run: crio --version
I0906 19:55:12.927892 65729 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0906 19:55:12.929083 65729 main.go:141] libmachine: (old-k8s-version-843298) Calling .GetIP
I0906 19:55:12.932193 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:12.932593 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:35:91:5e", ip: ""} in network mk-old-k8s-version-843298: {Iface:virbr4 ExpiryTime:2024-09-06 20:55:00 +0000 UTC Type:0 Mac:52:54:00:35:91:5e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-843298 Clientid:01:52:54:00:35:91:5e}
I0906 19:55:12.932631 65729 main.go:141] libmachine: (old-k8s-version-843298) DBG | domain old-k8s-version-843298 has defined IP address 192.168.72.30 and MAC address 52:54:00:35:91:5e in network mk-old-k8s-version-843298
I0906 19:55:12.932941 65729 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0906 19:55:12.937312 65729 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0906 19:55:12.949967 65729 kubeadm.go:883] updating cluster {Name:old-k8s-version-843298 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-843298 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.30 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: D
isableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0906 19:55:12.950073 65729 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0906 19:55:12.950126 65729 ssh_runner.go:195] Run: sudo crictl images --output json
I0906 19:55:12.983594 65729 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0906 19:55:12.983667 65729 ssh_runner.go:195] Run: which lz4
I0906 19:55:12.987657 65729 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0906 19:55:12.991806 65729 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0906 19:55:12.991838 65729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-6021/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0906 19:55:14.758376 65729 crio.go:462] duration metric: took 1.770757183s to copy over tarball
I0906 19:55:14.758471 65729 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0906 19:55:17.544178 65729 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.785674201s)
I0906 19:55:17.544207 65729 crio.go:469] duration metric: took 2.785788205s to extract the tarball
I0906 19:55:17.544216 65729 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0906 19:55:17.599711 65729 ssh_runner.go:195] Run: sudo crictl images --output json
I0906 19:55:17.676299 65729 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0906 19:55:17.676326 65729 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0906 19:55:17.676448 65729 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0906 19:55:17.676484 65729 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0906 19:55:17.676493 65729 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0906 19:55:17.676485 65729 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0906 19:55:17.676500 65729 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0906 19:55:17.676420 65729 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0906 19:55:17.676461 65729 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0906 19:55:17.676429 65729 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0906 19:55:17.678266 65729 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0906 19:55:17.678284 65729 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0906 19:55:17.678299 65729 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0906 19:55:17.678268 65729 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0906 19:55:17.678268 65729 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0906 19:55:17.678346 65729 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0906 19:55:17.678359 65729 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0906 19:55:17.678371 65729 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0906 19:55:17.841942 65729 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0906 19:55:17.845591 65729 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0906 19:55:17.858687 65729 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0906 19:55:17.871916 65729 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0906 19:55:17.880491 65729 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0906 19:55:17.891908 65729 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0906 19:55:17.920721 65729 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0906 19:55:17.925277 65729 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0906 19:55:17.925334 65729 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0906 19:55:17.925378 65729 ssh_runner.go:195] Run: which crictl
I0906 19:55:17.967117 65729 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0906 19:55:17.967159 65729 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0906 19:55:17.967222 65729 ssh_runner.go:195] Run: which crictl
I0906 19:55:18.032733 65729 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0906 19:55:18.032778 65729 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0906 19:55:18.032785 65729 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0906 19:55:18.032814 65729 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0906 19:55:18.032828 65729 ssh_runner.go:195] Run: which crictl
I0906 19:55:18.032870 65729 ssh_runner.go:195] Run: which crictl
I0906 19:55:18.035075 65729 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0906 19:55:18.035113 65729 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0906 19:55:18.035147 65729 ssh_runner.go:195] Run: which crictl
I0906 19:55:18.055002 65729 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0906 19:55:18.055051 65729 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0906 19:55:18.055112 65729 ssh_runner.go:195] Run: which crictl
I0906 19:55:18.072190 65729 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0906 19:55:18.072240 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0906 19:55:18.072243 65729 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0906 19:55:18.072249 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0906 19:55:18.072272 65729 ssh_runner.go:195] Run: which crictl
I0906 19:55:18.072289 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0906 19:55:18.072335 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0906 19:55:18.072303 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0906 19:55:18.072355 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0906 19:55:18.233974 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0906 19:55:18.234062 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0906 19:55:18.234113 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0906 19:55:18.234069 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0906 19:55:18.234135 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0906 19:55:18.234273 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0906 19:55:18.368287 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0906 19:55:18.368371 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0906 19:55:18.368452 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0906 19:55:18.368614 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0906 19:55:18.439301 65729 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0906 19:55:18.470629 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0906 19:55:18.470695 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0906 19:55:18.470813 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0906 19:55:18.470918 65729 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19576-6021/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0906 19:55:18.470976 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0906 19:55:18.470982 65729 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19576-6021/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0906 19:55:18.471105 65729 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19576-6021/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0906 19:55:18.671597 65729 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19576-6021/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0906 19:55:18.671669 65729 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0906 19:55:18.671689 65729 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19576-6021/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0906 19:55:18.671723 65729 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19576-6021/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0906 19:55:18.707580 65729 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19576-6021/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0906 19:55:18.707649 65729 cache_images.go:92] duration metric: took 1.031298352s to LoadCachedImages
W0906 19:55:18.707740 65729 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19576-6021/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19576-6021/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0: no such file or directory
I0906 19:55:18.707754 65729 kubeadm.go:934] updating node { 192.168.72.30 8443 v1.20.0 crio true true} ...
I0906 19:55:18.707856 65729 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-843298 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.30
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-843298 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0906 19:55:18.707932 65729 ssh_runner.go:195] Run: crio config
I0906 19:55:18.756142 65729 cni.go:84] Creating CNI manager for ""
I0906 19:55:18.756169 65729 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0906 19:55:18.756191 65729 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0906 19:55:18.756214 65729 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.30 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-843298 NodeName:old-k8s-version-843298 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.30"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.30 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0906 19:55:18.756390 65729 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.30
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-843298"
kubeletExtraArgs:
node-ip: 192.168.72.30
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.30"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0906 19:55:18.756461 65729 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0906 19:55:18.767207 65729 binaries.go:44] Found k8s binaries, skipping transfer
I0906 19:55:18.767283 65729 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0906 19:55:18.778315 65729 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0906 19:55:18.797647 65729 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0906 19:55:18.814760 65729 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0906 19:55:18.833494 65729 ssh_runner.go:195] Run: grep 192.168.72.30 control-plane.minikube.internal$ /etc/hosts
I0906 19:55:18.838698 65729 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.30 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0906 19:55:18.855316 65729 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0906 19:55:19.026615 65729 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0906 19:55:19.045978 65729 certs.go:68] Setting up /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298 for IP: 192.168.72.30
I0906 19:55:19.046003 65729 certs.go:194] generating shared ca certs ...
I0906 19:55:19.046019 65729 certs.go:226] acquiring lock for ca certs: {Name:mk6bd4100cdfbb4ea45c551d4af12536314b056b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 19:55:19.046200 65729 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19576-6021/.minikube/ca.key
I0906 19:55:19.046267 65729 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19576-6021/.minikube/proxy-client-ca.key
I0906 19:55:19.046290 65729 certs.go:256] generating profile certs ...
I0906 19:55:19.046357 65729 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/client.key
I0906 19:55:19.046373 65729 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/client.crt with IP's: []
I0906 19:55:19.260018 65729 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/client.crt ...
I0906 19:55:19.260056 65729 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/client.crt: {Name:mke6dc4f712c7e5e8cd85e01995b611058c0d7c9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 19:55:19.260267 65729 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/client.key ...
I0906 19:55:19.260294 65729 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/client.key: {Name:mk4909c7628b29b2b5a871a8256c6046576efbba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 19:55:19.260418 65729 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/apiserver.key.f5190fa3
I0906 19:55:19.260438 65729 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/apiserver.crt.f5190fa3 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.30]
I0906 19:55:19.468106 65729 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/apiserver.crt.f5190fa3 ...
I0906 19:55:19.468152 65729 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/apiserver.crt.f5190fa3: {Name:mk62b9318e796051ca03e2b68fbc690b665dc239 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 19:55:19.468325 65729 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/apiserver.key.f5190fa3 ...
I0906 19:55:19.468341 65729 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/apiserver.key.f5190fa3: {Name:mk24074bb81ca2e42f8829309c98d6ed60f63964 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 19:55:19.468417 65729 certs.go:381] copying /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/apiserver.crt.f5190fa3 -> /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/apiserver.crt
I0906 19:55:19.468483 65729 certs.go:385] copying /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/apiserver.key.f5190fa3 -> /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/apiserver.key
I0906 19:55:19.468533 65729 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/proxy-client.key
I0906 19:55:19.468553 65729 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/proxy-client.crt with IP's: []
I0906 19:55:19.573789 65729 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/proxy-client.crt ...
I0906 19:55:19.573832 65729 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/proxy-client.crt: {Name:mk321c38cd194413d66067eafe7c24905c5e84f0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 19:55:19.574051 65729 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/proxy-client.key ...
I0906 19:55:19.574068 65729 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/proxy-client.key: {Name:mk00d31908c4a41782ef3aa004df68f4021d983b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0906 19:55:19.574282 65729 certs.go:484] found cert: /home/jenkins/minikube-integration/19576-6021/.minikube/certs/13178.pem (1338 bytes)
W0906 19:55:19.574323 65729 certs.go:480] ignoring /home/jenkins/minikube-integration/19576-6021/.minikube/certs/13178_empty.pem, impossibly tiny 0 bytes
I0906 19:55:19.574330 65729 certs.go:484] found cert: /home/jenkins/minikube-integration/19576-6021/.minikube/certs/ca-key.pem (1679 bytes)
I0906 19:55:19.574390 65729 certs.go:484] found cert: /home/jenkins/minikube-integration/19576-6021/.minikube/certs/ca.pem (1078 bytes)
I0906 19:55:19.574419 65729 certs.go:484] found cert: /home/jenkins/minikube-integration/19576-6021/.minikube/certs/cert.pem (1123 bytes)
I0906 19:55:19.574446 65729 certs.go:484] found cert: /home/jenkins/minikube-integration/19576-6021/.minikube/certs/key.pem (1675 bytes)
I0906 19:55:19.574490 65729 certs.go:484] found cert: /home/jenkins/minikube-integration/19576-6021/.minikube/files/etc/ssl/certs/131782.pem (1708 bytes)
I0906 19:55:19.575117 65729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-6021/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0906 19:55:19.610686 65729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-6021/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0906 19:55:19.644812 65729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-6021/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0906 19:55:19.676482 65729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-6021/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0906 19:55:19.703439 65729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0906 19:55:19.730096 65729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0906 19:55:19.758047 65729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0906 19:55:19.786051 65729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-6021/.minikube/profiles/old-k8s-version-843298/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0906 19:55:19.813664 65729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-6021/.minikube/files/etc/ssl/certs/131782.pem --> /usr/share/ca-certificates/131782.pem (1708 bytes)
I0906 19:55:19.841953 65729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-6021/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0906 19:55:19.870448 65729 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19576-6021/.minikube/certs/13178.pem --> /usr/share/ca-certificates/13178.pem (1338 bytes)
I0906 19:55:19.908616 65729 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0906 19:55:19.934228 65729 ssh_runner.go:195] Run: openssl version
I0906 19:55:19.942816 65729 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/13178.pem && ln -fs /usr/share/ca-certificates/13178.pem /etc/ssl/certs/13178.pem"
I0906 19:55:19.961582 65729 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/13178.pem
I0906 19:55:19.971447 65729 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 6 18:47 /usr/share/ca-certificates/13178.pem
I0906 19:55:19.971536 65729 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/13178.pem
I0906 19:55:19.981378 65729 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/13178.pem /etc/ssl/certs/51391683.0"
I0906 19:55:20.000436 65729 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/131782.pem && ln -fs /usr/share/ca-certificates/131782.pem /etc/ssl/certs/131782.pem"
I0906 19:55:20.022684 65729 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/131782.pem
I0906 19:55:20.029071 65729 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 6 18:47 /usr/share/ca-certificates/131782.pem
I0906 19:55:20.029142 65729 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/131782.pem
I0906 19:55:20.036080 65729 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/131782.pem /etc/ssl/certs/3ec20f2e.0"
I0906 19:55:20.051280 65729 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0906 19:55:20.063240 65729 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0906 19:55:20.069294 65729 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 6 18:30 /usr/share/ca-certificates/minikubeCA.pem
I0906 19:55:20.069380 65729 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0906 19:55:20.077326 65729 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0906 19:55:20.091901 65729 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0906 19:55:20.097701 65729 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0906 19:55:20.097770 65729 kubeadm.go:392] StartCluster: {Name:old-k8s-version-843298 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-843298 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.30 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disa
bleOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0906 19:55:20.097861 65729 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0906 19:55:20.097947 65729 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0906 19:55:20.143146 65729 cri.go:89] found id: ""
I0906 19:55:20.143213 65729 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0906 19:55:20.153754 65729 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0906 19:55:20.166121 65729 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0906 19:55:20.176747 65729 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0906 19:55:20.176773 65729 kubeadm.go:157] found existing configuration files:
I0906 19:55:20.176825 65729 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0906 19:55:20.190006 65729 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0906 19:55:20.190075 65729 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0906 19:55:20.200826 65729 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0906 19:55:20.210355 65729 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0906 19:55:20.210411 65729 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0906 19:55:20.220592 65729 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0906 19:55:20.233741 65729 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0906 19:55:20.233814 65729 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0906 19:55:20.246447 65729 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0906 19:55:20.258003 65729 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0906 19:55:20.258062 65729 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0906 19:55:20.268810 65729 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0906 19:55:20.591798 65729 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0906 19:57:19.493553 65729 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0906 19:57:19.493737 65729 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0906 19:57:19.494780 65729 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0906 19:57:19.494895 65729 kubeadm.go:310] [preflight] Running pre-flight checks
I0906 19:57:19.495041 65729 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0906 19:57:19.495301 65729 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0906 19:57:19.495688 65729 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0906 19:57:19.495846 65729 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0906 19:57:19.497423 65729 out.go:235] - Generating certificates and keys ...
I0906 19:57:19.497521 65729 kubeadm.go:310] [certs] Using existing ca certificate authority
I0906 19:57:19.497620 65729 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0906 19:57:19.497762 65729 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0906 19:57:19.497865 65729 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0906 19:57:19.498002 65729 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0906 19:57:19.498096 65729 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0906 19:57:19.498219 65729 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0906 19:57:19.498439 65729 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-843298] and IPs [192.168.72.30 127.0.0.1 ::1]
I0906 19:57:19.498530 65729 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0906 19:57:19.498683 65729 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-843298] and IPs [192.168.72.30 127.0.0.1 ::1]
I0906 19:57:19.498747 65729 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0906 19:57:19.498802 65729 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0906 19:57:19.498849 65729 kubeadm.go:310] [certs] Generating "sa" key and public key
I0906 19:57:19.498902 65729 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0906 19:57:19.498946 65729 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0906 19:57:19.498990 65729 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0906 19:57:19.499047 65729 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0906 19:57:19.499094 65729 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0906 19:57:19.499178 65729 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0906 19:57:19.499252 65729 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0906 19:57:19.499290 65729 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0906 19:57:19.499348 65729 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0906 19:57:19.501229 65729 out.go:235] - Booting up control plane ...
I0906 19:57:19.501305 65729 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0906 19:57:19.501372 65729 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0906 19:57:19.501460 65729 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0906 19:57:19.501572 65729 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0906 19:57:19.501764 65729 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0906 19:57:19.501824 65729 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0906 19:57:19.501889 65729 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 19:57:19.502097 65729 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 19:57:19.502184 65729 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 19:57:19.502427 65729 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 19:57:19.502491 65729 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 19:57:19.502646 65729 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 19:57:19.502708 65729 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 19:57:19.502870 65729 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 19:57:19.502931 65729 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 19:57:19.503122 65729 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 19:57:19.503134 65729 kubeadm.go:310]
I0906 19:57:19.503187 65729 kubeadm.go:310] Unfortunately, an error has occurred:
I0906 19:57:19.503244 65729 kubeadm.go:310] timed out waiting for the condition
I0906 19:57:19.503252 65729 kubeadm.go:310]
I0906 19:57:19.503304 65729 kubeadm.go:310] This error is likely caused by:
I0906 19:57:19.503341 65729 kubeadm.go:310] - The kubelet is not running
I0906 19:57:19.503443 65729 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0906 19:57:19.503454 65729 kubeadm.go:310]
I0906 19:57:19.503692 65729 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0906 19:57:19.503736 65729 kubeadm.go:310] - 'systemctl status kubelet'
I0906 19:57:19.503766 65729 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0906 19:57:19.503772 65729 kubeadm.go:310]
I0906 19:57:19.503865 65729 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0906 19:57:19.503942 65729 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0906 19:57:19.503952 65729 kubeadm.go:310]
I0906 19:57:19.504075 65729 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0906 19:57:19.504169 65729 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0906 19:57:19.504257 65729 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0906 19:57:19.504330 65729 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0906 19:57:19.504349 65729 kubeadm.go:310]
W0906 19:57:19.504448 65729 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-843298] and IPs [192.168.72.30 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-843298] and IPs [192.168.72.30 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-843298] and IPs [192.168.72.30 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-843298] and IPs [192.168.72.30 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0906 19:57:19.504503 65729 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0906 19:57:20.415354 65729 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0906 19:57:20.429314 65729 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0906 19:57:20.438919 65729 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0906 19:57:20.438944 65729 kubeadm.go:157] found existing configuration files:
I0906 19:57:20.438984 65729 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0906 19:57:20.450281 65729 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0906 19:57:20.450348 65729 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0906 19:57:20.459331 65729 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0906 19:57:20.467989 65729 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0906 19:57:20.468033 65729 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0906 19:57:20.477018 65729 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0906 19:57:20.486920 65729 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0906 19:57:20.486965 65729 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0906 19:57:20.497254 65729 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0906 19:57:20.507398 65729 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0906 19:57:20.507486 65729 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0906 19:57:20.517623 65729 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0906 19:57:20.592077 65729 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0906 19:57:20.592202 65729 kubeadm.go:310] [preflight] Running pre-flight checks
I0906 19:57:20.744366 65729 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0906 19:57:20.744520 65729 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0906 19:57:20.744643 65729 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0906 19:57:20.918790 65729 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0906 19:57:20.920603 65729 out.go:235] - Generating certificates and keys ...
I0906 19:57:20.920675 65729 kubeadm.go:310] [certs] Using existing ca certificate authority
I0906 19:57:20.920727 65729 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0906 19:57:20.920789 65729 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0906 19:57:20.920837 65729 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0906 19:57:20.920917 65729 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0906 19:57:20.920965 65729 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0906 19:57:20.921018 65729 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0906 19:57:20.921066 65729 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0906 19:57:20.921124 65729 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0906 19:57:20.921188 65729 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0906 19:57:20.921219 65729 kubeadm.go:310] [certs] Using the existing "sa" key
I0906 19:57:20.921275 65729 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0906 19:57:21.001018 65729 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0906 19:57:21.286237 65729 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0906 19:57:21.406738 65729 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0906 19:57:21.585836 65729 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0906 19:57:21.600750 65729 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0906 19:57:21.603026 65729 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0906 19:57:21.603258 65729 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0906 19:57:21.752726 65729 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0906 19:57:21.754572 65729 out.go:235] - Booting up control plane ...
I0906 19:57:21.754688 65729 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0906 19:57:21.762359 65729 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0906 19:57:21.764055 65729 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0906 19:57:21.764886 65729 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0906 19:57:21.767308 65729 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0906 19:58:01.770408 65729 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0906 19:58:01.770809 65729 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 19:58:01.771015 65729 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 19:58:06.771736 65729 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 19:58:06.771972 65729 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 19:58:16.772272 65729 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 19:58:16.772492 65729 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 19:58:36.771591 65729 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 19:58:36.771764 65729 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 19:59:16.771804 65729 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0906 19:59:16.772014 65729 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0906 19:59:16.772025 65729 kubeadm.go:310]
I0906 19:59:16.772071 65729 kubeadm.go:310] Unfortunately, an error has occurred:
I0906 19:59:16.772131 65729 kubeadm.go:310] timed out waiting for the condition
I0906 19:59:16.772138 65729 kubeadm.go:310]
I0906 19:59:16.772165 65729 kubeadm.go:310] This error is likely caused by:
I0906 19:59:16.772191 65729 kubeadm.go:310] - The kubelet is not running
I0906 19:59:16.772282 65729 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0906 19:59:16.772286 65729 kubeadm.go:310]
I0906 19:59:16.772427 65729 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0906 19:59:16.772503 65729 kubeadm.go:310] - 'systemctl status kubelet'
I0906 19:59:16.772552 65729 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0906 19:59:16.772574 65729 kubeadm.go:310]
I0906 19:59:16.772702 65729 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0906 19:59:16.772826 65729 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0906 19:59:16.772840 65729 kubeadm.go:310]
I0906 19:59:16.773015 65729 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0906 19:59:16.773142 65729 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0906 19:59:16.773232 65729 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0906 19:59:16.773352 65729 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0906 19:59:16.773364 65729 kubeadm.go:310]
I0906 19:59:16.774074 65729 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0906 19:59:16.774150 65729 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0906 19:59:16.774203 65729 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0906 19:59:16.774258 65729 kubeadm.go:394] duration metric: took 3m56.676492569s to StartCluster
I0906 19:59:16.774297 65729 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0906 19:59:16.774347 65729 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0906 19:59:16.818115 65729 cri.go:89] found id: ""
I0906 19:59:16.818143 65729 logs.go:276] 0 containers: []
W0906 19:59:16.818151 65729 logs.go:278] No container was found matching "kube-apiserver"
I0906 19:59:16.818158 65729 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0906 19:59:16.818205 65729 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0906 19:59:16.851893 65729 cri.go:89] found id: ""
I0906 19:59:16.851919 65729 logs.go:276] 0 containers: []
W0906 19:59:16.851926 65729 logs.go:278] No container was found matching "etcd"
I0906 19:59:16.851932 65729 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0906 19:59:16.851980 65729 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0906 19:59:16.885337 65729 cri.go:89] found id: ""
I0906 19:59:16.885360 65729 logs.go:276] 0 containers: []
W0906 19:59:16.885368 65729 logs.go:278] No container was found matching "coredns"
I0906 19:59:16.885374 65729 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0906 19:59:16.885420 65729 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0906 19:59:16.919126 65729 cri.go:89] found id: ""
I0906 19:59:16.919150 65729 logs.go:276] 0 containers: []
W0906 19:59:16.919158 65729 logs.go:278] No container was found matching "kube-scheduler"
I0906 19:59:16.919168 65729 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0906 19:59:16.919212 65729 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0906 19:59:16.954117 65729 cri.go:89] found id: ""
I0906 19:59:16.954141 65729 logs.go:276] 0 containers: []
W0906 19:59:16.954149 65729 logs.go:278] No container was found matching "kube-proxy"
I0906 19:59:16.954154 65729 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0906 19:59:16.954199 65729 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0906 19:59:16.988606 65729 cri.go:89] found id: ""
I0906 19:59:16.988629 65729 logs.go:276] 0 containers: []
W0906 19:59:16.988636 65729 logs.go:278] No container was found matching "kube-controller-manager"
I0906 19:59:16.988643 65729 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0906 19:59:16.988690 65729 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0906 19:59:17.021839 65729 cri.go:89] found id: ""
I0906 19:59:17.021865 65729 logs.go:276] 0 containers: []
W0906 19:59:17.021873 65729 logs.go:278] No container was found matching "kindnet"
I0906 19:59:17.021881 65729 logs.go:123] Gathering logs for describe nodes ...
I0906 19:59:17.021893 65729 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0906 19:59:17.135508 65729 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0906 19:59:17.135531 65729 logs.go:123] Gathering logs for CRI-O ...
I0906 19:59:17.135549 65729 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0906 19:59:17.238589 65729 logs.go:123] Gathering logs for container status ...
I0906 19:59:17.238620 65729 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0906 19:59:17.289983 65729 logs.go:123] Gathering logs for kubelet ...
I0906 19:59:17.290025 65729 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0906 19:59:17.346081 65729 logs.go:123] Gathering logs for dmesg ...
I0906 19:59:17.346118 65729 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
W0906 19:59:17.368699 65729 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0906 19:59:17.368790 65729 out.go:270] *
*
W0906 19:59:17.368865 65729 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0906 19:59:17.368887 65729 out.go:270] *
*
W0906 19:59:17.369729 65729 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0906 19:59:17.373067 65729 out.go:201]
W0906 19:59:17.374179 65729 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0906 19:59:17.374218 65729 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0906 19:59:17.374236 65729 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0906 19:59:17.375525 65729 out.go:201]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-843298 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-843298 -n old-k8s-version-843298
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-843298 -n old-k8s-version-843298: exit status 6 (226.060333ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0906 19:59:17.653651 72428 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-843298" does not appear in /home/jenkins/minikube-integration/19576-6021/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-843298" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (289.65s)