=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-998147 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-998147 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m40.409423802s)
-- stdout --
* [old-k8s-version-998147] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19282
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19282-392903/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-392903/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-998147" primary control-plane node in "old-k8s-version-998147" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0717 19:22:30.131847 452176 out.go:291] Setting OutFile to fd 1 ...
I0717 19:22:30.131964 452176 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 19:22:30.131970 452176 out.go:304] Setting ErrFile to fd 2...
I0717 19:22:30.131976 452176 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 19:22:30.132184 452176 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-392903/.minikube/bin
I0717 19:22:30.132901 452176 out.go:298] Setting JSON to false
I0717 19:22:30.134146 452176 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":11093,"bootTime":1721233057,"procs":302,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0717 19:22:30.134213 452176 start.go:139] virtualization: kvm guest
I0717 19:22:30.136613 452176 out.go:177] * [old-k8s-version-998147] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0717 19:22:30.138097 452176 out.go:177] - MINIKUBE_LOCATION=19282
I0717 19:22:30.138131 452176 notify.go:220] Checking for updates...
I0717 19:22:30.140664 452176 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0717 19:22:30.141872 452176 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19282-392903/kubeconfig
I0717 19:22:30.142948 452176 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-392903/.minikube
I0717 19:22:30.144091 452176 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0717 19:22:30.145326 452176 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0717 19:22:30.147164 452176 config.go:182] Loaded profile config "bridge-369638": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2
I0717 19:22:30.147269 452176 config.go:182] Loaded profile config "enable-default-cni-369638": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2
I0717 19:22:30.147378 452176 config.go:182] Loaded profile config "flannel-369638": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2
I0717 19:22:30.147492 452176 driver.go:392] Setting default libvirt URI to qemu:///system
I0717 19:22:30.185736 452176 out.go:177] * Using the kvm2 driver based on user configuration
I0717 19:22:30.186990 452176 start.go:297] selected driver: kvm2
I0717 19:22:30.187017 452176 start.go:901] validating driver "kvm2" against <nil>
I0717 19:22:30.187031 452176 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0717 19:22:30.187799 452176 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0717 19:22:30.187889 452176 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19282-392903/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0717 19:22:30.203367 452176 install.go:137] /home/jenkins/minikube-integration/19282-392903/.minikube/bin/docker-machine-driver-kvm2 version is 1.33.1
I0717 19:22:30.203417 452176 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0717 19:22:30.203644 452176 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0717 19:22:30.203722 452176 cni.go:84] Creating CNI manager for ""
I0717 19:22:30.203736 452176 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0717 19:22:30.203748 452176 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0717 19:22:30.203846 452176 start.go:340] cluster config:
{Name:old-k8s-version-998147 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-998147 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0717 19:22:30.203979 452176 iso.go:125] acquiring lock: {Name:mk538e17966376fb8d1586bc9fef119ddb755e26 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0717 19:22:30.205800 452176 out.go:177] * Starting "old-k8s-version-998147" primary control-plane node in "old-k8s-version-998147" cluster
I0717 19:22:30.207076 452176 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0717 19:22:30.207123 452176 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19282-392903/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0717 19:22:30.207148 452176 cache.go:56] Caching tarball of preloaded images
I0717 19:22:30.207232 452176 preload.go:172] Found /home/jenkins/minikube-integration/19282-392903/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0717 19:22:30.207246 452176 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0717 19:22:30.207341 452176 profile.go:143] Saving config to /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/config.json ...
I0717 19:22:30.207366 452176 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/config.json: {Name:mka89d899845d95b92a8dda779d89552c952248b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 19:22:30.207513 452176 start.go:360] acquireMachinesLock for old-k8s-version-998147: {Name:mke9f5964d3678e22f96aac00347ee7351098bbc Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0717 19:22:37.166894 452176 start.go:364] duration metric: took 6.959352108s to acquireMachinesLock for "old-k8s-version-998147"
I0717 19:22:37.166978 452176 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-998147 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19264/minikube-v1.33.1-1721146474-19264-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-998147 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0717 19:22:37.167141 452176 start.go:125] createHost starting for "" (driver="kvm2")
I0717 19:22:37.169629 452176 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0717 19:22:37.169865 452176 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/19282-392903/.minikube/bin/docker-machine-driver-kvm2
I0717 19:22:37.169926 452176 main.go:141] libmachine: Launching plugin server for driver kvm2
I0717 19:22:37.190712 452176 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42665
I0717 19:22:37.191365 452176 main.go:141] libmachine: () Calling .GetVersion
I0717 19:22:37.191942 452176 main.go:141] libmachine: Using API Version 1
I0717 19:22:37.191966 452176 main.go:141] libmachine: () Calling .SetConfigRaw
I0717 19:22:37.192346 452176 main.go:141] libmachine: () Calling .GetMachineName
I0717 19:22:37.192574 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetMachineName
I0717 19:22:37.192786 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .DriverName
I0717 19:22:37.192991 452176 start.go:159] libmachine.API.Create for "old-k8s-version-998147" (driver="kvm2")
I0717 19:22:37.193035 452176 client.go:168] LocalClient.Create starting
I0717 19:22:37.193075 452176 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19282-392903/.minikube/certs/ca.pem
I0717 19:22:37.193118 452176 main.go:141] libmachine: Decoding PEM data...
I0717 19:22:37.193143 452176 main.go:141] libmachine: Parsing certificate...
I0717 19:22:37.193217 452176 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19282-392903/.minikube/certs/cert.pem
I0717 19:22:37.193246 452176 main.go:141] libmachine: Decoding PEM data...
I0717 19:22:37.193262 452176 main.go:141] libmachine: Parsing certificate...
I0717 19:22:37.193283 452176 main.go:141] libmachine: Running pre-create checks...
I0717 19:22:37.193303 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .PreCreateCheck
I0717 19:22:37.193711 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetConfigRaw
I0717 19:22:37.194155 452176 main.go:141] libmachine: Creating machine...
I0717 19:22:37.194170 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .Create
I0717 19:22:37.194322 452176 main.go:141] libmachine: (old-k8s-version-998147) Creating KVM machine...
I0717 19:22:37.195506 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found existing default KVM network
I0717 19:22:37.197098 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:37.196952 452252 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:5f:78:7d} reservation:<nil>}
I0717 19:22:37.198090 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:37.198024 452252 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:37:f0:6a} reservation:<nil>}
I0717 19:22:37.198927 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:37.198846 452252 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:cf:f2:9e} reservation:<nil>}
I0717 19:22:37.200027 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:37.199932 452252 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00030f200}
I0717 19:22:37.200056 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | created network xml:
I0717 19:22:37.200066 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | <network>
I0717 19:22:37.200074 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | <name>mk-old-k8s-version-998147</name>
I0717 19:22:37.200106 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | <dns enable='no'/>
I0717 19:22:37.200130 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG |
I0717 19:22:37.200156 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0717 19:22:37.200168 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | <dhcp>
I0717 19:22:37.200184 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0717 19:22:37.200194 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | </dhcp>
I0717 19:22:37.200204 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | </ip>
I0717 19:22:37.200215 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG |
I0717 19:22:37.200225 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | </network>
I0717 19:22:37.200236 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG |
I0717 19:22:37.205798 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | trying to create private KVM network mk-old-k8s-version-998147 192.168.72.0/24...
I0717 19:22:37.282941 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | private KVM network mk-old-k8s-version-998147 192.168.72.0/24 created
I0717 19:22:37.282976 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:37.282917 452252 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19282-392903/.minikube
I0717 19:22:37.282990 452176 main.go:141] libmachine: (old-k8s-version-998147) Setting up store path in /home/jenkins/minikube-integration/19282-392903/.minikube/machines/old-k8s-version-998147 ...
I0717 19:22:37.283007 452176 main.go:141] libmachine: (old-k8s-version-998147) Building disk image from file:///home/jenkins/minikube-integration/19282-392903/.minikube/cache/iso/amd64/minikube-v1.33.1-1721146474-19264-amd64.iso
I0717 19:22:37.283068 452176 main.go:141] libmachine: (old-k8s-version-998147) Downloading /home/jenkins/minikube-integration/19282-392903/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19282-392903/.minikube/cache/iso/amd64/minikube-v1.33.1-1721146474-19264-amd64.iso...
I0717 19:22:37.552441 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:37.552313 452252 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19282-392903/.minikube/machines/old-k8s-version-998147/id_rsa...
I0717 19:22:37.705311 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:37.705183 452252 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19282-392903/.minikube/machines/old-k8s-version-998147/old-k8s-version-998147.rawdisk...
I0717 19:22:37.705345 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | Writing magic tar header
I0717 19:22:37.705362 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | Writing SSH key tar header
I0717 19:22:37.705376 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:37.705322 452252 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19282-392903/.minikube/machines/old-k8s-version-998147 ...
I0717 19:22:37.705486 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19282-392903/.minikube/machines/old-k8s-version-998147
I0717 19:22:37.705561 452176 main.go:141] libmachine: (old-k8s-version-998147) Setting executable bit set on /home/jenkins/minikube-integration/19282-392903/.minikube/machines/old-k8s-version-998147 (perms=drwx------)
I0717 19:22:37.705587 452176 main.go:141] libmachine: (old-k8s-version-998147) Setting executable bit set on /home/jenkins/minikube-integration/19282-392903/.minikube/machines (perms=drwxr-xr-x)
I0717 19:22:37.705598 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19282-392903/.minikube/machines
I0717 19:22:37.705612 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19282-392903/.minikube
I0717 19:22:37.705625 452176 main.go:141] libmachine: (old-k8s-version-998147) Setting executable bit set on /home/jenkins/minikube-integration/19282-392903/.minikube (perms=drwxr-xr-x)
I0717 19:22:37.705636 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19282-392903
I0717 19:22:37.705652 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0717 19:22:37.705665 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | Checking permissions on dir: /home/jenkins
I0717 19:22:37.705679 452176 main.go:141] libmachine: (old-k8s-version-998147) Setting executable bit set on /home/jenkins/minikube-integration/19282-392903 (perms=drwxrwxr-x)
I0717 19:22:37.705696 452176 main.go:141] libmachine: (old-k8s-version-998147) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0717 19:22:37.705718 452176 main.go:141] libmachine: (old-k8s-version-998147) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0717 19:22:37.705732 452176 main.go:141] libmachine: (old-k8s-version-998147) Creating domain...
I0717 19:22:37.705742 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | Checking permissions on dir: /home
I0717 19:22:37.705756 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | Skipping /home - not owner
I0717 19:22:37.707136 452176 main.go:141] libmachine: (old-k8s-version-998147) define libvirt domain using xml:
I0717 19:22:37.707163 452176 main.go:141] libmachine: (old-k8s-version-998147) <domain type='kvm'>
I0717 19:22:37.707171 452176 main.go:141] libmachine: (old-k8s-version-998147) <name>old-k8s-version-998147</name>
I0717 19:22:37.707176 452176 main.go:141] libmachine: (old-k8s-version-998147) <memory unit='MiB'>2200</memory>
I0717 19:22:37.707197 452176 main.go:141] libmachine: (old-k8s-version-998147) <vcpu>2</vcpu>
I0717 19:22:37.707209 452176 main.go:141] libmachine: (old-k8s-version-998147) <features>
I0717 19:22:37.707219 452176 main.go:141] libmachine: (old-k8s-version-998147) <acpi/>
I0717 19:22:37.707224 452176 main.go:141] libmachine: (old-k8s-version-998147) <apic/>
I0717 19:22:37.707229 452176 main.go:141] libmachine: (old-k8s-version-998147) <pae/>
I0717 19:22:37.707233 452176 main.go:141] libmachine: (old-k8s-version-998147)
I0717 19:22:37.707239 452176 main.go:141] libmachine: (old-k8s-version-998147) </features>
I0717 19:22:37.707244 452176 main.go:141] libmachine: (old-k8s-version-998147) <cpu mode='host-passthrough'>
I0717 19:22:37.707249 452176 main.go:141] libmachine: (old-k8s-version-998147)
I0717 19:22:37.707254 452176 main.go:141] libmachine: (old-k8s-version-998147) </cpu>
I0717 19:22:37.707264 452176 main.go:141] libmachine: (old-k8s-version-998147) <os>
I0717 19:22:37.707272 452176 main.go:141] libmachine: (old-k8s-version-998147) <type>hvm</type>
I0717 19:22:37.707277 452176 main.go:141] libmachine: (old-k8s-version-998147) <boot dev='cdrom'/>
I0717 19:22:37.707282 452176 main.go:141] libmachine: (old-k8s-version-998147) <boot dev='hd'/>
I0717 19:22:37.707289 452176 main.go:141] libmachine: (old-k8s-version-998147) <bootmenu enable='no'/>
I0717 19:22:37.707293 452176 main.go:141] libmachine: (old-k8s-version-998147) </os>
I0717 19:22:37.707330 452176 main.go:141] libmachine: (old-k8s-version-998147) <devices>
I0717 19:22:37.707357 452176 main.go:141] libmachine: (old-k8s-version-998147) <disk type='file' device='cdrom'>
I0717 19:22:37.707390 452176 main.go:141] libmachine: (old-k8s-version-998147) <source file='/home/jenkins/minikube-integration/19282-392903/.minikube/machines/old-k8s-version-998147/boot2docker.iso'/>
I0717 19:22:37.707414 452176 main.go:141] libmachine: (old-k8s-version-998147) <target dev='hdc' bus='scsi'/>
I0717 19:22:37.707424 452176 main.go:141] libmachine: (old-k8s-version-998147) <readonly/>
I0717 19:22:37.707438 452176 main.go:141] libmachine: (old-k8s-version-998147) </disk>
I0717 19:22:37.707451 452176 main.go:141] libmachine: (old-k8s-version-998147) <disk type='file' device='disk'>
I0717 19:22:37.707463 452176 main.go:141] libmachine: (old-k8s-version-998147) <driver name='qemu' type='raw' cache='default' io='threads' />
I0717 19:22:37.707481 452176 main.go:141] libmachine: (old-k8s-version-998147) <source file='/home/jenkins/minikube-integration/19282-392903/.minikube/machines/old-k8s-version-998147/old-k8s-version-998147.rawdisk'/>
I0717 19:22:37.707491 452176 main.go:141] libmachine: (old-k8s-version-998147) <target dev='hda' bus='virtio'/>
I0717 19:22:37.707499 452176 main.go:141] libmachine: (old-k8s-version-998147) </disk>
I0717 19:22:37.707510 452176 main.go:141] libmachine: (old-k8s-version-998147) <interface type='network'>
I0717 19:22:37.707525 452176 main.go:141] libmachine: (old-k8s-version-998147) <source network='mk-old-k8s-version-998147'/>
I0717 19:22:37.707540 452176 main.go:141] libmachine: (old-k8s-version-998147) <model type='virtio'/>
I0717 19:22:37.707548 452176 main.go:141] libmachine: (old-k8s-version-998147) </interface>
I0717 19:22:37.707553 452176 main.go:141] libmachine: (old-k8s-version-998147) <interface type='network'>
I0717 19:22:37.707562 452176 main.go:141] libmachine: (old-k8s-version-998147) <source network='default'/>
I0717 19:22:37.707573 452176 main.go:141] libmachine: (old-k8s-version-998147) <model type='virtio'/>
I0717 19:22:37.707583 452176 main.go:141] libmachine: (old-k8s-version-998147) </interface>
I0717 19:22:37.707590 452176 main.go:141] libmachine: (old-k8s-version-998147) <serial type='pty'>
I0717 19:22:37.707602 452176 main.go:141] libmachine: (old-k8s-version-998147) <target port='0'/>
I0717 19:22:37.707609 452176 main.go:141] libmachine: (old-k8s-version-998147) </serial>
I0717 19:22:37.707618 452176 main.go:141] libmachine: (old-k8s-version-998147) <console type='pty'>
I0717 19:22:37.707628 452176 main.go:141] libmachine: (old-k8s-version-998147) <target type='serial' port='0'/>
I0717 19:22:37.707637 452176 main.go:141] libmachine: (old-k8s-version-998147) </console>
I0717 19:22:37.707648 452176 main.go:141] libmachine: (old-k8s-version-998147) <rng model='virtio'>
I0717 19:22:37.707657 452176 main.go:141] libmachine: (old-k8s-version-998147) <backend model='random'>/dev/random</backend>
I0717 19:22:37.707668 452176 main.go:141] libmachine: (old-k8s-version-998147) </rng>
I0717 19:22:37.707678 452176 main.go:141] libmachine: (old-k8s-version-998147)
I0717 19:22:37.707685 452176 main.go:141] libmachine: (old-k8s-version-998147)
I0717 19:22:37.707718 452176 main.go:141] libmachine: (old-k8s-version-998147) </devices>
I0717 19:22:37.707737 452176 main.go:141] libmachine: (old-k8s-version-998147) </domain>
I0717 19:22:37.707751 452176 main.go:141] libmachine: (old-k8s-version-998147)
I0717 19:22:37.712114 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:73:51:2e in network default
I0717 19:22:37.712780 452176 main.go:141] libmachine: (old-k8s-version-998147) Ensuring networks are active...
I0717 19:22:37.712803 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:22:37.713548 452176 main.go:141] libmachine: (old-k8s-version-998147) Ensuring network default is active
I0717 19:22:37.713921 452176 main.go:141] libmachine: (old-k8s-version-998147) Ensuring network mk-old-k8s-version-998147 is active
I0717 19:22:37.714538 452176 main.go:141] libmachine: (old-k8s-version-998147) Getting domain xml...
I0717 19:22:37.715294 452176 main.go:141] libmachine: (old-k8s-version-998147) Creating domain...
I0717 19:22:39.207393 452176 main.go:141] libmachine: (old-k8s-version-998147) Waiting to get IP...
I0717 19:22:39.208543 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:22:39.209127 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | unable to find current IP address of domain old-k8s-version-998147 in network mk-old-k8s-version-998147
I0717 19:22:39.209158 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:39.209080 452252 retry.go:31] will retry after 215.181531ms: waiting for machine to come up
I0717 19:22:39.425686 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:22:39.426316 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | unable to find current IP address of domain old-k8s-version-998147 in network mk-old-k8s-version-998147
I0717 19:22:39.426348 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:39.426235 452252 retry.go:31] will retry after 312.174885ms: waiting for machine to come up
I0717 19:22:39.739878 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:22:39.740542 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | unable to find current IP address of domain old-k8s-version-998147 in network mk-old-k8s-version-998147
I0717 19:22:39.740574 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:39.740464 452252 retry.go:31] will retry after 406.538949ms: waiting for machine to come up
I0717 19:22:40.149292 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:22:40.150006 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | unable to find current IP address of domain old-k8s-version-998147 in network mk-old-k8s-version-998147
I0717 19:22:40.150037 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:40.149959 452252 retry.go:31] will retry after 542.191773ms: waiting for machine to come up
I0717 19:22:40.693562 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:22:40.694229 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | unable to find current IP address of domain old-k8s-version-998147 in network mk-old-k8s-version-998147
I0717 19:22:40.694263 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:40.694165 452252 retry.go:31] will retry after 762.505438ms: waiting for machine to come up
I0717 19:22:41.459415 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:22:41.461277 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | unable to find current IP address of domain old-k8s-version-998147 in network mk-old-k8s-version-998147
I0717 19:22:41.461317 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:41.461101 452252 retry.go:31] will retry after 936.160952ms: waiting for machine to come up
I0717 19:22:42.399252 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:22:42.400197 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | unable to find current IP address of domain old-k8s-version-998147 in network mk-old-k8s-version-998147
I0717 19:22:42.400224 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:42.400098 452252 retry.go:31] will retry after 1.107864362s: waiting for machine to come up
I0717 19:22:43.510001 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:22:43.510686 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | unable to find current IP address of domain old-k8s-version-998147 in network mk-old-k8s-version-998147
I0717 19:22:43.510710 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:43.510595 452252 retry.go:31] will retry after 1.323512525s: waiting for machine to come up
I0717 19:22:44.835514 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:22:44.836138 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | unable to find current IP address of domain old-k8s-version-998147 in network mk-old-k8s-version-998147
I0717 19:22:44.836189 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:44.836084 452252 retry.go:31] will retry after 1.720820984s: waiting for machine to come up
I0717 19:22:46.558783 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:22:46.559326 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | unable to find current IP address of domain old-k8s-version-998147 in network mk-old-k8s-version-998147
I0717 19:22:46.559358 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:46.559264 452252 retry.go:31] will retry after 1.610937211s: waiting for machine to come up
I0717 19:22:48.171919 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:22:48.172512 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | unable to find current IP address of domain old-k8s-version-998147 in network mk-old-k8s-version-998147
I0717 19:22:48.172544 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:48.172402 452252 retry.go:31] will retry after 2.825549899s: waiting for machine to come up
I0717 19:22:50.999678 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:22:51.000214 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | unable to find current IP address of domain old-k8s-version-998147 in network mk-old-k8s-version-998147
I0717 19:22:51.000263 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:51.000150 452252 retry.go:31] will retry after 2.855900579s: waiting for machine to come up
I0717 19:22:53.858082 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:22:53.858660 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | unable to find current IP address of domain old-k8s-version-998147 in network mk-old-k8s-version-998147
I0717 19:22:53.858688 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:53.858605 452252 retry.go:31] will retry after 3.518834652s: waiting for machine to come up
I0717 19:22:57.379115 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:22:57.379568 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | unable to find current IP address of domain old-k8s-version-998147 in network mk-old-k8s-version-998147
I0717 19:22:57.379616 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | I0717 19:22:57.379521 452252 retry.go:31] will retry after 4.898810274s: waiting for machine to come up
I0717 19:23:02.280399 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:02.281081 452176 main.go:141] libmachine: (old-k8s-version-998147) Found IP for machine: 192.168.72.208
I0717 19:23:02.281101 452176 main.go:141] libmachine: (old-k8s-version-998147) Reserving static IP address...
I0717 19:23:02.281132 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has current primary IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:02.281477 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-998147", mac: "52:54:00:e7:d4:91", ip: "192.168.72.208"} in network mk-old-k8s-version-998147
I0717 19:23:02.365873 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | Getting to WaitForSSH function...
I0717 19:23:02.365910 452176 main.go:141] libmachine: (old-k8s-version-998147) Reserved static IP address: 192.168.72.208
I0717 19:23:02.365924 452176 main.go:141] libmachine: (old-k8s-version-998147) Waiting for SSH to be available...
I0717 19:23:02.369205 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:02.369592 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:minikube Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:02.369623 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:02.369745 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | Using SSH client type: external
I0717 19:23:02.369777 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | Using SSH private key: /home/jenkins/minikube-integration/19282-392903/.minikube/machines/old-k8s-version-998147/id_rsa (-rw-------)
I0717 19:23:02.369820 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.208 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19282-392903/.minikube/machines/old-k8s-version-998147/id_rsa -p 22] /usr/bin/ssh <nil>}
I0717 19:23:02.369829 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | About to run SSH command:
I0717 19:23:02.369842 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | exit 0
I0717 19:23:02.492935 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | SSH cmd err, output: <nil>:
I0717 19:23:02.493232 452176 main.go:141] libmachine: (old-k8s-version-998147) KVM machine creation complete!
I0717 19:23:02.493544 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetConfigRaw
I0717 19:23:02.494225 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .DriverName
I0717 19:23:02.494488 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .DriverName
I0717 19:23:02.494695 452176 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0717 19:23:02.494715 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetState
I0717 19:23:02.496351 452176 main.go:141] libmachine: Detecting operating system of created instance...
I0717 19:23:02.496368 452176 main.go:141] libmachine: Waiting for SSH to be available...
I0717 19:23:02.496377 452176 main.go:141] libmachine: Getting to WaitForSSH function...
I0717 19:23:02.496386 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHHostname
I0717 19:23:02.498999 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:02.499363 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:old-k8s-version-998147 Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:02.499410 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:02.499531 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHPort
I0717 19:23:02.499740 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHKeyPath
I0717 19:23:02.499957 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHKeyPath
I0717 19:23:02.500176 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHUsername
I0717 19:23:02.500354 452176 main.go:141] libmachine: Using SSH client type: native
I0717 19:23:02.500620 452176 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.72.208 22 <nil> <nil>}
I0717 19:23:02.500637 452176 main.go:141] libmachine: About to run SSH command:
exit 0
I0717 19:23:02.612174 452176 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0717 19:23:02.612215 452176 main.go:141] libmachine: Detecting the provisioner...
I0717 19:23:02.612228 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHHostname
I0717 19:23:02.615355 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:02.615707 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:old-k8s-version-998147 Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:02.615742 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:02.615820 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHPort
I0717 19:23:02.616018 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHKeyPath
I0717 19:23:02.616215 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHKeyPath
I0717 19:23:02.616345 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHUsername
I0717 19:23:02.616542 452176 main.go:141] libmachine: Using SSH client type: native
I0717 19:23:02.616774 452176 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.72.208 22 <nil> <nil>}
I0717 19:23:02.616788 452176 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0717 19:23:02.726003 452176 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0717 19:23:02.726092 452176 main.go:141] libmachine: found compatible host: buildroot
I0717 19:23:02.726103 452176 main.go:141] libmachine: Provisioning with buildroot...
I0717 19:23:02.726115 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetMachineName
I0717 19:23:02.726426 452176 buildroot.go:166] provisioning hostname "old-k8s-version-998147"
I0717 19:23:02.726454 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetMachineName
I0717 19:23:02.726645 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHHostname
I0717 19:23:02.729999 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:02.730359 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:old-k8s-version-998147 Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:02.730389 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:02.730595 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHPort
I0717 19:23:02.730786 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHKeyPath
I0717 19:23:02.730961 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHKeyPath
I0717 19:23:02.731106 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHUsername
I0717 19:23:02.731262 452176 main.go:141] libmachine: Using SSH client type: native
I0717 19:23:02.731414 452176 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.72.208 22 <nil> <nil>}
I0717 19:23:02.731422 452176 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-998147 && echo "old-k8s-version-998147" | sudo tee /etc/hostname
I0717 19:23:02.859875 452176 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-998147
I0717 19:23:02.859915 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHHostname
I0717 19:23:02.863129 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:02.863555 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:old-k8s-version-998147 Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:02.863594 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:02.863796 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHPort
I0717 19:23:02.864057 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHKeyPath
I0717 19:23:02.864259 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHKeyPath
I0717 19:23:02.864438 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHUsername
I0717 19:23:02.864682 452176 main.go:141] libmachine: Using SSH client type: native
I0717 19:23:02.864887 452176 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.72.208 22 <nil> <nil>}
I0717 19:23:02.864913 452176 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-998147' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-998147/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-998147' | sudo tee -a /etc/hosts;
fi
fi
I0717 19:23:02.980208 452176 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0717 19:23:02.980243 452176 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19282-392903/.minikube CaCertPath:/home/jenkins/minikube-integration/19282-392903/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19282-392903/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19282-392903/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19282-392903/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19282-392903/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19282-392903/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19282-392903/.minikube}
I0717 19:23:02.980289 452176 buildroot.go:174] setting up certificates
I0717 19:23:02.980304 452176 provision.go:84] configureAuth start
I0717 19:23:02.980322 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetMachineName
I0717 19:23:02.980664 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetIP
I0717 19:23:02.983463 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:02.983875 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:old-k8s-version-998147 Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:02.983906 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:02.984034 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHHostname
I0717 19:23:02.987137 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:02.987499 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:old-k8s-version-998147 Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:02.987528 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:02.987709 452176 provision.go:143] copyHostCerts
I0717 19:23:02.987780 452176 exec_runner.go:144] found /home/jenkins/minikube-integration/19282-392903/.minikube/ca.pem, removing ...
I0717 19:23:02.987793 452176 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19282-392903/.minikube/ca.pem
I0717 19:23:02.987887 452176 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19282-392903/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19282-392903/.minikube/ca.pem (1078 bytes)
I0717 19:23:02.988006 452176 exec_runner.go:144] found /home/jenkins/minikube-integration/19282-392903/.minikube/cert.pem, removing ...
I0717 19:23:02.988017 452176 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19282-392903/.minikube/cert.pem
I0717 19:23:02.988054 452176 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19282-392903/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19282-392903/.minikube/cert.pem (1123 bytes)
I0717 19:23:02.988126 452176 exec_runner.go:144] found /home/jenkins/minikube-integration/19282-392903/.minikube/key.pem, removing ...
I0717 19:23:02.988137 452176 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19282-392903/.minikube/key.pem
I0717 19:23:02.988168 452176 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19282-392903/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19282-392903/.minikube/key.pem (1675 bytes)
I0717 19:23:02.988319 452176 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19282-392903/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19282-392903/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19282-392903/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-998147 san=[127.0.0.1 192.168.72.208 localhost minikube old-k8s-version-998147]
I0717 19:23:03.159241 452176 provision.go:177] copyRemoteCerts
I0717 19:23:03.159309 452176 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0717 19:23:03.159341 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHHostname
I0717 19:23:03.163074 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.163490 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:old-k8s-version-998147 Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:03.163525 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.163753 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHPort
I0717 19:23:03.163927 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHKeyPath
I0717 19:23:03.164022 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHUsername
I0717 19:23:03.164188 452176 sshutil.go:53] new ssh client: &{IP:192.168.72.208 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19282-392903/.minikube/machines/old-k8s-version-998147/id_rsa Username:docker}
I0717 19:23:03.251519 452176 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-392903/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0717 19:23:03.281767 452176 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-392903/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0717 19:23:03.308820 452176 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-392903/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0717 19:23:03.337927 452176 provision.go:87] duration metric: took 357.576357ms to configureAuth
I0717 19:23:03.337958 452176 buildroot.go:189] setting minikube options for container-runtime
I0717 19:23:03.338167 452176 config.go:182] Loaded profile config "old-k8s-version-998147": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0717 19:23:03.338281 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHHostname
I0717 19:23:03.341386 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.341760 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:old-k8s-version-998147 Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:03.341797 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.341939 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHPort
I0717 19:23:03.342194 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHKeyPath
I0717 19:23:03.342385 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHKeyPath
I0717 19:23:03.342519 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHUsername
I0717 19:23:03.342680 452176 main.go:141] libmachine: Using SSH client type: native
I0717 19:23:03.342871 452176 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.72.208 22 <nil> <nil>}
I0717 19:23:03.342889 452176 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0717 19:23:03.639325 452176 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0717 19:23:03.639360 452176 main.go:141] libmachine: Checking connection to Docker...
I0717 19:23:03.639372 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetURL
I0717 19:23:03.640972 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | Using libvirt version 6000000
I0717 19:23:03.643621 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.644032 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:old-k8s-version-998147 Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:03.644059 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.644263 452176 main.go:141] libmachine: Docker is up and running!
I0717 19:23:03.644276 452176 main.go:141] libmachine: Reticulating splines...
I0717 19:23:03.644285 452176 client.go:171] duration metric: took 26.45123827s to LocalClient.Create
I0717 19:23:03.644312 452176 start.go:167] duration metric: took 26.451322363s to libmachine.API.Create "old-k8s-version-998147"
I0717 19:23:03.644341 452176 start.go:293] postStartSetup for "old-k8s-version-998147" (driver="kvm2")
I0717 19:23:03.644357 452176 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0717 19:23:03.644381 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .DriverName
I0717 19:23:03.644643 452176 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0717 19:23:03.644671 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHHostname
I0717 19:23:03.647443 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.647868 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:old-k8s-version-998147 Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:03.647900 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.648070 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHPort
I0717 19:23:03.648239 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHKeyPath
I0717 19:23:03.648401 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHUsername
I0717 19:23:03.648575 452176 sshutil.go:53] new ssh client: &{IP:192.168.72.208 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19282-392903/.minikube/machines/old-k8s-version-998147/id_rsa Username:docker}
I0717 19:23:03.734941 452176 ssh_runner.go:195] Run: cat /etc/os-release
I0717 19:23:03.740647 452176 info.go:137] Remote host: Buildroot 2023.02.9
I0717 19:23:03.740670 452176 filesync.go:126] Scanning /home/jenkins/minikube-integration/19282-392903/.minikube/addons for local assets ...
I0717 19:23:03.740721 452176 filesync.go:126] Scanning /home/jenkins/minikube-integration/19282-392903/.minikube/files for local assets ...
I0717 19:23:03.740829 452176 filesync.go:149] local asset: /home/jenkins/minikube-integration/19282-392903/.minikube/files/etc/ssl/certs/4001712.pem -> 4001712.pem in /etc/ssl/certs
I0717 19:23:03.740948 452176 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0717 19:23:03.758577 452176 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-392903/.minikube/files/etc/ssl/certs/4001712.pem --> /etc/ssl/certs/4001712.pem (1708 bytes)
I0717 19:23:03.790798 452176 start.go:296] duration metric: took 146.44101ms for postStartSetup
I0717 19:23:03.790849 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetConfigRaw
I0717 19:23:03.791514 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetIP
I0717 19:23:03.794750 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.795302 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:old-k8s-version-998147 Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:03.795342 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.795623 452176 profile.go:143] Saving config to /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/config.json ...
I0717 19:23:03.795834 452176 start.go:128] duration metric: took 26.628680905s to createHost
I0717 19:23:03.795854 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHHostname
I0717 19:23:03.798743 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.799114 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:old-k8s-version-998147 Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:03.799145 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.799335 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHPort
I0717 19:23:03.799471 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHKeyPath
I0717 19:23:03.799650 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHKeyPath
I0717 19:23:03.799761 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHUsername
I0717 19:23:03.799923 452176 main.go:141] libmachine: Using SSH client type: native
I0717 19:23:03.800154 452176 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.72.208 22 <nil> <nil>}
I0717 19:23:03.800176 452176 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0717 19:23:03.910096 452176 main.go:141] libmachine: SSH cmd err, output: <nil>: 1721244183.893734266
I0717 19:23:03.910121 452176 fix.go:216] guest clock: 1721244183.893734266
I0717 19:23:03.910128 452176 fix.go:229] Guest: 2024-07-17 19:23:03.893734266 +0000 UTC Remote: 2024-07-17 19:23:03.795842689 +0000 UTC m=+33.702255388 (delta=97.891577ms)
I0717 19:23:03.910150 452176 fix.go:200] guest clock delta is within tolerance: 97.891577ms
I0717 19:23:03.910158 452176 start.go:83] releasing machines lock for "old-k8s-version-998147", held for 26.743223072s
I0717 19:23:03.910184 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .DriverName
I0717 19:23:03.910503 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetIP
I0717 19:23:03.913662 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.914118 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:old-k8s-version-998147 Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:03.914153 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.914328 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .DriverName
I0717 19:23:03.914952 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .DriverName
I0717 19:23:03.915170 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .DriverName
I0717 19:23:03.915274 452176 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0717 19:23:03.915322 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHHostname
I0717 19:23:03.915456 452176 ssh_runner.go:195] Run: cat /version.json
I0717 19:23:03.915485 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHHostname
I0717 19:23:03.918082 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.918458 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:old-k8s-version-998147 Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:03.918491 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.918510 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.918655 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHPort
I0717 19:23:03.918821 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHKeyPath
I0717 19:23:03.918991 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHUsername
I0717 19:23:03.919014 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:old-k8s-version-998147 Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:03.919045 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:03.919193 452176 sshutil.go:53] new ssh client: &{IP:192.168.72.208 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19282-392903/.minikube/machines/old-k8s-version-998147/id_rsa Username:docker}
I0717 19:23:03.919208 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHPort
I0717 19:23:03.919403 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHKeyPath
I0717 19:23:03.919550 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetSSHUsername
I0717 19:23:03.919696 452176 sshutil.go:53] new ssh client: &{IP:192.168.72.208 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19282-392903/.minikube/machines/old-k8s-version-998147/id_rsa Username:docker}
I0717 19:23:04.020616 452176 ssh_runner.go:195] Run: systemctl --version
I0717 19:23:04.027708 452176 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0717 19:23:04.189505 452176 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0717 19:23:04.196099 452176 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0717 19:23:04.196166 452176 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0717 19:23:04.214020 452176 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0717 19:23:04.214046 452176 start.go:495] detecting cgroup driver to use...
I0717 19:23:04.214113 452176 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0717 19:23:04.233222 452176 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0717 19:23:04.250054 452176 docker.go:217] disabling cri-docker service (if available) ...
I0717 19:23:04.250129 452176 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0717 19:23:04.265298 452176 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0717 19:23:04.283580 452176 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0717 19:23:04.418804 452176 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0717 19:23:04.606253 452176 docker.go:233] disabling docker service ...
I0717 19:23:04.606319 452176 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0717 19:23:04.624291 452176 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0717 19:23:04.644351 452176 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0717 19:23:04.812274 452176 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0717 19:23:04.962920 452176 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0717 19:23:04.977994 452176 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0717 19:23:04.998453 452176 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0717 19:23:04.998508 452176 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0717 19:23:05.009655 452176 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0717 19:23:05.009742 452176 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0717 19:23:05.020364 452176 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0717 19:23:05.032069 452176 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0717 19:23:05.043288 452176 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0717 19:23:05.055454 452176 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0717 19:23:05.065892 452176 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0717 19:23:05.065961 452176 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0717 19:23:05.080165 452176 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0717 19:23:05.091013 452176 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0717 19:23:05.232976 452176 ssh_runner.go:195] Run: sudo systemctl restart crio
I0717 19:23:05.395652 452176 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0717 19:23:05.395733 452176 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0717 19:23:05.401188 452176 start.go:563] Will wait 60s for crictl version
I0717 19:23:05.401245 452176 ssh_runner.go:195] Run: which crictl
I0717 19:23:05.405198 452176 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0717 19:23:05.452388 452176 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0717 19:23:05.452515 452176 ssh_runner.go:195] Run: crio --version
I0717 19:23:05.486588 452176 ssh_runner.go:195] Run: crio --version
I0717 19:23:05.522263 452176 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0717 19:23:05.523535 452176 main.go:141] libmachine: (old-k8s-version-998147) Calling .GetIP
I0717 19:23:05.528192 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:05.528547 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:e7:d4:91", ip: ""} in network mk-old-k8s-version-998147: {Iface:virbr4 ExpiryTime:2024-07-17 20:22:53 +0000 UTC Type:0 Mac:52:54:00:e7:d4:91 Iaid: IPaddr:192.168.72.208 Prefix:24 Hostname:old-k8s-version-998147 Clientid:01:52:54:00:e7:d4:91}
I0717 19:23:05.528608 452176 main.go:141] libmachine: (old-k8s-version-998147) DBG | domain old-k8s-version-998147 has defined IP address 192.168.72.208 and MAC address 52:54:00:e7:d4:91 in network mk-old-k8s-version-998147
I0717 19:23:05.528811 452176 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0717 19:23:05.533041 452176 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0717 19:23:05.547727 452176 kubeadm.go:883] updating cluster {Name:old-k8s-version-998147 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19264/minikube-v1.33.1-1721146474-19264-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-998147 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.208 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0717 19:23:05.547864 452176 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0717 19:23:05.547934 452176 ssh_runner.go:195] Run: sudo crictl images --output json
I0717 19:23:05.593936 452176 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0717 19:23:05.594003 452176 ssh_runner.go:195] Run: which lz4
I0717 19:23:05.598261 452176 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0717 19:23:05.602886 452176 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0717 19:23:05.602919 452176 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-392903/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0717 19:23:07.516842 452176 crio.go:462] duration metric: took 1.918606291s to copy over tarball
I0717 19:23:07.516909 452176 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0717 19:23:10.828986 452176 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.312039341s)
I0717 19:23:10.829025 452176 crio.go:469] duration metric: took 3.312151422s to extract the tarball
I0717 19:23:10.829036 452176 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0717 19:23:10.880965 452176 ssh_runner.go:195] Run: sudo crictl images --output json
I0717 19:23:10.967624 452176 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0717 19:23:10.967651 452176 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0717 19:23:10.967712 452176 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0717 19:23:10.967985 452176 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0717 19:23:10.968006 452176 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0717 19:23:10.968124 452176 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0717 19:23:10.968208 452176 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0717 19:23:10.968223 452176 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0717 19:23:10.967987 452176 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0717 19:23:10.968360 452176 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0717 19:23:10.970710 452176 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0717 19:23:10.970731 452176 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0717 19:23:10.970796 452176 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0717 19:23:10.970828 452176 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0717 19:23:10.970969 452176 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0717 19:23:10.971106 452176 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0717 19:23:10.971453 452176 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0717 19:23:10.972287 452176 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0717 19:23:11.118394 452176 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0717 19:23:11.118565 452176 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0717 19:23:11.144818 452176 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0717 19:23:11.154178 452176 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0717 19:23:11.162455 452176 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0717 19:23:11.200524 452176 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0717 19:23:11.240721 452176 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0717 19:23:11.240779 452176 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0717 19:23:11.240823 452176 ssh_runner.go:195] Run: which crictl
I0717 19:23:11.254765 452176 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0717 19:23:11.254814 452176 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0717 19:23:11.254864 452176 ssh_runner.go:195] Run: which crictl
I0717 19:23:11.317691 452176 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0717 19:23:11.353690 452176 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0717 19:23:11.353751 452176 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0717 19:23:11.353805 452176 ssh_runner.go:195] Run: which crictl
I0717 19:23:11.353925 452176 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0717 19:23:11.353954 452176 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0717 19:23:11.353993 452176 ssh_runner.go:195] Run: which crictl
I0717 19:23:11.360860 452176 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0717 19:23:11.360903 452176 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0717 19:23:11.360915 452176 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0717 19:23:11.360931 452176 ssh_runner.go:195] Run: which crictl
I0717 19:23:11.360934 452176 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0717 19:23:11.360965 452176 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0717 19:23:11.360994 452176 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0717 19:23:11.360996 452176 ssh_runner.go:195] Run: which crictl
I0717 19:23:11.453059 452176 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0717 19:23:11.453111 452176 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0717 19:23:11.453161 452176 ssh_runner.go:195] Run: which crictl
I0717 19:23:11.453254 452176 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0717 19:23:11.453318 452176 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0717 19:23:11.456790 452176 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19282-392903/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0717 19:23:11.456886 452176 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0717 19:23:11.457011 452176 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19282-392903/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0717 19:23:11.457063 452176 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0717 19:23:11.580303 452176 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0717 19:23:11.580444 452176 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19282-392903/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0717 19:23:11.580667 452176 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19282-392903/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0717 19:23:11.581177 452176 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19282-392903/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0717 19:23:11.581239 452176 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19282-392903/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0717 19:23:11.616880 452176 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19282-392903/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0717 19:23:11.862454 452176 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0717 19:23:12.010998 452176 cache_images.go:92] duration metric: took 1.043318926s to LoadCachedImages
W0717 19:23:12.011099 452176 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19282-392903/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19282-392903/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
I0717 19:23:12.011116 452176 kubeadm.go:934] updating node { 192.168.72.208 8443 v1.20.0 crio true true} ...
I0717 19:23:12.011242 452176 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-998147 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.208
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-998147 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0717 19:23:12.011329 452176 ssh_runner.go:195] Run: crio config
I0717 19:23:12.081477 452176 cni.go:84] Creating CNI manager for ""
I0717 19:23:12.081505 452176 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0717 19:23:12.081524 452176 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0717 19:23:12.081558 452176 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.208 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-998147 NodeName:old-k8s-version-998147 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.208"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.208 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0717 19:23:12.081811 452176 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.208
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-998147"
kubeletExtraArgs:
node-ip: 192.168.72.208
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.208"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0717 19:23:12.081883 452176 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0717 19:23:12.096307 452176 binaries.go:44] Found k8s binaries, skipping transfer
I0717 19:23:12.096402 452176 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0717 19:23:12.110407 452176 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0717 19:23:12.133777 452176 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0717 19:23:12.164222 452176 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0717 19:23:12.187983 452176 ssh_runner.go:195] Run: grep 192.168.72.208 control-plane.minikube.internal$ /etc/hosts
I0717 19:23:12.193571 452176 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.208 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0717 19:23:12.209617 452176 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0717 19:23:12.346441 452176 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0717 19:23:12.372802 452176 certs.go:68] Setting up /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147 for IP: 192.168.72.208
I0717 19:23:12.372844 452176 certs.go:194] generating shared ca certs ...
I0717 19:23:12.372868 452176 certs.go:226] acquiring lock for ca certs: {Name:mkdc95c9e649ed1b684161ab382abd0c6d5d829f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 19:23:12.373075 452176 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19282-392903/.minikube/ca.key
I0717 19:23:12.373143 452176 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19282-392903/.minikube/proxy-client-ca.key
I0717 19:23:12.373159 452176 certs.go:256] generating profile certs ...
I0717 19:23:12.373233 452176 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/client.key
I0717 19:23:12.373256 452176 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/client.crt with IP's: []
I0717 19:23:12.592867 452176 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/client.crt ...
I0717 19:23:12.592961 452176 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/client.crt: {Name:mkbe0245e3861d1e14d58e9fd743c35135897064 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 19:23:12.593177 452176 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/client.key ...
I0717 19:23:12.593234 452176 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/client.key: {Name:mkbdc5b8053b0739d98dea1ad2f1ed02a94695b2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 19:23:12.593413 452176 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/apiserver.key.204e9011
I0717 19:23:12.593478 452176 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/apiserver.crt.204e9011 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.208]
I0717 19:23:12.941214 452176 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/apiserver.crt.204e9011 ...
I0717 19:23:12.941248 452176 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/apiserver.crt.204e9011: {Name:mk0fb64699a442709392fff0028a7b1c79a7580d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 19:23:12.941427 452176 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/apiserver.key.204e9011 ...
I0717 19:23:12.941446 452176 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/apiserver.key.204e9011: {Name:mk3c6f46b7dc1ddf92153ca473d8878b789b9fd9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 19:23:12.941543 452176 certs.go:381] copying /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/apiserver.crt.204e9011 -> /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/apiserver.crt
I0717 19:23:12.941623 452176 certs.go:385] copying /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/apiserver.key.204e9011 -> /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/apiserver.key
I0717 19:23:12.941675 452176 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/proxy-client.key
I0717 19:23:12.941739 452176 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/proxy-client.crt with IP's: []
I0717 19:23:13.157680 452176 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/proxy-client.crt ...
I0717 19:23:13.157710 452176 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/proxy-client.crt: {Name:mk59c30fd271251caf64e13b2de9f8ec92fe558b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 19:23:13.157862 452176 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/proxy-client.key ...
I0717 19:23:13.157875 452176 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/proxy-client.key: {Name:mkc3c2c88a19cadb7816dd957d2794ad16ee10fd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 19:23:13.158049 452176 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-392903/.minikube/certs/400171.pem (1338 bytes)
W0717 19:23:13.158091 452176 certs.go:480] ignoring /home/jenkins/minikube-integration/19282-392903/.minikube/certs/400171_empty.pem, impossibly tiny 0 bytes
I0717 19:23:13.158100 452176 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-392903/.minikube/certs/ca-key.pem (1679 bytes)
I0717 19:23:13.158119 452176 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-392903/.minikube/certs/ca.pem (1078 bytes)
I0717 19:23:13.158141 452176 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-392903/.minikube/certs/cert.pem (1123 bytes)
I0717 19:23:13.158165 452176 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-392903/.minikube/certs/key.pem (1675 bytes)
I0717 19:23:13.158210 452176 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-392903/.minikube/files/etc/ssl/certs/4001712.pem (1708 bytes)
I0717 19:23:13.158839 452176 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-392903/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0717 19:23:13.197332 452176 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-392903/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0717 19:23:13.243629 452176 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-392903/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0717 19:23:13.273706 452176 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-392903/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0717 19:23:13.309708 452176 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0717 19:23:13.351233 452176 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0717 19:23:13.395869 452176 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0717 19:23:13.441449 452176 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-392903/.minikube/profiles/old-k8s-version-998147/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0717 19:23:13.468863 452176 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-392903/.minikube/certs/400171.pem --> /usr/share/ca-certificates/400171.pem (1338 bytes)
I0717 19:23:13.498473 452176 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-392903/.minikube/files/etc/ssl/certs/4001712.pem --> /usr/share/ca-certificates/4001712.pem (1708 bytes)
I0717 19:23:13.531412 452176 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-392903/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0717 19:23:13.561623 452176 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0717 19:23:13.584776 452176 ssh_runner.go:195] Run: openssl version
I0717 19:23:13.591453 452176 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/400171.pem && ln -fs /usr/share/ca-certificates/400171.pem /etc/ssl/certs/400171.pem"
I0717 19:23:13.604336 452176 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/400171.pem
I0717 19:23:13.609309 452176 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 17 18:17 /usr/share/ca-certificates/400171.pem
I0717 19:23:13.609370 452176 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/400171.pem
I0717 19:23:13.615684 452176 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/400171.pem /etc/ssl/certs/51391683.0"
I0717 19:23:13.628563 452176 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4001712.pem && ln -fs /usr/share/ca-certificates/4001712.pem /etc/ssl/certs/4001712.pem"
I0717 19:23:13.647169 452176 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/4001712.pem
I0717 19:23:13.653915 452176 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 17 18:17 /usr/share/ca-certificates/4001712.pem
I0717 19:23:13.653980 452176 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4001712.pem
I0717 19:23:13.662049 452176 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/4001712.pem /etc/ssl/certs/3ec20f2e.0"
I0717 19:23:13.675581 452176 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0717 19:23:13.687580 452176 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0717 19:23:13.692704 452176 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 17 18:04 /usr/share/ca-certificates/minikubeCA.pem
I0717 19:23:13.692769 452176 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0717 19:23:13.699389 452176 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0717 19:23:13.712679 452176 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0717 19:23:13.718890 452176 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0717 19:23:13.718962 452176 kubeadm.go:392] StartCluster: {Name:old-k8s-version-998147 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19264/minikube-v1.33.1-1721146474-19264-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-998147 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.208 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0717 19:23:13.719072 452176 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0717 19:23:13.719135 452176 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0717 19:23:13.764734 452176 cri.go:89] found id: ""
I0717 19:23:13.764815 452176 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0717 19:23:13.782851 452176 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0717 19:23:13.797231 452176 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0717 19:23:13.819920 452176 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0717 19:23:13.819945 452176 kubeadm.go:157] found existing configuration files:
I0717 19:23:13.819993 452176 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0717 19:23:13.833824 452176 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0717 19:23:13.833894 452176 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0717 19:23:13.846603 452176 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0717 19:23:13.858765 452176 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0717 19:23:13.858835 452176 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0717 19:23:13.871740 452176 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0717 19:23:13.885738 452176 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0717 19:23:13.885801 452176 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0717 19:23:13.902981 452176 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0717 19:23:13.926797 452176 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0717 19:23:13.926891 452176 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0717 19:23:13.943681 452176 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0717 19:23:14.104872 452176 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0717 19:23:14.105846 452176 kubeadm.go:310] [preflight] Running pre-flight checks
I0717 19:23:14.341937 452176 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0717 19:23:14.342077 452176 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0717 19:23:14.342186 452176 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0717 19:23:14.582453 452176 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0717 19:23:14.584915 452176 out.go:204] - Generating certificates and keys ...
I0717 19:23:14.585028 452176 kubeadm.go:310] [certs] Using existing ca certificate authority
I0717 19:23:14.585113 452176 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0717 19:23:14.703724 452176 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0717 19:23:14.855900 452176 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0717 19:23:14.943638 452176 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0717 19:23:15.131095 452176 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0717 19:23:15.575926 452176 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0717 19:23:15.583269 452176 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-998147] and IPs [192.168.72.208 127.0.0.1 ::1]
I0717 19:23:16.062255 452176 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0717 19:23:16.062689 452176 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-998147] and IPs [192.168.72.208 127.0.0.1 ::1]
I0717 19:23:16.133592 452176 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0717 19:23:16.367843 452176 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0717 19:23:16.448469 452176 kubeadm.go:310] [certs] Generating "sa" key and public key
I0717 19:23:16.448854 452176 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0717 19:23:16.621887 452176 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0717 19:23:17.006243 452176 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0717 19:23:17.565402 452176 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0717 19:23:17.738583 452176 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0717 19:23:17.761231 452176 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0717 19:23:17.762907 452176 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0717 19:23:17.762984 452176 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0717 19:23:17.936404 452176 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0717 19:23:17.938418 452176 out.go:204] - Booting up control plane ...
I0717 19:23:17.938541 452176 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0717 19:23:17.952476 452176 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0717 19:23:17.954959 452176 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0717 19:23:17.956338 452176 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0717 19:23:17.960930 452176 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0717 19:23:57.959202 452176 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0717 19:23:57.959779 452176 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 19:23:57.959954 452176 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 19:24:02.960288 452176 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 19:24:02.960689 452176 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 19:24:12.961021 452176 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 19:24:12.961227 452176 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 19:24:32.962004 452176 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 19:24:32.962269 452176 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 19:25:12.962518 452176 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 19:25:12.963008 452176 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 19:25:12.963040 452176 kubeadm.go:310]
I0717 19:25:12.963121 452176 kubeadm.go:310] Unfortunately, an error has occurred:
I0717 19:25:12.963205 452176 kubeadm.go:310] timed out waiting for the condition
I0717 19:25:12.963215 452176 kubeadm.go:310]
I0717 19:25:12.963288 452176 kubeadm.go:310] This error is likely caused by:
I0717 19:25:12.963400 452176 kubeadm.go:310] - The kubelet is not running
I0717 19:25:12.963669 452176 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0717 19:25:12.963692 452176 kubeadm.go:310]
I0717 19:25:12.963955 452176 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0717 19:25:12.964065 452176 kubeadm.go:310] - 'systemctl status kubelet'
I0717 19:25:12.964153 452176 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0717 19:25:12.964165 452176 kubeadm.go:310]
I0717 19:25:12.964415 452176 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0717 19:25:12.964663 452176 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0717 19:25:12.964692 452176 kubeadm.go:310]
I0717 19:25:12.964909 452176 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0717 19:25:12.965448 452176 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0717 19:25:12.965939 452176 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0717 19:25:12.966060 452176 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0717 19:25:12.966084 452176 kubeadm.go:310]
I0717 19:25:12.966222 452176 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0717 19:25:12.966332 452176 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0717 19:25:12.966434 452176 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0717 19:25:12.966582 452176 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-998147] and IPs [192.168.72.208 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-998147] and IPs [192.168.72.208 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-998147] and IPs [192.168.72.208 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-998147] and IPs [192.168.72.208 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0717 19:25:12.966650 452176 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0717 19:25:13.453836 452176 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0717 19:25:13.474931 452176 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0717 19:25:13.488822 452176 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0717 19:25:13.488847 452176 kubeadm.go:157] found existing configuration files:
I0717 19:25:13.488912 452176 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0717 19:25:13.502382 452176 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0717 19:25:13.502446 452176 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0717 19:25:13.515349 452176 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0717 19:25:13.525516 452176 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0717 19:25:13.525615 452176 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0717 19:25:13.537550 452176 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0717 19:25:13.547408 452176 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0717 19:25:13.547483 452176 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0717 19:25:13.559485 452176 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0717 19:25:13.571187 452176 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0717 19:25:13.571319 452176 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0717 19:25:13.583243 452176 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0717 19:25:13.829988 452176 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0717 19:27:09.879929 452176 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0717 19:27:09.880046 452176 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0717 19:27:09.881756 452176 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0717 19:27:09.881832 452176 kubeadm.go:310] [preflight] Running pre-flight checks
I0717 19:27:09.881930 452176 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0717 19:27:09.882058 452176 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0717 19:27:09.882203 452176 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0717 19:27:09.882302 452176 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0717 19:27:09.884099 452176 out.go:204] - Generating certificates and keys ...
I0717 19:27:09.884207 452176 kubeadm.go:310] [certs] Using existing ca certificate authority
I0717 19:27:09.884274 452176 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0717 19:27:09.884362 452176 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0717 19:27:09.884448 452176 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0717 19:27:09.884565 452176 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0717 19:27:09.884677 452176 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0717 19:27:09.884782 452176 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0717 19:27:09.884878 452176 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0717 19:27:09.884994 452176 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0717 19:27:09.885123 452176 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0717 19:27:09.885175 452176 kubeadm.go:310] [certs] Using the existing "sa" key
I0717 19:27:09.885253 452176 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0717 19:27:09.885319 452176 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0717 19:27:09.885391 452176 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0717 19:27:09.885475 452176 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0717 19:27:09.885554 452176 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0717 19:27:09.885676 452176 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0717 19:27:09.885775 452176 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0717 19:27:09.885812 452176 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0717 19:27:09.885902 452176 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0717 19:27:09.887410 452176 out.go:204] - Booting up control plane ...
I0717 19:27:09.887500 452176 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0717 19:27:09.887581 452176 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0717 19:27:09.887646 452176 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0717 19:27:09.887747 452176 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0717 19:27:09.887982 452176 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0717 19:27:09.888044 452176 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0717 19:27:09.888120 452176 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 19:27:09.888286 452176 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 19:27:09.888353 452176 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 19:27:09.888580 452176 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 19:27:09.888678 452176 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 19:27:09.888871 452176 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 19:27:09.888946 452176 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 19:27:09.889114 452176 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 19:27:09.889176 452176 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 19:27:09.889329 452176 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 19:27:09.889337 452176 kubeadm.go:310]
I0717 19:27:09.889390 452176 kubeadm.go:310] Unfortunately, an error has occurred:
I0717 19:27:09.889450 452176 kubeadm.go:310] timed out waiting for the condition
I0717 19:27:09.889457 452176 kubeadm.go:310]
I0717 19:27:09.889485 452176 kubeadm.go:310] This error is likely caused by:
I0717 19:27:09.889514 452176 kubeadm.go:310] - The kubelet is not running
I0717 19:27:09.889608 452176 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0717 19:27:09.889617 452176 kubeadm.go:310]
I0717 19:27:09.889711 452176 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0717 19:27:09.889746 452176 kubeadm.go:310] - 'systemctl status kubelet'
I0717 19:27:09.889774 452176 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0717 19:27:09.889780 452176 kubeadm.go:310]
I0717 19:27:09.889899 452176 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0717 19:27:09.890004 452176 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0717 19:27:09.890015 452176 kubeadm.go:310]
I0717 19:27:09.890191 452176 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0717 19:27:09.890307 452176 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0717 19:27:09.890406 452176 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0717 19:27:09.890502 452176 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0717 19:27:09.890580 452176 kubeadm.go:310]
I0717 19:27:09.890593 452176 kubeadm.go:394] duration metric: took 3m56.171637144s to StartCluster
I0717 19:27:09.890671 452176 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0717 19:27:09.890756 452176 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0717 19:27:09.941699 452176 cri.go:89] found id: ""
I0717 19:27:09.941732 452176 logs.go:276] 0 containers: []
W0717 19:27:09.941741 452176 logs.go:278] No container was found matching "kube-apiserver"
I0717 19:27:09.941747 452176 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0717 19:27:09.941818 452176 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0717 19:27:09.977692 452176 cri.go:89] found id: ""
I0717 19:27:09.977732 452176 logs.go:276] 0 containers: []
W0717 19:27:09.977745 452176 logs.go:278] No container was found matching "etcd"
I0717 19:27:09.977753 452176 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0717 19:27:09.977825 452176 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0717 19:27:10.013209 452176 cri.go:89] found id: ""
I0717 19:27:10.013242 452176 logs.go:276] 0 containers: []
W0717 19:27:10.013250 452176 logs.go:278] No container was found matching "coredns"
I0717 19:27:10.013257 452176 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0717 19:27:10.013310 452176 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0717 19:27:10.048264 452176 cri.go:89] found id: ""
I0717 19:27:10.048292 452176 logs.go:276] 0 containers: []
W0717 19:27:10.048303 452176 logs.go:278] No container was found matching "kube-scheduler"
I0717 19:27:10.048311 452176 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0717 19:27:10.048370 452176 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0717 19:27:10.081450 452176 cri.go:89] found id: ""
I0717 19:27:10.081498 452176 logs.go:276] 0 containers: []
W0717 19:27:10.081511 452176 logs.go:278] No container was found matching "kube-proxy"
I0717 19:27:10.081518 452176 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0717 19:27:10.081598 452176 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0717 19:27:10.113913 452176 cri.go:89] found id: ""
I0717 19:27:10.113945 452176 logs.go:276] 0 containers: []
W0717 19:27:10.113957 452176 logs.go:278] No container was found matching "kube-controller-manager"
I0717 19:27:10.113966 452176 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0717 19:27:10.114039 452176 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0717 19:27:10.150115 452176 cri.go:89] found id: ""
I0717 19:27:10.150156 452176 logs.go:276] 0 containers: []
W0717 19:27:10.150169 452176 logs.go:278] No container was found matching "kindnet"
I0717 19:27:10.150184 452176 logs.go:123] Gathering logs for describe nodes ...
I0717 19:27:10.150202 452176 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0717 19:27:10.274170 452176 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0717 19:27:10.274198 452176 logs.go:123] Gathering logs for CRI-O ...
I0717 19:27:10.274211 452176 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0717 19:27:10.377449 452176 logs.go:123] Gathering logs for container status ...
I0717 19:27:10.377491 452176 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0717 19:27:10.419598 452176 logs.go:123] Gathering logs for kubelet ...
I0717 19:27:10.419632 452176 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0717 19:27:10.472151 452176 logs.go:123] Gathering logs for dmesg ...
I0717 19:27:10.472200 452176 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
W0717 19:27:10.486331 452176 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0717 19:27:10.486383 452176 out.go:239] *
*
W0717 19:27:10.486439 452176 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0717 19:27:10.486461 452176 out.go:239] *
*
W0717 19:27:10.487275 452176 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0717 19:27:10.490819 452176 out.go:177]
W0717 19:27:10.492087 452176 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0717 19:27:10.492143 452176 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0717 19:27:10.492161 452176 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0717 19:27:10.493554 452176 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-998147 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-998147 -n old-k8s-version-998147
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-998147 -n old-k8s-version-998147: exit status 6 (221.390034ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0717 19:27:10.765025 458592 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-998147" does not appear in /home/jenkins/minikube-integration/19282-392903/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-998147" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (280.69s)