=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-254968 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.16.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-254968 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.16.0: exit status 109 (4m54.849132924s)
-- stdout --
* [old-k8s-version-254968] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18063
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18063-309085/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18063-309085/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting control plane node old-k8s-version-254968 in cluster old-k8s-version-254968
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.16.0 on containerd 1.7.11 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0229 02:07:41.704977 352939 out.go:291] Setting OutFile to fd 1 ...
I0229 02:07:41.705079 352939 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0229 02:07:41.705083 352939 out.go:304] Setting ErrFile to fd 2...
I0229 02:07:41.705088 352939 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0229 02:07:41.705296 352939 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18063-309085/.minikube/bin
I0229 02:07:41.708079 352939 out.go:298] Setting JSON to false
I0229 02:07:41.709089 352939 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-11","uptime":6606,"bootTime":1709165856,"procs":220,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0229 02:07:41.709157 352939 start.go:139] virtualization: kvm guest
I0229 02:07:41.711142 352939 out.go:177] * [old-k8s-version-254968] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0229 02:07:41.713258 352939 out.go:177] - MINIKUBE_LOCATION=18063
I0229 02:07:41.713319 352939 notify.go:220] Checking for updates...
I0229 02:07:41.714891 352939 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0229 02:07:41.717194 352939 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18063-309085/kubeconfig
I0229 02:07:41.718806 352939 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18063-309085/.minikube
I0229 02:07:41.720205 352939 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0229 02:07:41.721848 352939 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0229 02:07:41.723657 352939 config.go:182] Loaded profile config "bridge-704272": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.28.4
I0229 02:07:41.723776 352939 config.go:182] Loaded profile config "enable-default-cni-704272": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.28.4
I0229 02:07:41.723871 352939 config.go:182] Loaded profile config "flannel-704272": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.28.4
I0229 02:07:41.723997 352939 driver.go:392] Setting default libvirt URI to qemu:///system
I0229 02:07:41.768138 352939 out.go:177] * Using the kvm2 driver based on user configuration
I0229 02:07:41.770197 352939 start.go:299] selected driver: kvm2
I0229 02:07:41.770219 352939 start.go:903] validating driver "kvm2" against <nil>
I0229 02:07:41.770237 352939 start.go:914] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0229 02:07:41.771290 352939 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0229 02:07:41.771410 352939 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18063-309085/.minikube/bin:/home/jenkins/workspace/KVM_Linux_containerd_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0229 02:07:41.788009 352939 install.go:137] /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0229 02:07:41.788080 352939 start_flags.go:309] no existing cluster config was found, will generate one from the flags
I0229 02:07:41.788388 352939 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0229 02:07:41.788483 352939 cni.go:84] Creating CNI manager for ""
I0229 02:07:41.788500 352939 cni.go:146] "kvm2" driver + "containerd" runtime found, recommending bridge
I0229 02:07:41.788512 352939 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0229 02:07:41.788524 352939 start_flags.go:323] config:
{Name:old-k8s-version-254968 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-254968 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR
untime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0229 02:07:41.788719 352939 iso.go:125] acquiring lock: {Name:mk1a6013324bd96d611c2de882ca0af6f4df38f8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0229 02:07:41.791730 352939 out.go:177] * Starting control plane node old-k8s-version-254968 in cluster old-k8s-version-254968
I0229 02:07:41.793140 352939 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
I0229 02:07:41.793192 352939 preload.go:148] Found local preload: /home/jenkins/minikube-integration/18063-309085/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4
I0229 02:07:41.793215 352939 cache.go:56] Caching tarball of preloaded images
I0229 02:07:41.793328 352939 preload.go:174] Found /home/jenkins/minikube-integration/18063-309085/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
I0229 02:07:41.793343 352939 cache.go:59] Finished verifying existence of preloaded tar for v1.16.0 on containerd
I0229 02:07:41.793481 352939 profile.go:148] Saving config to /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/config.json ...
I0229 02:07:41.793509 352939 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/config.json: {Name:mkbb8358306f40bb862484a128b4ae01d75bf612 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 02:07:41.793672 352939 start.go:365] acquiring machines lock for old-k8s-version-254968: {Name:mk8de78527e9cb979575b614e5d893b33768243a Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0229 02:08:01.007634 352939 start.go:369] acquired machines lock for "old-k8s-version-254968" in 19.213930262s
I0229 02:08:01.007711 352939 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-254968 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-254968 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0229 02:08:01.007845 352939 start.go:125] createHost starting for "" (driver="kvm2")
I0229 02:08:01.009643 352939 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0229 02:08:01.009936 352939 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0229 02:08:01.009998 352939 main.go:141] libmachine: Launching plugin server for driver kvm2
I0229 02:08:01.030363 352939 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40987
I0229 02:08:01.030834 352939 main.go:141] libmachine: () Calling .GetVersion
I0229 02:08:01.031403 352939 main.go:141] libmachine: Using API Version 1
I0229 02:08:01.031424 352939 main.go:141] libmachine: () Calling .SetConfigRaw
I0229 02:08:01.031889 352939 main.go:141] libmachine: () Calling .GetMachineName
I0229 02:08:01.032130 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetMachineName
I0229 02:08:01.032294 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .DriverName
I0229 02:08:01.032447 352939 start.go:159] libmachine.API.Create for "old-k8s-version-254968" (driver="kvm2")
I0229 02:08:01.032477 352939 client.go:168] LocalClient.Create starting
I0229 02:08:01.032512 352939 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18063-309085/.minikube/certs/ca.pem
I0229 02:08:01.032552 352939 main.go:141] libmachine: Decoding PEM data...
I0229 02:08:01.032572 352939 main.go:141] libmachine: Parsing certificate...
I0229 02:08:01.032654 352939 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18063-309085/.minikube/certs/cert.pem
I0229 02:08:01.032687 352939 main.go:141] libmachine: Decoding PEM data...
I0229 02:08:01.032705 352939 main.go:141] libmachine: Parsing certificate...
I0229 02:08:01.032729 352939 main.go:141] libmachine: Running pre-create checks...
I0229 02:08:01.032745 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .PreCreateCheck
I0229 02:08:01.033115 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetConfigRaw
I0229 02:08:01.033546 352939 main.go:141] libmachine: Creating machine...
I0229 02:08:01.033563 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .Create
I0229 02:08:01.033677 352939 main.go:141] libmachine: (old-k8s-version-254968) Creating KVM machine...
I0229 02:08:01.034917 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found existing default KVM network
I0229 02:08:01.036635 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:01.036471 353079 network.go:212] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:50:0f:69} reservation:<nil>}
I0229 02:08:01.037812 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:01.037723 353079 network.go:207] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00028aab0}
I0229 02:08:01.042960 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | trying to create private KVM network mk-old-k8s-version-254968 192.168.50.0/24...
I0229 02:08:01.118662 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | private KVM network mk-old-k8s-version-254968 192.168.50.0/24 created
I0229 02:08:01.118718 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:01.118614 353079 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18063-309085/.minikube
I0229 02:08:01.118737 352939 main.go:141] libmachine: (old-k8s-version-254968) Setting up store path in /home/jenkins/minikube-integration/18063-309085/.minikube/machines/old-k8s-version-254968 ...
I0229 02:08:01.118770 352939 main.go:141] libmachine: (old-k8s-version-254968) Building disk image from file:///home/jenkins/minikube-integration/18063-309085/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso
I0229 02:08:01.118787 352939 main.go:141] libmachine: (old-k8s-version-254968) Downloading /home/jenkins/minikube-integration/18063-309085/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18063-309085/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
I0229 02:08:01.399961 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:01.399805 353079 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18063-309085/.minikube/machines/old-k8s-version-254968/id_rsa...
I0229 02:08:01.652866 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:01.652702 353079 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18063-309085/.minikube/machines/old-k8s-version-254968/old-k8s-version-254968.rawdisk...
I0229 02:08:01.652913 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Writing magic tar header
I0229 02:08:01.652934 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Writing SSH key tar header
I0229 02:08:01.652952 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:01.652859 353079 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18063-309085/.minikube/machines/old-k8s-version-254968 ...
I0229 02:08:01.653059 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18063-309085/.minikube/machines/old-k8s-version-254968
I0229 02:08:01.653095 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18063-309085/.minikube/machines
I0229 02:08:01.653120 352939 main.go:141] libmachine: (old-k8s-version-254968) Setting executable bit set on /home/jenkins/minikube-integration/18063-309085/.minikube/machines/old-k8s-version-254968 (perms=drwx------)
I0229 02:08:01.653142 352939 main.go:141] libmachine: (old-k8s-version-254968) Setting executable bit set on /home/jenkins/minikube-integration/18063-309085/.minikube/machines (perms=drwxr-xr-x)
I0229 02:08:01.653155 352939 main.go:141] libmachine: (old-k8s-version-254968) Setting executable bit set on /home/jenkins/minikube-integration/18063-309085/.minikube (perms=drwxr-xr-x)
I0229 02:08:01.653171 352939 main.go:141] libmachine: (old-k8s-version-254968) Setting executable bit set on /home/jenkins/minikube-integration/18063-309085 (perms=drwxrwxr-x)
I0229 02:08:01.653183 352939 main.go:141] libmachine: (old-k8s-version-254968) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0229 02:08:01.653205 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18063-309085/.minikube
I0229 02:08:01.653219 352939 main.go:141] libmachine: (old-k8s-version-254968) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0229 02:08:01.653236 352939 main.go:141] libmachine: (old-k8s-version-254968) Creating domain...
I0229 02:08:01.653253 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18063-309085
I0229 02:08:01.653265 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0229 02:08:01.653317 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Checking permissions on dir: /home/jenkins
I0229 02:08:01.653336 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Checking permissions on dir: /home
I0229 02:08:01.653351 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Skipping /home - not owner
I0229 02:08:01.654502 352939 main.go:141] libmachine: (old-k8s-version-254968) define libvirt domain using xml:
I0229 02:08:01.654537 352939 main.go:141] libmachine: (old-k8s-version-254968) <domain type='kvm'>
I0229 02:08:01.654547 352939 main.go:141] libmachine: (old-k8s-version-254968) <name>old-k8s-version-254968</name>
I0229 02:08:01.654556 352939 main.go:141] libmachine: (old-k8s-version-254968) <memory unit='MiB'>2200</memory>
I0229 02:08:01.654573 352939 main.go:141] libmachine: (old-k8s-version-254968) <vcpu>2</vcpu>
I0229 02:08:01.654580 352939 main.go:141] libmachine: (old-k8s-version-254968) <features>
I0229 02:08:01.654588 352939 main.go:141] libmachine: (old-k8s-version-254968) <acpi/>
I0229 02:08:01.654602 352939 main.go:141] libmachine: (old-k8s-version-254968) <apic/>
I0229 02:08:01.654609 352939 main.go:141] libmachine: (old-k8s-version-254968) <pae/>
I0229 02:08:01.654620 352939 main.go:141] libmachine: (old-k8s-version-254968)
I0229 02:08:01.654629 352939 main.go:141] libmachine: (old-k8s-version-254968) </features>
I0229 02:08:01.654637 352939 main.go:141] libmachine: (old-k8s-version-254968) <cpu mode='host-passthrough'>
I0229 02:08:01.654645 352939 main.go:141] libmachine: (old-k8s-version-254968)
I0229 02:08:01.654651 352939 main.go:141] libmachine: (old-k8s-version-254968) </cpu>
I0229 02:08:01.654659 352939 main.go:141] libmachine: (old-k8s-version-254968) <os>
I0229 02:08:01.654665 352939 main.go:141] libmachine: (old-k8s-version-254968) <type>hvm</type>
I0229 02:08:01.654673 352939 main.go:141] libmachine: (old-k8s-version-254968) <boot dev='cdrom'/>
I0229 02:08:01.654680 352939 main.go:141] libmachine: (old-k8s-version-254968) <boot dev='hd'/>
I0229 02:08:01.654710 352939 main.go:141] libmachine: (old-k8s-version-254968) <bootmenu enable='no'/>
I0229 02:08:01.654730 352939 main.go:141] libmachine: (old-k8s-version-254968) </os>
I0229 02:08:01.654741 352939 main.go:141] libmachine: (old-k8s-version-254968) <devices>
I0229 02:08:01.654759 352939 main.go:141] libmachine: (old-k8s-version-254968) <disk type='file' device='cdrom'>
I0229 02:08:01.654773 352939 main.go:141] libmachine: (old-k8s-version-254968) <source file='/home/jenkins/minikube-integration/18063-309085/.minikube/machines/old-k8s-version-254968/boot2docker.iso'/>
I0229 02:08:01.654781 352939 main.go:141] libmachine: (old-k8s-version-254968) <target dev='hdc' bus='scsi'/>
I0229 02:08:01.654790 352939 main.go:141] libmachine: (old-k8s-version-254968) <readonly/>
I0229 02:08:01.654802 352939 main.go:141] libmachine: (old-k8s-version-254968) </disk>
I0229 02:08:01.654813 352939 main.go:141] libmachine: (old-k8s-version-254968) <disk type='file' device='disk'>
I0229 02:08:01.654822 352939 main.go:141] libmachine: (old-k8s-version-254968) <driver name='qemu' type='raw' cache='default' io='threads' />
I0229 02:08:01.654837 352939 main.go:141] libmachine: (old-k8s-version-254968) <source file='/home/jenkins/minikube-integration/18063-309085/.minikube/machines/old-k8s-version-254968/old-k8s-version-254968.rawdisk'/>
I0229 02:08:01.654845 352939 main.go:141] libmachine: (old-k8s-version-254968) <target dev='hda' bus='virtio'/>
I0229 02:08:01.654852 352939 main.go:141] libmachine: (old-k8s-version-254968) </disk>
I0229 02:08:01.654860 352939 main.go:141] libmachine: (old-k8s-version-254968) <interface type='network'>
I0229 02:08:01.654884 352939 main.go:141] libmachine: (old-k8s-version-254968) <source network='mk-old-k8s-version-254968'/>
I0229 02:08:01.654906 352939 main.go:141] libmachine: (old-k8s-version-254968) <model type='virtio'/>
I0229 02:08:01.654915 352939 main.go:141] libmachine: (old-k8s-version-254968) </interface>
I0229 02:08:01.654923 352939 main.go:141] libmachine: (old-k8s-version-254968) <interface type='network'>
I0229 02:08:01.654933 352939 main.go:141] libmachine: (old-k8s-version-254968) <source network='default'/>
I0229 02:08:01.654940 352939 main.go:141] libmachine: (old-k8s-version-254968) <model type='virtio'/>
I0229 02:08:01.654951 352939 main.go:141] libmachine: (old-k8s-version-254968) </interface>
I0229 02:08:01.654962 352939 main.go:141] libmachine: (old-k8s-version-254968) <serial type='pty'>
I0229 02:08:01.654971 352939 main.go:141] libmachine: (old-k8s-version-254968) <target port='0'/>
I0229 02:08:01.654983 352939 main.go:141] libmachine: (old-k8s-version-254968) </serial>
I0229 02:08:01.654992 352939 main.go:141] libmachine: (old-k8s-version-254968) <console type='pty'>
I0229 02:08:01.654999 352939 main.go:141] libmachine: (old-k8s-version-254968) <target type='serial' port='0'/>
I0229 02:08:01.655008 352939 main.go:141] libmachine: (old-k8s-version-254968) </console>
I0229 02:08:01.655014 352939 main.go:141] libmachine: (old-k8s-version-254968) <rng model='virtio'>
I0229 02:08:01.655022 352939 main.go:141] libmachine: (old-k8s-version-254968) <backend model='random'>/dev/random</backend>
I0229 02:08:01.655028 352939 main.go:141] libmachine: (old-k8s-version-254968) </rng>
I0229 02:08:01.655034 352939 main.go:141] libmachine: (old-k8s-version-254968)
I0229 02:08:01.655041 352939 main.go:141] libmachine: (old-k8s-version-254968)
I0229 02:08:01.655048 352939 main.go:141] libmachine: (old-k8s-version-254968) </devices>
I0229 02:08:01.655055 352939 main.go:141] libmachine: (old-k8s-version-254968) </domain>
I0229 02:08:01.655064 352939 main.go:141] libmachine: (old-k8s-version-254968)
I0229 02:08:01.659142 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:86:cb:a0 in network default
I0229 02:08:01.659803 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:01.659838 352939 main.go:141] libmachine: (old-k8s-version-254968) Ensuring networks are active...
I0229 02:08:01.660669 352939 main.go:141] libmachine: (old-k8s-version-254968) Ensuring network default is active
I0229 02:08:01.661084 352939 main.go:141] libmachine: (old-k8s-version-254968) Ensuring network mk-old-k8s-version-254968 is active
I0229 02:08:01.661883 352939 main.go:141] libmachine: (old-k8s-version-254968) Getting domain xml...
I0229 02:08:01.662794 352939 main.go:141] libmachine: (old-k8s-version-254968) Creating domain...
I0229 02:08:02.924245 352939 main.go:141] libmachine: (old-k8s-version-254968) Waiting to get IP...
I0229 02:08:02.925061 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:02.925504 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find current IP address of domain old-k8s-version-254968 in network mk-old-k8s-version-254968
I0229 02:08:02.925535 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:02.925482 353079 retry.go:31] will retry after 202.899151ms: waiting for machine to come up
I0229 02:08:03.131026 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:03.131668 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find current IP address of domain old-k8s-version-254968 in network mk-old-k8s-version-254968
I0229 02:08:03.131689 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:03.131587 353079 retry.go:31] will retry after 285.750874ms: waiting for machine to come up
I0229 02:08:03.419422 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:03.420180 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find current IP address of domain old-k8s-version-254968 in network mk-old-k8s-version-254968
I0229 02:08:03.420212 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:03.420126 353079 retry.go:31] will retry after 394.913015ms: waiting for machine to come up
I0229 02:08:03.817398 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:03.818063 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find current IP address of domain old-k8s-version-254968 in network mk-old-k8s-version-254968
I0229 02:08:03.818110 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:03.817965 353079 retry.go:31] will retry after 574.028462ms: waiting for machine to come up
I0229 02:08:04.397334 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:04.400060 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find current IP address of domain old-k8s-version-254968 in network mk-old-k8s-version-254968
I0229 02:08:04.400120 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:04.400020 353079 retry.go:31] will retry after 545.023112ms: waiting for machine to come up
I0229 02:08:04.946872 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:04.947928 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find current IP address of domain old-k8s-version-254968 in network mk-old-k8s-version-254968
I0229 02:08:04.947954 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:04.947827 353079 retry.go:31] will retry after 612.076685ms: waiting for machine to come up
I0229 02:08:05.561255 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:05.562026 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find current IP address of domain old-k8s-version-254968 in network mk-old-k8s-version-254968
I0229 02:08:05.562058 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:05.561961 353079 retry.go:31] will retry after 1.148430706s: waiting for machine to come up
I0229 02:08:06.712563 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:06.713156 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find current IP address of domain old-k8s-version-254968 in network mk-old-k8s-version-254968
I0229 02:08:06.713177 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:06.713059 353079 retry.go:31] will retry after 1.283252839s: waiting for machine to come up
I0229 02:08:07.998620 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:07.999232 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find current IP address of domain old-k8s-version-254968 in network mk-old-k8s-version-254968
I0229 02:08:07.999289 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:07.999196 353079 retry.go:31] will retry after 1.637282044s: waiting for machine to come up
I0229 02:08:09.638681 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:09.639248 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find current IP address of domain old-k8s-version-254968 in network mk-old-k8s-version-254968
I0229 02:08:09.639277 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:09.639195 353079 retry.go:31] will retry after 1.926029879s: waiting for machine to come up
I0229 02:08:11.566673 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:11.567250 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find current IP address of domain old-k8s-version-254968 in network mk-old-k8s-version-254968
I0229 02:08:11.567299 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:11.567214 353079 retry.go:31] will retry after 2.907843798s: waiting for machine to come up
I0229 02:08:14.476845 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:14.477278 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find current IP address of domain old-k8s-version-254968 in network mk-old-k8s-version-254968
I0229 02:08:14.477346 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:14.477258 353079 retry.go:31] will retry after 2.540994187s: waiting for machine to come up
I0229 02:08:17.020268 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:17.020743 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find current IP address of domain old-k8s-version-254968 in network mk-old-k8s-version-254968
I0229 02:08:17.020780 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:17.020663 353079 retry.go:31] will retry after 3.229385889s: waiting for machine to come up
I0229 02:08:20.251117 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:20.251494 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find current IP address of domain old-k8s-version-254968 in network mk-old-k8s-version-254968
I0229 02:08:20.251522 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | I0229 02:08:20.251450 353079 retry.go:31] will retry after 3.98495326s: waiting for machine to come up
I0229 02:08:24.239369 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:24.239958 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has current primary IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:24.240002 352939 main.go:141] libmachine: (old-k8s-version-254968) Found IP for machine: 192.168.50.250
I0229 02:08:24.240029 352939 main.go:141] libmachine: (old-k8s-version-254968) Reserving static IP address...
I0229 02:08:24.240314 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-254968", mac: "52:54:00:7f:e3:b1", ip: "192.168.50.250"} in network mk-old-k8s-version-254968
I0229 02:08:24.322804 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Getting to WaitForSSH function...
I0229 02:08:24.322843 352939 main.go:141] libmachine: (old-k8s-version-254968) Reserved static IP address: 192.168.50.250
I0229 02:08:24.322853 352939 main.go:141] libmachine: (old-k8s-version-254968) Waiting for SSH to be available...
I0229 02:08:24.325870 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:24.326326 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968
I0229 02:08:24.326349 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | unable to find defined IP address of network mk-old-k8s-version-254968 interface with MAC address 52:54:00:7f:e3:b1
I0229 02:08:24.326591 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Using SSH client type: external
I0229 02:08:24.326616 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Using SSH private key: /home/jenkins/minikube-integration/18063-309085/.minikube/machines/old-k8s-version-254968/id_rsa (-rw-------)
I0229 02:08:24.326650 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18063-309085/.minikube/machines/old-k8s-version-254968/id_rsa -p 22] /usr/bin/ssh <nil>}
I0229 02:08:24.326668 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | About to run SSH command:
I0229 02:08:24.326682 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | exit 0
I0229 02:08:24.331214 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | SSH cmd err, output: exit status 255:
I0229 02:08:24.331239 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0229 02:08:24.331249 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | command : exit 0
I0229 02:08:24.331268 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | err : exit status 255
I0229 02:08:24.331280 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | output :
I0229 02:08:27.332331 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Getting to WaitForSSH function...
I0229 02:08:27.334829 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:27.335281 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968: {Iface:virbr2 ExpiryTime:2024-02-29 03:08:18 +0000 UTC Type:0 Mac:52:54:00:7f:e3:b1 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-254968 Clientid:01:52:54:00:7f:e3:b1}
I0229 02:08:27.335311 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:27.335488 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Using SSH client type: external
I0229 02:08:27.335511 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Using SSH private key: /home/jenkins/minikube-integration/18063-309085/.minikube/machines/old-k8s-version-254968/id_rsa (-rw-------)
I0229 02:08:27.335545 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.250 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18063-309085/.minikube/machines/old-k8s-version-254968/id_rsa -p 22] /usr/bin/ssh <nil>}
I0229 02:08:27.335563 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | About to run SSH command:
I0229 02:08:27.335579 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | exit 0
I0229 02:08:27.467072 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | SSH cmd err, output: <nil>:
I0229 02:08:27.467353 352939 main.go:141] libmachine: (old-k8s-version-254968) KVM machine creation complete!
I0229 02:08:27.467727 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetConfigRaw
I0229 02:08:27.468450 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .DriverName
I0229 02:08:27.468734 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .DriverName
I0229 02:08:27.468945 352939 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0229 02:08:27.468961 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetState
I0229 02:08:27.470445 352939 main.go:141] libmachine: Detecting operating system of created instance...
I0229 02:08:27.470461 352939 main.go:141] libmachine: Waiting for SSH to be available...
I0229 02:08:27.470466 352939 main.go:141] libmachine: Getting to WaitForSSH function...
I0229 02:08:27.470472 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHHostname
I0229 02:08:27.473121 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:27.473551 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968: {Iface:virbr2 ExpiryTime:2024-02-29 03:08:18 +0000 UTC Type:0 Mac:52:54:00:7f:e3:b1 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-254968 Clientid:01:52:54:00:7f:e3:b1}
I0229 02:08:27.473593 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:27.473758 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHPort
I0229 02:08:27.474003 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHKeyPath
I0229 02:08:27.474212 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHKeyPath
I0229 02:08:27.474410 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHUsername
I0229 02:08:27.474603 352939 main.go:141] libmachine: Using SSH client type: native
I0229 02:08:27.474862 352939 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.50.250 22 <nil> <nil>}
I0229 02:08:27.474881 352939 main.go:141] libmachine: About to run SSH command:
exit 0
I0229 02:08:27.602050 352939 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0229 02:08:27.602074 352939 main.go:141] libmachine: Detecting the provisioner...
I0229 02:08:27.602107 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHHostname
I0229 02:08:27.607626 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:27.608041 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968: {Iface:virbr2 ExpiryTime:2024-02-29 03:08:18 +0000 UTC Type:0 Mac:52:54:00:7f:e3:b1 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-254968 Clientid:01:52:54:00:7f:e3:b1}
I0229 02:08:27.608100 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:27.608226 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHPort
I0229 02:08:27.608397 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHKeyPath
I0229 02:08:27.608568 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHKeyPath
I0229 02:08:27.608720 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHUsername
I0229 02:08:27.608926 352939 main.go:141] libmachine: Using SSH client type: native
I0229 02:08:27.609097 352939 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.50.250 22 <nil> <nil>}
I0229 02:08:27.609107 352939 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0229 02:08:27.732198 352939 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0229 02:08:27.732311 352939 main.go:141] libmachine: found compatible host: buildroot
I0229 02:08:27.732325 352939 main.go:141] libmachine: Provisioning with buildroot...
I0229 02:08:27.732336 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetMachineName
I0229 02:08:27.732607 352939 buildroot.go:166] provisioning hostname "old-k8s-version-254968"
I0229 02:08:27.732651 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetMachineName
I0229 02:08:27.732856 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHHostname
I0229 02:08:27.736099 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:27.736494 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968: {Iface:virbr2 ExpiryTime:2024-02-29 03:08:18 +0000 UTC Type:0 Mac:52:54:00:7f:e3:b1 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-254968 Clientid:01:52:54:00:7f:e3:b1}
I0229 02:08:27.736526 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:27.736677 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHPort
I0229 02:08:27.736885 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHKeyPath
I0229 02:08:27.737087 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHKeyPath
I0229 02:08:27.737261 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHUsername
I0229 02:08:27.737428 352939 main.go:141] libmachine: Using SSH client type: native
I0229 02:08:27.737668 352939 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.50.250 22 <nil> <nil>}
I0229 02:08:27.737686 352939 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-254968 && echo "old-k8s-version-254968" | sudo tee /etc/hostname
I0229 02:08:27.874874 352939 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-254968
I0229 02:08:27.874909 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHHostname
I0229 02:08:27.878285 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:27.878686 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968: {Iface:virbr2 ExpiryTime:2024-02-29 03:08:18 +0000 UTC Type:0 Mac:52:54:00:7f:e3:b1 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-254968 Clientid:01:52:54:00:7f:e3:b1}
I0229 02:08:27.878716 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:27.878908 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHPort
I0229 02:08:27.879134 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHKeyPath
I0229 02:08:27.879340 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHKeyPath
I0229 02:08:27.879473 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHUsername
I0229 02:08:27.879683 352939 main.go:141] libmachine: Using SSH client type: native
I0229 02:08:27.879913 352939 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.50.250 22 <nil> <nil>}
I0229 02:08:27.879938 352939 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-254968' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-254968/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-254968' | sudo tee -a /etc/hosts;
fi
fi
I0229 02:08:28.007337 352939 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0229 02:08:28.007368 352939 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18063-309085/.minikube CaCertPath:/home/jenkins/minikube-integration/18063-309085/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18063-309085/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18063-309085/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18063-309085/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18063-309085/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18063-309085/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18063-309085/.minikube}
I0229 02:08:28.007398 352939 buildroot.go:174] setting up certificates
I0229 02:08:28.007413 352939 provision.go:83] configureAuth start
I0229 02:08:28.007428 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetMachineName
I0229 02:08:28.007708 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetIP
I0229 02:08:28.010742 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.011181 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968: {Iface:virbr2 ExpiryTime:2024-02-29 03:08:18 +0000 UTC Type:0 Mac:52:54:00:7f:e3:b1 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-254968 Clientid:01:52:54:00:7f:e3:b1}
I0229 02:08:28.011211 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.011349 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHHostname
I0229 02:08:28.013566 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.013941 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968: {Iface:virbr2 ExpiryTime:2024-02-29 03:08:18 +0000 UTC Type:0 Mac:52:54:00:7f:e3:b1 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-254968 Clientid:01:52:54:00:7f:e3:b1}
I0229 02:08:28.013969 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.014172 352939 provision.go:138] copyHostCerts
I0229 02:08:28.014235 352939 exec_runner.go:144] found /home/jenkins/minikube-integration/18063-309085/.minikube/ca.pem, removing ...
I0229 02:08:28.014255 352939 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18063-309085/.minikube/ca.pem
I0229 02:08:28.014330 352939 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18063-309085/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18063-309085/.minikube/ca.pem (1082 bytes)
I0229 02:08:28.014438 352939 exec_runner.go:144] found /home/jenkins/minikube-integration/18063-309085/.minikube/cert.pem, removing ...
I0229 02:08:28.014450 352939 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18063-309085/.minikube/cert.pem
I0229 02:08:28.014481 352939 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18063-309085/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18063-309085/.minikube/cert.pem (1123 bytes)
I0229 02:08:28.014553 352939 exec_runner.go:144] found /home/jenkins/minikube-integration/18063-309085/.minikube/key.pem, removing ...
I0229 02:08:28.014565 352939 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18063-309085/.minikube/key.pem
I0229 02:08:28.014593 352939 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18063-309085/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18063-309085/.minikube/key.pem (1675 bytes)
I0229 02:08:28.014691 352939 provision.go:112] generating server cert: /home/jenkins/minikube-integration/18063-309085/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18063-309085/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18063-309085/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-254968 san=[192.168.50.250 192.168.50.250 localhost 127.0.0.1 minikube old-k8s-version-254968]
I0229 02:08:28.157788 352939 provision.go:172] copyRemoteCerts
I0229 02:08:28.157846 352939 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0229 02:08:28.157878 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHHostname
I0229 02:08:28.160627 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.161086 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968: {Iface:virbr2 ExpiryTime:2024-02-29 03:08:18 +0000 UTC Type:0 Mac:52:54:00:7f:e3:b1 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-254968 Clientid:01:52:54:00:7f:e3:b1}
I0229 02:08:28.161128 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.161392 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHPort
I0229 02:08:28.161612 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHKeyPath
I0229 02:08:28.161821 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHUsername
I0229 02:08:28.162010 352939 sshutil.go:53] new ssh client: &{IP:192.168.50.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18063-309085/.minikube/machines/old-k8s-version-254968/id_rsa Username:docker}
I0229 02:08:28.256044 352939 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-309085/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0229 02:08:28.286939 352939 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-309085/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I0229 02:08:28.319747 352939 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-309085/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0229 02:08:28.356540 352939 provision.go:86] duration metric: configureAuth took 349.112671ms
I0229 02:08:28.356579 352939 buildroot.go:189] setting minikube options for container-runtime
I0229 02:08:28.356767 352939 config.go:182] Loaded profile config "old-k8s-version-254968": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
I0229 02:08:28.356791 352939 main.go:141] libmachine: Checking connection to Docker...
I0229 02:08:28.356802 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetURL
I0229 02:08:28.358307 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | Using libvirt version 6000000
I0229 02:08:28.360892 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.361382 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968: {Iface:virbr2 ExpiryTime:2024-02-29 03:08:18 +0000 UTC Type:0 Mac:52:54:00:7f:e3:b1 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-254968 Clientid:01:52:54:00:7f:e3:b1}
I0229 02:08:28.361407 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.361662 352939 main.go:141] libmachine: Docker is up and running!
I0229 02:08:28.361688 352939 main.go:141] libmachine: Reticulating splines...
I0229 02:08:28.361706 352939 client.go:171] LocalClient.Create took 27.329208118s
I0229 02:08:28.361733 352939 start.go:167] duration metric: libmachine.API.Create for "old-k8s-version-254968" took 27.329288252s
I0229 02:08:28.361751 352939 start.go:300] post-start starting for "old-k8s-version-254968" (driver="kvm2")
I0229 02:08:28.361764 352939 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0229 02:08:28.361783 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .DriverName
I0229 02:08:28.362092 352939 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0229 02:08:28.362127 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHHostname
I0229 02:08:28.364808 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.365237 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968: {Iface:virbr2 ExpiryTime:2024-02-29 03:08:18 +0000 UTC Type:0 Mac:52:54:00:7f:e3:b1 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-254968 Clientid:01:52:54:00:7f:e3:b1}
I0229 02:08:28.365267 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.365464 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHPort
I0229 02:08:28.365682 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHKeyPath
I0229 02:08:28.365892 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHUsername
I0229 02:08:28.366118 352939 sshutil.go:53] new ssh client: &{IP:192.168.50.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18063-309085/.minikube/machines/old-k8s-version-254968/id_rsa Username:docker}
I0229 02:08:28.456318 352939 ssh_runner.go:195] Run: cat /etc/os-release
I0229 02:08:28.461254 352939 info.go:137] Remote host: Buildroot 2023.02.9
I0229 02:08:28.461299 352939 filesync.go:126] Scanning /home/jenkins/minikube-integration/18063-309085/.minikube/addons for local assets ...
I0229 02:08:28.461370 352939 filesync.go:126] Scanning /home/jenkins/minikube-integration/18063-309085/.minikube/files for local assets ...
I0229 02:08:28.461442 352939 filesync.go:149] local asset: /home/jenkins/minikube-integration/18063-309085/.minikube/files/etc/ssl/certs/3163362.pem -> 3163362.pem in /etc/ssl/certs
I0229 02:08:28.461530 352939 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0229 02:08:28.473698 352939 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-309085/.minikube/files/etc/ssl/certs/3163362.pem --> /etc/ssl/certs/3163362.pem (1708 bytes)
I0229 02:08:28.502529 352939 start.go:303] post-start completed in 140.758524ms
I0229 02:08:28.502589 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetConfigRaw
I0229 02:08:28.503333 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetIP
I0229 02:08:28.506166 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.506544 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968: {Iface:virbr2 ExpiryTime:2024-02-29 03:08:18 +0000 UTC Type:0 Mac:52:54:00:7f:e3:b1 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-254968 Clientid:01:52:54:00:7f:e3:b1}
I0229 02:08:28.506572 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.506819 352939 profile.go:148] Saving config to /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/config.json ...
I0229 02:08:28.506989 352939 start.go:128] duration metric: createHost completed in 27.499133374s
I0229 02:08:28.507011 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHHostname
I0229 02:08:28.509569 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.509956 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968: {Iface:virbr2 ExpiryTime:2024-02-29 03:08:18 +0000 UTC Type:0 Mac:52:54:00:7f:e3:b1 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-254968 Clientid:01:52:54:00:7f:e3:b1}
I0229 02:08:28.509991 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.510112 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHPort
I0229 02:08:28.510311 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHKeyPath
I0229 02:08:28.510487 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHKeyPath
I0229 02:08:28.510632 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHUsername
I0229 02:08:28.510808 352939 main.go:141] libmachine: Using SSH client type: native
I0229 02:08:28.511048 352939 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.50.250 22 <nil> <nil>}
I0229 02:08:28.511067 352939 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0229 02:08:28.636269 352939 main.go:141] libmachine: SSH cmd err, output: <nil>: 1709172508.617562583
I0229 02:08:28.636295 352939 fix.go:206] guest clock: 1709172508.617562583
I0229 02:08:28.636311 352939 fix.go:219] Guest: 2024-02-29 02:08:28.617562583 +0000 UTC Remote: 2024-02-29 02:08:28.507000841 +0000 UTC m=+46.863326447 (delta=110.561742ms)
I0229 02:08:28.636337 352939 fix.go:190] guest clock delta is within tolerance: 110.561742ms
I0229 02:08:28.636345 352939 start.go:83] releasing machines lock for "old-k8s-version-254968", held for 27.628683757s
I0229 02:08:28.636370 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .DriverName
I0229 02:08:28.636708 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetIP
I0229 02:08:28.639823 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.640207 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968: {Iface:virbr2 ExpiryTime:2024-02-29 03:08:18 +0000 UTC Type:0 Mac:52:54:00:7f:e3:b1 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-254968 Clientid:01:52:54:00:7f:e3:b1}
I0229 02:08:28.640232 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.640450 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .DriverName
I0229 02:08:28.640924 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .DriverName
I0229 02:08:28.641143 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .DriverName
I0229 02:08:28.641252 352939 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0229 02:08:28.641316 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHHostname
I0229 02:08:28.641557 352939 ssh_runner.go:195] Run: cat /version.json
I0229 02:08:28.641586 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHHostname
I0229 02:08:28.644412 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.644609 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.644844 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968: {Iface:virbr2 ExpiryTime:2024-02-29 03:08:18 +0000 UTC Type:0 Mac:52:54:00:7f:e3:b1 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-254968 Clientid:01:52:54:00:7f:e3:b1}
I0229 02:08:28.644888 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.644918 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968: {Iface:virbr2 ExpiryTime:2024-02-29 03:08:18 +0000 UTC Type:0 Mac:52:54:00:7f:e3:b1 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-254968 Clientid:01:52:54:00:7f:e3:b1}
I0229 02:08:28.644983 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:28.645057 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHPort
I0229 02:08:28.645181 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHPort
I0229 02:08:28.645344 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHKeyPath
I0229 02:08:28.645352 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHKeyPath
I0229 02:08:28.645531 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHUsername
I0229 02:08:28.645545 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetSSHUsername
I0229 02:08:28.645691 352939 sshutil.go:53] new ssh client: &{IP:192.168.50.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18063-309085/.minikube/machines/old-k8s-version-254968/id_rsa Username:docker}
I0229 02:08:28.645958 352939 sshutil.go:53] new ssh client: &{IP:192.168.50.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18063-309085/.minikube/machines/old-k8s-version-254968/id_rsa Username:docker}
I0229 02:08:28.761941 352939 ssh_runner.go:195] Run: systemctl --version
I0229 02:08:28.770303 352939 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0229 02:08:28.778049 352939 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0229 02:08:28.778133 352939 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0229 02:08:28.797976 352939 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0229 02:08:28.798006 352939 start.go:475] detecting cgroup driver to use...
I0229 02:08:28.798113 352939 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0229 02:08:28.840738 352939 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0229 02:08:28.860550 352939 docker.go:217] disabling cri-docker service (if available) ...
I0229 02:08:28.860614 352939 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0229 02:08:28.879352 352939 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0229 02:08:28.897104 352939 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0229 02:08:29.079427 352939 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0229 02:08:29.264782 352939 docker.go:233] disabling docker service ...
I0229 02:08:29.264868 352939 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0229 02:08:29.285965 352939 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0229 02:08:29.308992 352939 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0229 02:08:29.456661 352939 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0229 02:08:29.617442 352939 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0229 02:08:29.638250 352939 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0229 02:08:29.660651 352939 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.1"|' /etc/containerd/config.toml"
I0229 02:08:29.673108 352939 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0229 02:08:29.686330 352939 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0229 02:08:29.686402 352939 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0229 02:08:29.698226 352939 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0229 02:08:29.714564 352939 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0229 02:08:29.731774 352939 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0229 02:08:29.749123 352939 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0229 02:08:29.764335 352939 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0229 02:08:29.782247 352939 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0229 02:08:29.798815 352939 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0229 02:08:29.798882 352939 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0229 02:08:29.822156 352939 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0229 02:08:29.834551 352939 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0229 02:08:29.969444 352939 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0229 02:08:30.008303 352939 start.go:522] Will wait 60s for socket path /run/containerd/containerd.sock
I0229 02:08:30.008380 352939 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0229 02:08:30.015955 352939 retry.go:31] will retry after 1.106089673s: stat /run/containerd/containerd.sock: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/run/containerd/containerd.sock': No such file or directory
I0229 02:08:31.122186 352939 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0229 02:08:31.129256 352939 start.go:543] Will wait 60s for crictl version
I0229 02:08:31.129335 352939 ssh_runner.go:195] Run: which crictl
I0229 02:08:31.134618 352939 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0229 02:08:31.178169 352939 start.go:559] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: v1.7.11
RuntimeApiVersion: v1
I0229 02:08:31.178230 352939 ssh_runner.go:195] Run: containerd --version
I0229 02:08:31.207758 352939 ssh_runner.go:195] Run: containerd --version
I0229 02:08:31.239999 352939 out.go:177] * Preparing Kubernetes v1.16.0 on containerd 1.7.11 ...
I0229 02:08:31.241409 352939 main.go:141] libmachine: (old-k8s-version-254968) Calling .GetIP
I0229 02:08:31.244678 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:31.245143 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7f:e3:b1", ip: ""} in network mk-old-k8s-version-254968: {Iface:virbr2 ExpiryTime:2024-02-29 03:08:18 +0000 UTC Type:0 Mac:52:54:00:7f:e3:b1 Iaid: IPaddr:192.168.50.250 Prefix:24 Hostname:old-k8s-version-254968 Clientid:01:52:54:00:7f:e3:b1}
I0229 02:08:31.245172 352939 main.go:141] libmachine: (old-k8s-version-254968) DBG | domain old-k8s-version-254968 has defined IP address 192.168.50.250 and MAC address 52:54:00:7f:e3:b1 in network mk-old-k8s-version-254968
I0229 02:08:31.245438 352939 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0229 02:08:31.251007 352939 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0229 02:08:31.268390 352939 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
I0229 02:08:31.268477 352939 ssh_runner.go:195] Run: sudo crictl images --output json
I0229 02:08:31.307900 352939 containerd.go:608] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0229 02:08:31.307977 352939 ssh_runner.go:195] Run: which lz4
I0229 02:08:31.313067 352939 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0229 02:08:31.318785 352939 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0229 02:08:31.318824 352939 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-309085/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (440628646 bytes)
I0229 02:08:33.476613 352939 containerd.go:548] Took 2.163567 seconds to copy over tarball
I0229 02:08:33.476713 352939 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0229 02:08:36.830627 352939 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.353867564s)
I0229 02:08:36.830664 352939 containerd.go:555] Took 3.354012 seconds to extract the tarball
I0229 02:08:36.830693 352939 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0229 02:08:36.874068 352939 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0229 02:08:37.019285 352939 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0229 02:08:37.049557 352939 ssh_runner.go:195] Run: sudo crictl images --output json
I0229 02:08:37.097479 352939 retry.go:31] will retry after 320.735607ms: sudo crictl images --output json: Process exited with status 1
stdout:
stderr:
time="2024-02-29T02:08:37Z" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///run/containerd/containerd.sock\": rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
I0229 02:08:37.419097 352939 ssh_runner.go:195] Run: sudo crictl images --output json
I0229 02:08:37.479061 352939 containerd.go:608] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0229 02:08:37.479091 352939 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.16.0 registry.k8s.io/kube-controller-manager:v1.16.0 registry.k8s.io/kube-scheduler:v1.16.0 registry.k8s.io/kube-proxy:v1.16.0 registry.k8s.io/pause:3.1 registry.k8s.io/etcd:3.3.15-0 registry.k8s.io/coredns:1.6.2 gcr.io/k8s-minikube/storage-provisioner:v5]
I0229 02:08:37.479155 352939 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0229 02:08:37.479195 352939 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.16.0
I0229 02:08:37.479208 352939 image.go:134] retrieving image: registry.k8s.io/pause:3.1
I0229 02:08:37.479233 352939 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.2
I0229 02:08:37.479248 352939 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 02:08:37.479274 352939 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 02:08:37.479214 352939 image.go:134] retrieving image: registry.k8s.io/etcd:3.3.15-0
I0229 02:08:37.479471 352939 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 02:08:37.480742 352939 image.go:177] daemon lookup for registry.k8s.io/etcd:3.3.15-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.3.15-0
I0229 02:08:37.480743 352939 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0229 02:08:37.480858 352939 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.2: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.2
I0229 02:08:37.481254 352939 image.go:177] daemon lookup for registry.k8s.io/pause:3.1: Error response from daemon: No such image: registry.k8s.io/pause:3.1
I0229 02:08:37.481252 352939 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 02:08:37.481259 352939 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 02:08:37.481947 352939 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.16.0
I0229 02:08:37.482353 352939 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 02:08:37.623927 352939 containerd.go:252] Checking existence of image with name "registry.k8s.io/kube-scheduler:v1.16.0" and sha "301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a"
I0229 02:08:37.623993 352939 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images check
I0229 02:08:37.626008 352939 containerd.go:252] Checking existence of image with name "registry.k8s.io/kube-proxy:v1.16.0" and sha "c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384"
I0229 02:08:37.626068 352939 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images check
I0229 02:08:37.632128 352939 containerd.go:252] Checking existence of image with name "registry.k8s.io/etcd:3.3.15-0" and sha "b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed"
I0229 02:08:37.632185 352939 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images check
I0229 02:08:37.641822 352939 containerd.go:252] Checking existence of image with name "registry.k8s.io/pause:3.1" and sha "da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e"
I0229 02:08:37.641896 352939 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images check
I0229 02:08:37.655435 352939 containerd.go:252] Checking existence of image with name "registry.k8s.io/coredns:1.6.2" and sha "bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b"
I0229 02:08:37.655513 352939 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images check
I0229 02:08:37.656381 352939 containerd.go:252] Checking existence of image with name "registry.k8s.io/kube-apiserver:v1.16.0" and sha "b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e"
I0229 02:08:37.656442 352939 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images check
I0229 02:08:37.657742 352939 containerd.go:252] Checking existence of image with name "registry.k8s.io/kube-controller-manager:v1.16.0" and sha "06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d"
I0229 02:08:37.657810 352939 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images check
I0229 02:08:38.318335 352939 containerd.go:252] Checking existence of image with name "gcr.io/k8s-minikube/storage-provisioner:v5" and sha "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562"
I0229 02:08:38.318426 352939 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images check
I0229 02:08:38.647838 352939 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images check: (1.023819317s)
I0229 02:08:38.647916 352939 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.16.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.16.0" does not exist at hash "301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a" in container runtime
I0229 02:08:38.647963 352939 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 02:08:38.648013 352939 ssh_runner.go:195] Run: which crictl
I0229 02:08:38.724848 352939 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images check: (1.098754854s)
I0229 02:08:38.724933 352939 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.16.0" needs transfer: "registry.k8s.io/kube-proxy:v1.16.0" does not exist at hash "c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384" in container runtime
I0229 02:08:38.724976 352939 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.16.0
I0229 02:08:38.725034 352939 ssh_runner.go:195] Run: which crictl
I0229 02:08:38.965573 352939 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images check: (1.333362029s)
I0229 02:08:38.965688 352939 cache_images.go:116] "registry.k8s.io/etcd:3.3.15-0" needs transfer: "registry.k8s.io/etcd:3.3.15-0" does not exist at hash "b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed" in container runtime
I0229 02:08:38.965739 352939 cri.go:218] Removing image: registry.k8s.io/etcd:3.3.15-0
I0229 02:08:38.965762 352939 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images check: (1.323842657s)
I0229 02:08:38.965791 352939 ssh_runner.go:195] Run: which crictl
I0229 02:08:38.965823 352939 cache_images.go:116] "registry.k8s.io/pause:3.1" needs transfer: "registry.k8s.io/pause:3.1" does not exist at hash "da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e" in container runtime
I0229 02:08:38.965854 352939 cri.go:218] Removing image: registry.k8s.io/pause:3.1
I0229 02:08:38.965893 352939 ssh_runner.go:195] Run: which crictl
I0229 02:08:38.966394 352939 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images check: (1.310858493s)
I0229 02:08:38.966455 352939 cache_images.go:116] "registry.k8s.io/coredns:1.6.2" needs transfer: "registry.k8s.io/coredns:1.6.2" does not exist at hash "bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b" in container runtime
I0229 02:08:38.966488 352939 cri.go:218] Removing image: registry.k8s.io/coredns:1.6.2
I0229 02:08:38.966532 352939 ssh_runner.go:195] Run: which crictl
I0229 02:08:39.062145 352939 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images check: (1.405666431s)
I0229 02:08:39.062227 352939 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.16.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.16.0" does not exist at hash "b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e" in container runtime
I0229 02:08:39.062269 352939 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 02:08:39.062337 352939 ssh_runner.go:195] Run: which crictl
I0229 02:08:39.062683 352939 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images check: (1.404851191s)
I0229 02:08:39.062743 352939 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.16.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.16.0" does not exist at hash "06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d" in container runtime
I0229 02:08:39.062783 352939 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 02:08:39.062838 352939 ssh_runner.go:195] Run: which crictl
I0229 02:08:39.164011 352939 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.16.0
I0229 02:08:39.164078 352939 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.16.0
I0229 02:08:39.164105 352939 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.1
I0229 02:08:39.164127 352939 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.3.15-0
I0229 02:08:39.164175 352939 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.6.2
I0229 02:08:39.164226 352939 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.16.0
I0229 02:08:39.164272 352939 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.16.0
I0229 02:08:39.314119 352939 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-309085/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0
I0229 02:08:39.317249 352939 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-309085/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.16.0
I0229 02:08:39.317327 352939 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-309085/.minikube/cache/images/amd64/registry.k8s.io/pause_3.1
I0229 02:08:39.317422 352939 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-309085/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.3.15-0
I0229 02:08:39.328054 352939 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-309085/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0
I0229 02:08:39.333333 352939 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-309085/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2
I0229 02:08:39.333394 352939 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-309085/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0
I0229 02:08:39.333454 352939 cache_images.go:92] LoadImages completed in 1.854351218s
W0229 02:08:39.333541 352939 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18063-309085/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18063-309085/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0: no such file or directory
I0229 02:08:39.333610 352939 ssh_runner.go:195] Run: sudo crictl info
I0229 02:08:39.379973 352939 cni.go:84] Creating CNI manager for ""
I0229 02:08:39.379998 352939 cni.go:146] "kvm2" driver + "containerd" runtime found, recommending bridge
I0229 02:08:39.380017 352939 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0229 02:08:39.380036 352939 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.250 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-254968 NodeName:old-k8s-version-254968 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.250"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.250 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/c
a.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0229 02:08:39.380150 352939 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.250
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-254968"
kubeletExtraArgs:
node-ip: 192.168.50.250
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.250"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-254968
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.50.250:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0229 02:08:39.380229 352939 kubeadm.go:976] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-254968 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.250
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-254968 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0229 02:08:39.380295 352939 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0229 02:08:39.393551 352939 binaries.go:44] Found k8s binaries, skipping transfer
I0229 02:08:39.393634 352939 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0229 02:08:39.406098 352939 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (444 bytes)
I0229 02:08:39.426968 352939 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0229 02:08:39.447451 352939 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2189 bytes)
I0229 02:08:39.468921 352939 ssh_runner.go:195] Run: grep 192.168.50.250 control-plane.minikube.internal$ /etc/hosts
I0229 02:08:39.473614 352939 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.250 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0229 02:08:39.488879 352939 certs.go:56] Setting up /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968 for IP: 192.168.50.250
I0229 02:08:39.488915 352939 certs.go:190] acquiring lock for shared ca certs: {Name:mkd93205d1e0ff28501dacf7d21e224f19de9501 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 02:08:39.489086 352939 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/18063-309085/.minikube/ca.key
I0229 02:08:39.489141 352939 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/18063-309085/.minikube/proxy-client-ca.key
I0229 02:08:39.489198 352939 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/client.key
I0229 02:08:39.489211 352939 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/client.crt with IP's: []
I0229 02:08:39.571039 352939 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/client.crt ...
I0229 02:08:39.571085 352939 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/client.crt: {Name:mk3b48fc044cbf4166a29b169398e8ffef41e421 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 02:08:39.571283 352939 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/client.key ...
I0229 02:08:39.571299 352939 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/client.key: {Name:mka4ffc2ea8dd4024ec8836e683cf463febb3137 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 02:08:39.571379 352939 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/apiserver.key.df55815c
I0229 02:08:39.571394 352939 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/apiserver.crt.df55815c with IP's: [192.168.50.250 10.96.0.1 127.0.0.1 10.0.0.1]
I0229 02:08:39.625133 352939 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/apiserver.crt.df55815c ...
I0229 02:08:39.625161 352939 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/apiserver.crt.df55815c: {Name:mk40262f094f3c86f3f1856870cbfa804dddea5d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 02:08:39.625354 352939 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/apiserver.key.df55815c ...
I0229 02:08:39.625382 352939 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/apiserver.key.df55815c: {Name:mk502fba553b5476bec39cef43812c9ff221ecdb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 02:08:39.625495 352939 certs.go:337] copying /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/apiserver.crt.df55815c -> /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/apiserver.crt
I0229 02:08:39.625609 352939 certs.go:341] copying /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/apiserver.key.df55815c -> /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/apiserver.key
I0229 02:08:39.625692 352939 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/proxy-client.key
I0229 02:08:39.625714 352939 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/proxy-client.crt with IP's: []
I0229 02:08:39.773597 352939 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/proxy-client.crt ...
I0229 02:08:39.773630 352939 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/proxy-client.crt: {Name:mk0b1a2d00889efa492481f95f395126771ebb3b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 02:08:39.773791 352939 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/proxy-client.key ...
I0229 02:08:39.773804 352939 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/proxy-client.key: {Name:mkd98616003546dd25d9820333335517d79ec453 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 02:08:39.774001 352939 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-309085/.minikube/certs/home/jenkins/minikube-integration/18063-309085/.minikube/certs/316336.pem (1338 bytes)
W0229 02:08:39.774051 352939 certs.go:433] ignoring /home/jenkins/minikube-integration/18063-309085/.minikube/certs/home/jenkins/minikube-integration/18063-309085/.minikube/certs/316336_empty.pem, impossibly tiny 0 bytes
I0229 02:08:39.774064 352939 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-309085/.minikube/certs/home/jenkins/minikube-integration/18063-309085/.minikube/certs/ca-key.pem (1679 bytes)
I0229 02:08:39.774123 352939 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-309085/.minikube/certs/home/jenkins/minikube-integration/18063-309085/.minikube/certs/ca.pem (1082 bytes)
I0229 02:08:39.774165 352939 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-309085/.minikube/certs/home/jenkins/minikube-integration/18063-309085/.minikube/certs/cert.pem (1123 bytes)
I0229 02:08:39.774217 352939 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-309085/.minikube/certs/home/jenkins/minikube-integration/18063-309085/.minikube/certs/key.pem (1675 bytes)
I0229 02:08:39.774283 352939 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-309085/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/18063-309085/.minikube/files/etc/ssl/certs/3163362.pem (1708 bytes)
I0229 02:08:39.775012 352939 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0229 02:08:39.805163 352939 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0229 02:08:39.833878 352939 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0229 02:08:39.863924 352939 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-309085/.minikube/profiles/old-k8s-version-254968/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0229 02:08:39.892808 352939 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-309085/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0229 02:08:39.921392 352939 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-309085/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0229 02:08:39.952271 352939 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-309085/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0229 02:08:39.981113 352939 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-309085/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0229 02:08:40.009299 352939 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-309085/.minikube/files/etc/ssl/certs/3163362.pem --> /usr/share/ca-certificates/3163362.pem (1708 bytes)
I0229 02:08:40.038738 352939 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-309085/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0229 02:08:40.067962 352939 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-309085/.minikube/certs/316336.pem --> /usr/share/ca-certificates/316336.pem (1338 bytes)
I0229 02:08:40.097818 352939 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0229 02:08:40.120277 352939 ssh_runner.go:195] Run: openssl version
I0229 02:08:40.128190 352939 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0229 02:08:40.144167 352939 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0229 02:08:40.149418 352939 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Feb 29 01:12 /usr/share/ca-certificates/minikubeCA.pem
I0229 02:08:40.149475 352939 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0229 02:08:40.155942 352939 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0229 02:08:40.169070 352939 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/316336.pem && ln -fs /usr/share/ca-certificates/316336.pem /etc/ssl/certs/316336.pem"
I0229 02:08:40.181839 352939 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/316336.pem
I0229 02:08:40.187619 352939 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Feb 29 01:18 /usr/share/ca-certificates/316336.pem
I0229 02:08:40.187688 352939 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/316336.pem
I0229 02:08:40.194237 352939 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/316336.pem /etc/ssl/certs/51391683.0"
I0229 02:08:40.210184 352939 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3163362.pem && ln -fs /usr/share/ca-certificates/3163362.pem /etc/ssl/certs/3163362.pem"
I0229 02:08:40.224622 352939 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3163362.pem
I0229 02:08:40.230005 352939 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Feb 29 01:18 /usr/share/ca-certificates/3163362.pem
I0229 02:08:40.230068 352939 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3163362.pem
I0229 02:08:40.237154 352939 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3163362.pem /etc/ssl/certs/3ec20f2e.0"
I0229 02:08:40.254231 352939 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I0229 02:08:40.260177 352939 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
I0229 02:08:40.260243 352939 kubeadm.go:404] StartCluster: {Name:old-k8s-version-254968 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVe
rsion:v1.16.0 ClusterName:old-k8s-version-254968 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.50.250 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mou
ntMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0229 02:08:40.260328 352939 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0229 02:08:40.260388 352939 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0229 02:08:40.301647 352939 cri.go:89] found id: ""
I0229 02:08:40.301730 352939 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0229 02:08:40.315444 352939 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0229 02:08:40.327983 352939 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0229 02:08:40.342233 352939 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0229 02:08:40.342289 352939 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0229 02:08:40.753101 352939 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0229 02:10:38.665460 352939 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0229 02:10:38.665588 352939 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
I0229 02:10:38.667087 352939 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0229 02:10:38.667157 352939 kubeadm.go:322] [preflight] Running pre-flight checks
I0229 02:10:38.667277 352939 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0229 02:10:38.667442 352939 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0229 02:10:38.667573 352939 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0229 02:10:38.667696 352939 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0229 02:10:38.667808 352939 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0229 02:10:38.667878 352939 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0229 02:10:38.667972 352939 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0229 02:10:38.669608 352939 out.go:204] - Generating certificates and keys ...
I0229 02:10:38.669695 352939 kubeadm.go:322] [certs] Using existing ca certificate authority
I0229 02:10:38.669783 352939 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0229 02:10:38.669868 352939 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I0229 02:10:38.669940 352939 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I0229 02:10:38.670021 352939 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I0229 02:10:38.670111 352939 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I0229 02:10:38.670217 352939 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I0229 02:10:38.670357 352939 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [old-k8s-version-254968 localhost] and IPs [192.168.50.250 127.0.0.1 ::1]
I0229 02:10:38.670429 352939 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I0229 02:10:38.670597 352939 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-254968 localhost] and IPs [192.168.50.250 127.0.0.1 ::1]
I0229 02:10:38.670693 352939 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I0229 02:10:38.670800 352939 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I0229 02:10:38.670885 352939 kubeadm.go:322] [certs] Generating "sa" key and public key
I0229 02:10:38.670965 352939 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0229 02:10:38.671038 352939 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0229 02:10:38.671109 352939 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0229 02:10:38.671198 352939 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0229 02:10:38.671300 352939 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0229 02:10:38.671378 352939 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0229 02:10:38.672697 352939 out.go:204] - Booting up control plane ...
I0229 02:10:38.672805 352939 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0229 02:10:38.672907 352939 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0229 02:10:38.672980 352939 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0229 02:10:38.673041 352939 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0229 02:10:38.673159 352939 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0229 02:10:38.673216 352939 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0229 02:10:38.673287 352939 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:10:38.673447 352939 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:10:38.673505 352939 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:10:38.673655 352939 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:10:38.673715 352939 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:10:38.673903 352939 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:10:38.673994 352939 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:10:38.674280 352939 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:10:38.674381 352939 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:10:38.674538 352939 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:10:38.674555 352939 kubeadm.go:322]
I0229 02:10:38.674594 352939 kubeadm.go:322] Unfortunately, an error has occurred:
I0229 02:10:38.674625 352939 kubeadm.go:322] timed out waiting for the condition
I0229 02:10:38.674632 352939 kubeadm.go:322]
I0229 02:10:38.674669 352939 kubeadm.go:322] This error is likely caused by:
I0229 02:10:38.674722 352939 kubeadm.go:322] - The kubelet is not running
I0229 02:10:38.674876 352939 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0229 02:10:38.674889 352939 kubeadm.go:322]
I0229 02:10:38.675040 352939 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0229 02:10:38.675087 352939 kubeadm.go:322] - 'systemctl status kubelet'
I0229 02:10:38.675142 352939 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0229 02:10:38.675151 352939 kubeadm.go:322]
I0229 02:10:38.675288 352939 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0229 02:10:38.675405 352939 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0229 02:10:38.675496 352939 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0229 02:10:38.675538 352939 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0229 02:10:38.675595 352939 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0229 02:10:38.675678 352939 kubeadm.go:322] - 'docker logs CONTAINERID'
W0229 02:10:38.675769 352939 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-254968 localhost] and IPs [192.168.50.250 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-254968 localhost] and IPs [192.168.50.250 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-254968 localhost] and IPs [192.168.50.250 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-254968 localhost] and IPs [192.168.50.250 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0229 02:10:38.675831 352939 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
I0229 02:10:39.150728 352939 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0229 02:10:39.169953 352939 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0229 02:10:39.182131 352939 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0229 02:10:39.182188 352939 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0229 02:10:39.245826 352939 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0229 02:10:39.245910 352939 kubeadm.go:322] [preflight] Running pre-flight checks
I0229 02:10:39.378672 352939 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0229 02:10:39.378844 352939 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0229 02:10:39.378984 352939 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0229 02:10:39.604172 352939 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0229 02:10:39.605540 352939 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0229 02:10:39.614968 352939 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0229 02:10:39.755999 352939 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0229 02:10:39.758361 352939 out.go:204] - Generating certificates and keys ...
I0229 02:10:39.758451 352939 kubeadm.go:322] [certs] Using existing ca certificate authority
I0229 02:10:39.758540 352939 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0229 02:10:39.758673 352939 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0229 02:10:39.758793 352939 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority
I0229 02:10:39.758891 352939 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk
I0229 02:10:39.758969 352939 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority
I0229 02:10:39.759054 352939 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk
I0229 02:10:39.759160 352939 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk
I0229 02:10:39.759273 352939 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0229 02:10:39.759364 352939 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0229 02:10:39.759410 352939 kubeadm.go:322] [certs] Using the existing "sa" key
I0229 02:10:39.759513 352939 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0229 02:10:39.903904 352939 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0229 02:10:40.171619 352939 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0229 02:10:40.697375 352939 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0229 02:10:40.876520 352939 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0229 02:10:40.877444 352939 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0229 02:10:40.879210 352939 out.go:204] - Booting up control plane ...
I0229 02:10:40.879350 352939 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0229 02:10:40.884243 352939 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0229 02:10:40.885655 352939 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0229 02:10:40.887461 352939 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0229 02:10:40.890562 352939 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0229 02:11:20.892835 352939 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0229 02:11:20.893158 352939 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:11:20.893446 352939 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:11:25.895663 352939 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:11:25.896046 352939 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:11:35.896969 352939 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:11:35.897227 352939 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:11:55.898638 352939 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:11:55.898914 352939 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:12:35.898329 352939 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:12:35.898614 352939 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:12:35.898645 352939 kubeadm.go:322]
I0229 02:12:35.898718 352939 kubeadm.go:322] Unfortunately, an error has occurred:
I0229 02:12:35.898788 352939 kubeadm.go:322] timed out waiting for the condition
I0229 02:12:35.898798 352939 kubeadm.go:322]
I0229 02:12:35.898839 352939 kubeadm.go:322] This error is likely caused by:
I0229 02:12:35.898872 352939 kubeadm.go:322] - The kubelet is not running
I0229 02:12:35.899001 352939 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0229 02:12:35.899017 352939 kubeadm.go:322]
I0229 02:12:35.899137 352939 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0229 02:12:35.899182 352939 kubeadm.go:322] - 'systemctl status kubelet'
I0229 02:12:35.899232 352939 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0229 02:12:35.899244 352939 kubeadm.go:322]
I0229 02:12:35.899391 352939 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0229 02:12:35.899515 352939 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0229 02:12:35.899625 352939 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0229 02:12:35.899700 352939 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0229 02:12:35.899797 352939 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0229 02:12:35.899849 352939 kubeadm.go:322] - 'docker logs CONTAINERID'
I0229 02:12:35.900789 352939 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0229 02:12:35.900906 352939 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0229 02:12:35.901010 352939 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
I0229 02:12:35.901065 352939 kubeadm.go:406] StartCluster complete in 3m55.640832895s
I0229 02:12:35.901140 352939 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0229 02:12:35.901212 352939 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0229 02:12:35.952939 352939 cri.go:89] found id: ""
I0229 02:12:35.952966 352939 logs.go:276] 0 containers: []
W0229 02:12:35.952974 352939 logs.go:278] No container was found matching "kube-apiserver"
I0229 02:12:35.952982 352939 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0229 02:12:35.953049 352939 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0229 02:12:35.988981 352939 cri.go:89] found id: ""
I0229 02:12:35.989012 352939 logs.go:276] 0 containers: []
W0229 02:12:35.989021 352939 logs.go:278] No container was found matching "etcd"
I0229 02:12:35.989027 352939 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0229 02:12:35.989081 352939 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0229 02:12:36.022715 352939 cri.go:89] found id: ""
I0229 02:12:36.022749 352939 logs.go:276] 0 containers: []
W0229 02:12:36.022762 352939 logs.go:278] No container was found matching "coredns"
I0229 02:12:36.022770 352939 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0229 02:12:36.022852 352939 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0229 02:12:36.059376 352939 cri.go:89] found id: ""
I0229 02:12:36.059413 352939 logs.go:276] 0 containers: []
W0229 02:12:36.059425 352939 logs.go:278] No container was found matching "kube-scheduler"
I0229 02:12:36.059434 352939 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0229 02:12:36.059501 352939 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0229 02:12:36.098205 352939 cri.go:89] found id: ""
I0229 02:12:36.098237 352939 logs.go:276] 0 containers: []
W0229 02:12:36.098246 352939 logs.go:278] No container was found matching "kube-proxy"
I0229 02:12:36.098252 352939 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0229 02:12:36.098331 352939 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0229 02:12:36.138193 352939 cri.go:89] found id: ""
I0229 02:12:36.138225 352939 logs.go:276] 0 containers: []
W0229 02:12:36.138236 352939 logs.go:278] No container was found matching "kube-controller-manager"
I0229 02:12:36.138244 352939 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0229 02:12:36.138322 352939 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0229 02:12:36.174400 352939 cri.go:89] found id: ""
I0229 02:12:36.174427 352939 logs.go:276] 0 containers: []
W0229 02:12:36.174436 352939 logs.go:278] No container was found matching "kindnet"
I0229 02:12:36.174446 352939 logs.go:123] Gathering logs for kubelet ...
I0229 02:12:36.174460 352939 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0229 02:12:36.221302 352939 logs.go:123] Gathering logs for dmesg ...
I0229 02:12:36.221336 352939 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0229 02:12:36.236708 352939 logs.go:123] Gathering logs for describe nodes ...
I0229 02:12:36.236738 352939 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0229 02:12:36.395030 352939 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0229 02:12:36.395059 352939 logs.go:123] Gathering logs for containerd ...
I0229 02:12:36.395072 352939 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0229 02:12:36.435335 352939 logs.go:123] Gathering logs for container status ...
I0229 02:12:36.435368 352939 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0229 02:12:36.475320 352939 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 02:12:36.475369 352939 out.go:239] *
*
W0229 02:12:36.475426 352939 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 02:12:36.475444 352939 out.go:239] *
*
W0229 02:12:36.476344 352939 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0229 02:12:36.479302 352939 out.go:177]
W0229 02:12:36.480466 352939 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 02:12:36.480517 352939 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0229 02:12:36.480538 352939 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0229 02:12:36.481961 352939 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-254968 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-254968 -n old-k8s-version-254968
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-254968 -n old-k8s-version-254968: exit status 6 (244.758111ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0229 02:12:36.762183 359884 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-254968" does not appear in /home/jenkins/minikube-integration/18063-309085/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-254968" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (295.14s)