=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-467811 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --kubernetes-version=v1.16.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-467811 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --kubernetes-version=v1.16.0: exit status 109 (4m43.126626637s)
-- stdout --
* [old-k8s-version-467811] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18259
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18259-6402/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18259-6402/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting control plane node old-k8s-version-467811 in cluster old-k8s-version-467811
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.16.0 on Docker 24.0.7 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0229 18:33:53.392459 53990 out.go:291] Setting OutFile to fd 1 ...
I0229 18:33:53.392615 53990 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0229 18:33:53.392625 53990 out.go:304] Setting ErrFile to fd 2...
I0229 18:33:53.392632 53990 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0229 18:33:53.392822 53990 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18259-6402/.minikube/bin
I0229 18:33:53.393412 53990 out.go:298] Setting JSON to false
I0229 18:33:53.394488 53990 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-7","uptime":4584,"bootTime":1709227050,"procs":295,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0229 18:33:53.394549 53990 start.go:139] virtualization: kvm guest
I0229 18:33:53.396762 53990 out.go:177] * [old-k8s-version-467811] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0229 18:33:53.398700 53990 out.go:177] - MINIKUBE_LOCATION=18259
I0229 18:33:53.398708 53990 notify.go:220] Checking for updates...
I0229 18:33:53.400208 53990 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0229 18:33:53.401939 53990 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18259-6402/kubeconfig
I0229 18:33:53.403486 53990 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18259-6402/.minikube
I0229 18:33:53.404980 53990 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0229 18:33:53.406435 53990 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0229 18:33:53.408312 53990 config.go:182] Loaded profile config "bridge-911469": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0229 18:33:53.408424 53990 config.go:182] Loaded profile config "flannel-911469": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0229 18:33:53.408524 53990 config.go:182] Loaded profile config "kubenet-911469": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0229 18:33:53.408637 53990 driver.go:392] Setting default libvirt URI to qemu:///system
I0229 18:33:53.450973 53990 out.go:177] * Using the kvm2 driver based on user configuration
I0229 18:33:53.452370 53990 start.go:299] selected driver: kvm2
I0229 18:33:53.452389 53990 start.go:903] validating driver "kvm2" against <nil>
I0229 18:33:53.452403 53990 start.go:914] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0229 18:33:53.453254 53990 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0229 18:33:53.453343 53990 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18259-6402/.minikube/bin:/home/jenkins/workspace/KVM_Linux_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0229 18:33:53.470937 53990 install.go:137] /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0229 18:33:53.470988 53990 start_flags.go:309] no existing cluster config was found, will generate one from the flags
I0229 18:33:53.471251 53990 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0229 18:33:53.471331 53990 cni.go:84] Creating CNI manager for ""
I0229 18:33:53.471350 53990 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0229 18:33:53.471357 53990 start_flags.go:323] config:
{Name:old-k8s-version-467811 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-467811 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR
untime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0229 18:33:53.471530 53990 iso.go:125] acquiring lock: {Name:mk9e2949140cf4fb33ba681841e4205e10738498 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0229 18:33:53.473561 53990 out.go:177] * Starting control plane node old-k8s-version-467811 in cluster old-k8s-version-467811
I0229 18:33:53.474870 53990 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0229 18:33:53.474901 53990 preload.go:148] Found local preload: /home/jenkins/minikube-integration/18259-6402/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I0229 18:33:53.474911 53990 cache.go:56] Caching tarball of preloaded images
I0229 18:33:53.474978 53990 preload.go:174] Found /home/jenkins/minikube-integration/18259-6402/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0229 18:33:53.474988 53990 cache.go:59] Finished verifying existence of preloaded tar for v1.16.0 on docker
I0229 18:33:53.475065 53990 profile.go:148] Saving config to /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/config.json ...
I0229 18:33:53.475090 53990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/config.json: {Name:mk283066d85f79a359f644dcae05400ad0df7ede Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:33:53.475212 53990 start.go:365] acquiring machines lock for old-k8s-version-467811: {Name:mk74557154dfda7cafd0db37b211474724c8cf09 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0229 18:33:59.961190 53990 start.go:369] acquired machines lock for "old-k8s-version-467811" in 6.485955014s
I0229 18:33:59.961253 53990 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-467811 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-467811 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountM
Size:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0229 18:33:59.961368 53990 start.go:125] createHost starting for "" (driver="kvm2")
I0229 18:33:59.963518 53990 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0229 18:33:59.963826 53990 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2
I0229 18:33:59.963879 53990 main.go:141] libmachine: Launching plugin server for driver kvm2
I0229 18:33:59.981880 53990 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39677
I0229 18:33:59.982281 53990 main.go:141] libmachine: () Calling .GetVersion
I0229 18:33:59.982759 53990 main.go:141] libmachine: Using API Version 1
I0229 18:33:59.982782 53990 main.go:141] libmachine: () Calling .SetConfigRaw
I0229 18:33:59.983230 53990 main.go:141] libmachine: () Calling .GetMachineName
I0229 18:33:59.983413 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetMachineName
I0229 18:33:59.983575 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .DriverName
I0229 18:33:59.983745 53990 start.go:159] libmachine.API.Create for "old-k8s-version-467811" (driver="kvm2")
I0229 18:33:59.983785 53990 client.go:168] LocalClient.Create starting
I0229 18:33:59.983813 53990 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18259-6402/.minikube/certs/ca.pem
I0229 18:33:59.983845 53990 main.go:141] libmachine: Decoding PEM data...
I0229 18:33:59.983862 53990 main.go:141] libmachine: Parsing certificate...
I0229 18:33:59.983906 53990 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18259-6402/.minikube/certs/cert.pem
I0229 18:33:59.983920 53990 main.go:141] libmachine: Decoding PEM data...
I0229 18:33:59.983928 53990 main.go:141] libmachine: Parsing certificate...
I0229 18:33:59.983940 53990 main.go:141] libmachine: Running pre-create checks...
I0229 18:33:59.983950 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .PreCreateCheck
I0229 18:33:59.984322 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetConfigRaw
I0229 18:33:59.984729 53990 main.go:141] libmachine: Creating machine...
I0229 18:33:59.984744 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .Create
I0229 18:33:59.984866 53990 main.go:141] libmachine: (old-k8s-version-467811) Creating KVM machine...
I0229 18:33:59.986026 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found existing default KVM network
I0229 18:33:59.987715 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:33:59.987400 54417 network.go:212] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:a0:2e:d7} reservation:<nil>}
I0229 18:33:59.988617 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:33:59.988400 54417 network.go:212] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr4 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:a6:dc:b2} reservation:<nil>}
I0229 18:33:59.989497 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:33:59.989375 54417 network.go:212] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:46:27:a0} reservation:<nil>}
I0229 18:33:59.990578 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:33:59.990499 54417 network.go:207] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002b36c0}
I0229 18:33:59.997685 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | trying to create private KVM network mk-old-k8s-version-467811 192.168.72.0/24...
I0229 18:34:00.074012 53990 main.go:141] libmachine: (old-k8s-version-467811) Setting up store path in /home/jenkins/minikube-integration/18259-6402/.minikube/machines/old-k8s-version-467811 ...
I0229 18:34:00.074058 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | private KVM network mk-old-k8s-version-467811 192.168.72.0/24 created
I0229 18:34:00.074076 53990 main.go:141] libmachine: (old-k8s-version-467811) Building disk image from file:///home/jenkins/minikube-integration/18259-6402/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso
I0229 18:34:00.074096 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:00.073960 54417 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18259-6402/.minikube
I0229 18:34:00.074147 53990 main.go:141] libmachine: (old-k8s-version-467811) Downloading /home/jenkins/minikube-integration/18259-6402/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18259-6402/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
I0229 18:34:00.326466 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:00.326348 54417 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18259-6402/.minikube/machines/old-k8s-version-467811/id_rsa...
I0229 18:34:00.468197 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:00.468069 54417 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18259-6402/.minikube/machines/old-k8s-version-467811/old-k8s-version-467811.rawdisk...
I0229 18:34:00.468230 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Writing magic tar header
I0229 18:34:00.468249 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Writing SSH key tar header
I0229 18:34:00.468262 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:00.468232 54417 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18259-6402/.minikube/machines/old-k8s-version-467811 ...
I0229 18:34:00.468478 53990 main.go:141] libmachine: (old-k8s-version-467811) Setting executable bit set on /home/jenkins/minikube-integration/18259-6402/.minikube/machines/old-k8s-version-467811 (perms=drwx------)
I0229 18:34:00.468509 53990 main.go:141] libmachine: (old-k8s-version-467811) Setting executable bit set on /home/jenkins/minikube-integration/18259-6402/.minikube/machines (perms=drwxr-xr-x)
I0229 18:34:00.468523 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18259-6402/.minikube/machines/old-k8s-version-467811
I0229 18:34:00.468539 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18259-6402/.minikube/machines
I0229 18:34:00.468551 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18259-6402/.minikube
I0229 18:34:00.468564 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18259-6402
I0229 18:34:00.468573 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0229 18:34:00.468584 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Checking permissions on dir: /home/jenkins
I0229 18:34:00.468593 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Checking permissions on dir: /home
I0229 18:34:00.468609 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Skipping /home - not owner
I0229 18:34:00.468631 53990 main.go:141] libmachine: (old-k8s-version-467811) Setting executable bit set on /home/jenkins/minikube-integration/18259-6402/.minikube (perms=drwxr-xr-x)
I0229 18:34:00.468643 53990 main.go:141] libmachine: (old-k8s-version-467811) Setting executable bit set on /home/jenkins/minikube-integration/18259-6402 (perms=drwxrwxr-x)
I0229 18:34:00.468658 53990 main.go:141] libmachine: (old-k8s-version-467811) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0229 18:34:00.468667 53990 main.go:141] libmachine: (old-k8s-version-467811) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0229 18:34:00.468678 53990 main.go:141] libmachine: (old-k8s-version-467811) Creating domain...
I0229 18:34:00.470704 53990 main.go:141] libmachine: (old-k8s-version-467811) define libvirt domain using xml:
I0229 18:34:00.470721 53990 main.go:141] libmachine: (old-k8s-version-467811) <domain type='kvm'>
I0229 18:34:00.470732 53990 main.go:141] libmachine: (old-k8s-version-467811) <name>old-k8s-version-467811</name>
I0229 18:34:00.470740 53990 main.go:141] libmachine: (old-k8s-version-467811) <memory unit='MiB'>2200</memory>
I0229 18:34:00.470748 53990 main.go:141] libmachine: (old-k8s-version-467811) <vcpu>2</vcpu>
I0229 18:34:00.470755 53990 main.go:141] libmachine: (old-k8s-version-467811) <features>
I0229 18:34:00.470763 53990 main.go:141] libmachine: (old-k8s-version-467811) <acpi/>
I0229 18:34:00.470771 53990 main.go:141] libmachine: (old-k8s-version-467811) <apic/>
I0229 18:34:00.470779 53990 main.go:141] libmachine: (old-k8s-version-467811) <pae/>
I0229 18:34:00.470786 53990 main.go:141] libmachine: (old-k8s-version-467811)
I0229 18:34:00.470794 53990 main.go:141] libmachine: (old-k8s-version-467811) </features>
I0229 18:34:00.470801 53990 main.go:141] libmachine: (old-k8s-version-467811) <cpu mode='host-passthrough'>
I0229 18:34:00.470808 53990 main.go:141] libmachine: (old-k8s-version-467811)
I0229 18:34:00.470825 53990 main.go:141] libmachine: (old-k8s-version-467811) </cpu>
I0229 18:34:00.470833 53990 main.go:141] libmachine: (old-k8s-version-467811) <os>
I0229 18:34:00.470843 53990 main.go:141] libmachine: (old-k8s-version-467811) <type>hvm</type>
I0229 18:34:00.470851 53990 main.go:141] libmachine: (old-k8s-version-467811) <boot dev='cdrom'/>
I0229 18:34:00.470863 53990 main.go:141] libmachine: (old-k8s-version-467811) <boot dev='hd'/>
I0229 18:34:00.470872 53990 main.go:141] libmachine: (old-k8s-version-467811) <bootmenu enable='no'/>
I0229 18:34:00.470886 53990 main.go:141] libmachine: (old-k8s-version-467811) </os>
I0229 18:34:00.470894 53990 main.go:141] libmachine: (old-k8s-version-467811) <devices>
I0229 18:34:00.470902 53990 main.go:141] libmachine: (old-k8s-version-467811) <disk type='file' device='cdrom'>
I0229 18:34:00.470916 53990 main.go:141] libmachine: (old-k8s-version-467811) <source file='/home/jenkins/minikube-integration/18259-6402/.minikube/machines/old-k8s-version-467811/boot2docker.iso'/>
I0229 18:34:00.470924 53990 main.go:141] libmachine: (old-k8s-version-467811) <target dev='hdc' bus='scsi'/>
I0229 18:34:00.470955 53990 main.go:141] libmachine: (old-k8s-version-467811) <readonly/>
I0229 18:34:00.470977 53990 main.go:141] libmachine: (old-k8s-version-467811) </disk>
I0229 18:34:00.470988 53990 main.go:141] libmachine: (old-k8s-version-467811) <disk type='file' device='disk'>
I0229 18:34:00.471002 53990 main.go:141] libmachine: (old-k8s-version-467811) <driver name='qemu' type='raw' cache='default' io='threads' />
I0229 18:34:00.471018 53990 main.go:141] libmachine: (old-k8s-version-467811) <source file='/home/jenkins/minikube-integration/18259-6402/.minikube/machines/old-k8s-version-467811/old-k8s-version-467811.rawdisk'/>
I0229 18:34:00.471027 53990 main.go:141] libmachine: (old-k8s-version-467811) <target dev='hda' bus='virtio'/>
I0229 18:34:00.471036 53990 main.go:141] libmachine: (old-k8s-version-467811) </disk>
I0229 18:34:00.471057 53990 main.go:141] libmachine: (old-k8s-version-467811) <interface type='network'>
I0229 18:34:00.471068 53990 main.go:141] libmachine: (old-k8s-version-467811) <source network='mk-old-k8s-version-467811'/>
I0229 18:34:00.471080 53990 main.go:141] libmachine: (old-k8s-version-467811) <model type='virtio'/>
I0229 18:34:00.471089 53990 main.go:141] libmachine: (old-k8s-version-467811) </interface>
I0229 18:34:00.471097 53990 main.go:141] libmachine: (old-k8s-version-467811) <interface type='network'>
I0229 18:34:00.471107 53990 main.go:141] libmachine: (old-k8s-version-467811) <source network='default'/>
I0229 18:34:00.471115 53990 main.go:141] libmachine: (old-k8s-version-467811) <model type='virtio'/>
I0229 18:34:00.471125 53990 main.go:141] libmachine: (old-k8s-version-467811) </interface>
I0229 18:34:00.471132 53990 main.go:141] libmachine: (old-k8s-version-467811) <serial type='pty'>
I0229 18:34:00.471140 53990 main.go:141] libmachine: (old-k8s-version-467811) <target port='0'/>
I0229 18:34:00.471155 53990 main.go:141] libmachine: (old-k8s-version-467811) </serial>
I0229 18:34:00.471163 53990 main.go:141] libmachine: (old-k8s-version-467811) <console type='pty'>
I0229 18:34:00.471172 53990 main.go:141] libmachine: (old-k8s-version-467811) <target type='serial' port='0'/>
I0229 18:34:00.471179 53990 main.go:141] libmachine: (old-k8s-version-467811) </console>
I0229 18:34:00.471187 53990 main.go:141] libmachine: (old-k8s-version-467811) <rng model='virtio'>
I0229 18:34:00.471196 53990 main.go:141] libmachine: (old-k8s-version-467811) <backend model='random'>/dev/random</backend>
I0229 18:34:00.471204 53990 main.go:141] libmachine: (old-k8s-version-467811) </rng>
I0229 18:34:00.471210 53990 main.go:141] libmachine: (old-k8s-version-467811)
I0229 18:34:00.471217 53990 main.go:141] libmachine: (old-k8s-version-467811)
I0229 18:34:00.471224 53990 main.go:141] libmachine: (old-k8s-version-467811) </devices>
I0229 18:34:00.471233 53990 main.go:141] libmachine: (old-k8s-version-467811) </domain>
I0229 18:34:00.471239 53990 main.go:141] libmachine: (old-k8s-version-467811)
I0229 18:34:00.475831 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:69:4b:63 in network default
I0229 18:34:00.476561 53990 main.go:141] libmachine: (old-k8s-version-467811) Ensuring networks are active...
I0229 18:34:00.476584 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:00.477266 53990 main.go:141] libmachine: (old-k8s-version-467811) Ensuring network default is active
I0229 18:34:00.477735 53990 main.go:141] libmachine: (old-k8s-version-467811) Ensuring network mk-old-k8s-version-467811 is active
I0229 18:34:00.478350 53990 main.go:141] libmachine: (old-k8s-version-467811) Getting domain xml...
I0229 18:34:00.479071 53990 main.go:141] libmachine: (old-k8s-version-467811) Creating domain...
I0229 18:34:02.027767 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:02.027799 53990 main.go:141] libmachine: (old-k8s-version-467811) Waiting to get IP...
I0229 18:34:02.027811 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find current IP address of domain old-k8s-version-467811 in network mk-old-k8s-version-467811
I0229 18:34:02.027827 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:02.026985 54417 retry.go:31] will retry after 233.177492ms: waiting for machine to come up
I0229 18:34:02.261574 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:02.262204 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find current IP address of domain old-k8s-version-467811 in network mk-old-k8s-version-467811
I0229 18:34:02.262234 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:02.262161 54417 retry.go:31] will retry after 323.693072ms: waiting for machine to come up
I0229 18:34:02.587782 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:02.588479 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find current IP address of domain old-k8s-version-467811 in network mk-old-k8s-version-467811
I0229 18:34:02.588504 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:02.588394 54417 retry.go:31] will retry after 296.759826ms: waiting for machine to come up
I0229 18:34:02.886883 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:02.887476 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find current IP address of domain old-k8s-version-467811 in network mk-old-k8s-version-467811
I0229 18:34:02.887494 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:02.887427 54417 retry.go:31] will retry after 473.231873ms: waiting for machine to come up
I0229 18:34:03.361950 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:03.362514 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find current IP address of domain old-k8s-version-467811 in network mk-old-k8s-version-467811
I0229 18:34:03.362534 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:03.362433 54417 retry.go:31] will retry after 570.868856ms: waiting for machine to come up
I0229 18:34:03.935216 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:03.936161 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find current IP address of domain old-k8s-version-467811 in network mk-old-k8s-version-467811
I0229 18:34:03.936188 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:03.936085 54417 retry.go:31] will retry after 609.938031ms: waiting for machine to come up
I0229 18:34:04.547288 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:04.547866 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find current IP address of domain old-k8s-version-467811 in network mk-old-k8s-version-467811
I0229 18:34:04.547896 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:04.547813 54417 retry.go:31] will retry after 802.481749ms: waiting for machine to come up
I0229 18:34:05.351433 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:05.352034 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find current IP address of domain old-k8s-version-467811 in network mk-old-k8s-version-467811
I0229 18:34:05.352056 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:05.351954 54417 retry.go:31] will retry after 1.445057355s: waiting for machine to come up
I0229 18:34:06.798437 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:06.799001 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find current IP address of domain old-k8s-version-467811 in network mk-old-k8s-version-467811
I0229 18:34:06.799026 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:06.798949 54417 retry.go:31] will retry after 1.310293753s: waiting for machine to come up
I0229 18:34:08.111551 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:08.112150 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find current IP address of domain old-k8s-version-467811 in network mk-old-k8s-version-467811
I0229 18:34:08.112183 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:08.112112 54417 retry.go:31] will retry after 1.71169369s: waiting for machine to come up
I0229 18:34:10.081748 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:10.082353 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find current IP address of domain old-k8s-version-467811 in network mk-old-k8s-version-467811
I0229 18:34:10.082377 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:10.082304 54417 retry.go:31] will retry after 1.872855982s: waiting for machine to come up
I0229 18:34:11.957321 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:11.957885 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find current IP address of domain old-k8s-version-467811 in network mk-old-k8s-version-467811
I0229 18:34:11.957917 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:11.957832 54417 retry.go:31] will retry after 2.988421456s: waiting for machine to come up
I0229 18:34:14.948772 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:14.949277 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find current IP address of domain old-k8s-version-467811 in network mk-old-k8s-version-467811
I0229 18:34:14.949304 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:14.949242 54417 retry.go:31] will retry after 3.511636137s: waiting for machine to come up
I0229 18:34:18.462278 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:18.462871 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find current IP address of domain old-k8s-version-467811 in network mk-old-k8s-version-467811
I0229 18:34:18.462900 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | I0229 18:34:18.462824 54417 retry.go:31] will retry after 4.999228419s: waiting for machine to come up
I0229 18:34:23.465618 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:23.466261 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has current primary IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:23.466293 53990 main.go:141] libmachine: (old-k8s-version-467811) Found IP for machine: 192.168.72.30
I0229 18:34:23.466307 53990 main.go:141] libmachine: (old-k8s-version-467811) Reserving static IP address...
I0229 18:34:23.466659 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-467811", mac: "52:54:00:44:95:0e", ip: "192.168.72.30"} in network mk-old-k8s-version-467811
I0229 18:34:23.547827 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Getting to WaitForSSH function...
I0229 18:34:23.547855 53990 main.go:141] libmachine: (old-k8s-version-467811) Reserved static IP address: 192.168.72.30
I0229 18:34:23.547869 53990 main.go:141] libmachine: (old-k8s-version-467811) Waiting for SSH to be available...
I0229 18:34:23.550867 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:23.551335 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811
I0229 18:34:23.551363 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | unable to find defined IP address of network mk-old-k8s-version-467811 interface with MAC address 52:54:00:44:95:0e
I0229 18:34:23.551526 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Using SSH client type: external
I0229 18:34:23.551571 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Using SSH private key: /home/jenkins/minikube-integration/18259-6402/.minikube/machines/old-k8s-version-467811/id_rsa (-rw-------)
I0229 18:34:23.551609 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18259-6402/.minikube/machines/old-k8s-version-467811/id_rsa -p 22] /usr/bin/ssh <nil>}
I0229 18:34:23.551694 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | About to run SSH command:
I0229 18:34:23.551716 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | exit 0
I0229 18:34:23.555395 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | SSH cmd err, output: exit status 255:
I0229 18:34:23.555418 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0229 18:34:23.555429 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | command : exit 0
I0229 18:34:23.555442 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | err : exit status 255
I0229 18:34:23.555457 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | output :
I0229 18:34:26.556794 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Getting to WaitForSSH function...
I0229 18:34:26.559465 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:26.559886 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:26.559918 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:26.560059 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Using SSH client type: external
I0229 18:34:26.560090 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Using SSH private key: /home/jenkins/minikube-integration/18259-6402/.minikube/machines/old-k8s-version-467811/id_rsa (-rw-------)
I0229 18:34:26.560117 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.30 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18259-6402/.minikube/machines/old-k8s-version-467811/id_rsa -p 22] /usr/bin/ssh <nil>}
I0229 18:34:26.560129 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | About to run SSH command:
I0229 18:34:26.560145 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | exit 0
I0229 18:34:26.683859 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | SSH cmd err, output: <nil>:
I0229 18:34:26.684103 53990 main.go:141] libmachine: (old-k8s-version-467811) KVM machine creation complete!
I0229 18:34:26.684434 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetConfigRaw
I0229 18:34:26.684965 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .DriverName
I0229 18:34:26.685184 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .DriverName
I0229 18:34:26.685332 53990 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0229 18:34:26.685349 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetState
I0229 18:34:26.686560 53990 main.go:141] libmachine: Detecting operating system of created instance...
I0229 18:34:26.686574 53990 main.go:141] libmachine: Waiting for SSH to be available...
I0229 18:34:26.686580 53990 main.go:141] libmachine: Getting to WaitForSSH function...
I0229 18:34:26.686586 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHHostname
I0229 18:34:26.689147 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:26.689550 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:26.689574 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:26.689755 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHPort
I0229 18:34:26.689960 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:26.690140 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:26.690298 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHUsername
I0229 18:34:26.690442 53990 main.go:141] libmachine: Using SSH client type: native
I0229 18:34:26.690682 53990 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.72.30 22 <nil> <nil>}
I0229 18:34:26.690697 53990 main.go:141] libmachine: About to run SSH command:
exit 0
I0229 18:34:26.795716 53990 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0229 18:34:26.795744 53990 main.go:141] libmachine: Detecting the provisioner...
I0229 18:34:26.795755 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHHostname
I0229 18:34:26.798785 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:26.799155 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:26.799189 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:26.799347 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHPort
I0229 18:34:26.799585 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:26.799806 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:26.799993 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHUsername
I0229 18:34:26.800198 53990 main.go:141] libmachine: Using SSH client type: native
I0229 18:34:26.800374 53990 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.72.30 22 <nil> <nil>}
I0229 18:34:26.800386 53990 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0229 18:34:26.908919 53990 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0229 18:34:26.909017 53990 main.go:141] libmachine: found compatible host: buildroot
I0229 18:34:26.909030 53990 main.go:141] libmachine: Provisioning with buildroot...
I0229 18:34:26.909038 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetMachineName
I0229 18:34:26.909301 53990 buildroot.go:166] provisioning hostname "old-k8s-version-467811"
I0229 18:34:26.909332 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetMachineName
I0229 18:34:26.909506 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHHostname
I0229 18:34:26.912193 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:26.912622 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:26.912655 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:26.912736 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHPort
I0229 18:34:26.912934 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:26.913116 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:26.913277 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHUsername
I0229 18:34:26.913439 53990 main.go:141] libmachine: Using SSH client type: native
I0229 18:34:26.913621 53990 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.72.30 22 <nil> <nil>}
I0229 18:34:26.913635 53990 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-467811 && echo "old-k8s-version-467811" | sudo tee /etc/hostname
I0229 18:34:27.034868 53990 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-467811
I0229 18:34:27.034900 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHHostname
I0229 18:34:27.037607 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:27.037944 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:27.037971 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:27.038195 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHPort
I0229 18:34:27.038397 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:27.038580 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:27.038758 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHUsername
I0229 18:34:27.038946 53990 main.go:141] libmachine: Using SSH client type: native
I0229 18:34:27.039152 53990 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.72.30 22 <nil> <nil>}
I0229 18:34:27.039179 53990 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-467811' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-467811/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-467811' | sudo tee -a /etc/hosts;
fi
fi
I0229 18:34:27.154069 53990 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0229 18:34:27.154103 53990 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18259-6402/.minikube CaCertPath:/home/jenkins/minikube-integration/18259-6402/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18259-6402/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18259-6402/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18259-6402/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18259-6402/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18259-6402/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18259-6402/.minikube}
I0229 18:34:27.154124 53990 buildroot.go:174] setting up certificates
I0229 18:34:27.154136 53990 provision.go:83] configureAuth start
I0229 18:34:27.154149 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetMachineName
I0229 18:34:27.154487 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetIP
I0229 18:34:27.157195 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:27.157565 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:27.157607 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:27.157782 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHHostname
I0229 18:34:27.159967 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:27.160339 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:27.160369 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:27.160498 53990 provision.go:138] copyHostCerts
I0229 18:34:27.160553 53990 exec_runner.go:144] found /home/jenkins/minikube-integration/18259-6402/.minikube/key.pem, removing ...
I0229 18:34:27.160568 53990 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18259-6402/.minikube/key.pem
I0229 18:34:27.160621 53990 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18259-6402/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18259-6402/.minikube/key.pem (1675 bytes)
I0229 18:34:27.160695 53990 exec_runner.go:144] found /home/jenkins/minikube-integration/18259-6402/.minikube/ca.pem, removing ...
I0229 18:34:27.160702 53990 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18259-6402/.minikube/ca.pem
I0229 18:34:27.160722 53990 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18259-6402/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18259-6402/.minikube/ca.pem (1078 bytes)
I0229 18:34:27.160767 53990 exec_runner.go:144] found /home/jenkins/minikube-integration/18259-6402/.minikube/cert.pem, removing ...
I0229 18:34:27.160774 53990 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18259-6402/.minikube/cert.pem
I0229 18:34:27.160791 53990 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18259-6402/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18259-6402/.minikube/cert.pem (1123 bytes)
I0229 18:34:27.160851 53990 provision.go:112] generating server cert: /home/jenkins/minikube-integration/18259-6402/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18259-6402/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18259-6402/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-467811 san=[192.168.72.30 192.168.72.30 localhost 127.0.0.1 minikube old-k8s-version-467811]
I0229 18:34:27.392728 53990 provision.go:172] copyRemoteCerts
I0229 18:34:27.392781 53990 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0229 18:34:27.392811 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHHostname
I0229 18:34:27.395688 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:27.396063 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:27.396093 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:27.396234 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHPort
I0229 18:34:27.396417 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:27.396584 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHUsername
I0229 18:34:27.396718 53990 sshutil.go:53] new ssh client: &{IP:192.168.72.30 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18259-6402/.minikube/machines/old-k8s-version-467811/id_rsa Username:docker}
I0229 18:34:27.482614 53990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6402/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0229 18:34:27.508778 53990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6402/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I0229 18:34:27.535415 53990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6402/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0229 18:34:27.561421 53990 provision.go:86] duration metric: configureAuth took 407.271231ms
I0229 18:34:27.561451 53990 buildroot.go:189] setting minikube options for container-runtime
I0229 18:34:27.561618 53990 config.go:182] Loaded profile config "old-k8s-version-467811": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0229 18:34:27.561640 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .DriverName
I0229 18:34:27.561921 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHHostname
I0229 18:34:27.564690 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:27.565105 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:27.565135 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:27.565354 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHPort
I0229 18:34:27.565550 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:27.565729 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:27.565908 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHUsername
I0229 18:34:27.566075 53990 main.go:141] libmachine: Using SSH client type: native
I0229 18:34:27.566268 53990 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.72.30 22 <nil> <nil>}
I0229 18:34:27.566285 53990 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0229 18:34:27.677428 53990 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
I0229 18:34:27.677460 53990 buildroot.go:70] root file system type: tmpfs
I0229 18:34:27.677596 53990 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0229 18:34:27.677623 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHHostname
I0229 18:34:27.680394 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:27.680771 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:27.680797 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:27.681025 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHPort
I0229 18:34:27.681238 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:27.681410 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:27.681543 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHUsername
I0229 18:34:27.681703 53990 main.go:141] libmachine: Using SSH client type: native
I0229 18:34:27.681868 53990 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.72.30 22 <nil> <nil>}
I0229 18:34:27.681929 53990 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0229 18:34:27.802621 53990 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0229 18:34:27.802660 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHHostname
I0229 18:34:27.805623 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:27.806088 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:27.806115 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:27.806320 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHPort
I0229 18:34:27.806524 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:27.806684 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:27.806851 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHUsername
I0229 18:34:27.807030 53990 main.go:141] libmachine: Using SSH client type: native
I0229 18:34:27.807186 53990 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.72.30 22 <nil> <nil>}
I0229 18:34:27.807203 53990 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0229 18:34:28.725011 53990 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
I0229 18:34:28.725054 53990 main.go:141] libmachine: Checking connection to Docker...
I0229 18:34:28.725068 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetURL
I0229 18:34:28.726445 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | Using libvirt version 6000000
I0229 18:34:28.729267 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:28.729713 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:28.729742 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:28.729921 53990 main.go:141] libmachine: Docker is up and running!
I0229 18:34:28.729937 53990 main.go:141] libmachine: Reticulating splines...
I0229 18:34:28.729945 53990 client.go:171] LocalClient.Create took 28.746149655s
I0229 18:34:28.729970 53990 start.go:167] duration metric: libmachine.API.Create for "old-k8s-version-467811" took 28.746227721s
I0229 18:34:28.729982 53990 start.go:300] post-start starting for "old-k8s-version-467811" (driver="kvm2")
I0229 18:34:28.729997 53990 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0229 18:34:28.730021 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .DriverName
I0229 18:34:28.730285 53990 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0229 18:34:28.730339 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHHostname
I0229 18:34:28.732971 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:28.733294 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:28.733328 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:28.733488 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHPort
I0229 18:34:28.733651 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:28.733834 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHUsername
I0229 18:34:28.733983 53990 sshutil.go:53] new ssh client: &{IP:192.168.72.30 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18259-6402/.minikube/machines/old-k8s-version-467811/id_rsa Username:docker}
I0229 18:34:28.822829 53990 ssh_runner.go:195] Run: cat /etc/os-release
I0229 18:34:28.827135 53990 info.go:137] Remote host: Buildroot 2023.02.9
I0229 18:34:28.827158 53990 filesync.go:126] Scanning /home/jenkins/minikube-integration/18259-6402/.minikube/addons for local assets ...
I0229 18:34:28.827223 53990 filesync.go:126] Scanning /home/jenkins/minikube-integration/18259-6402/.minikube/files for local assets ...
I0229 18:34:28.827314 53990 filesync.go:149] local asset: /home/jenkins/minikube-integration/18259-6402/.minikube/files/etc/ssl/certs/136052.pem -> 136052.pem in /etc/ssl/certs
I0229 18:34:28.827427 53990 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0229 18:34:28.837626 53990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6402/.minikube/files/etc/ssl/certs/136052.pem --> /etc/ssl/certs/136052.pem (1708 bytes)
I0229 18:34:28.863118 53990 start.go:303] post-start completed in 133.119742ms
I0229 18:34:28.863175 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetConfigRaw
I0229 18:34:28.863772 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetIP
I0229 18:34:28.866291 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:28.866700 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:28.866740 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:28.866947 53990 profile.go:148] Saving config to /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/config.json ...
I0229 18:34:28.867132 53990 start.go:128] duration metric: createHost completed in 28.905752377s
I0229 18:34:28.867171 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHHostname
I0229 18:34:28.869437 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:28.869775 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:28.869807 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:28.869958 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHPort
I0229 18:34:28.870166 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:28.870340 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:28.870507 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHUsername
I0229 18:34:28.870666 53990 main.go:141] libmachine: Using SSH client type: native
I0229 18:34:28.870886 53990 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.72.30 22 <nil> <nil>}
I0229 18:34:28.870901 53990 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0229 18:34:28.981844 53990 main.go:141] libmachine: SSH cmd err, output: <nil>: 1709231668.969463493
I0229 18:34:28.981872 53990 fix.go:206] guest clock: 1709231668.969463493
I0229 18:34:28.981882 53990 fix.go:219] Guest: 2024-02-29 18:34:28.969463493 +0000 UTC Remote: 2024-02-29 18:34:28.867144245 +0000 UTC m=+35.528531857 (delta=102.319248ms)
I0229 18:34:28.981921 53990 fix.go:190] guest clock delta is within tolerance: 102.319248ms
I0229 18:34:28.981934 53990 start.go:83] releasing machines lock for "old-k8s-version-467811", held for 29.02071355s
I0229 18:34:28.981963 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .DriverName
I0229 18:34:28.982260 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetIP
I0229 18:34:28.985654 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:28.986022 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:28.986044 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:28.986239 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .DriverName
I0229 18:34:28.986805 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .DriverName
I0229 18:34:28.986985 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .DriverName
I0229 18:34:28.987080 53990 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0229 18:34:28.987134 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHHostname
I0229 18:34:28.987391 53990 ssh_runner.go:195] Run: cat /version.json
I0229 18:34:28.987418 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHHostname
I0229 18:34:28.990270 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:28.991522 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHPort
I0229 18:34:28.991529 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:28.991562 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:28.991586 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:28.991839 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:28.991934 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:28.991955 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:28.992059 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHUsername
I0229 18:34:28.992171 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHPort
I0229 18:34:28.992243 53990 sshutil.go:53] new ssh client: &{IP:192.168.72.30 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18259-6402/.minikube/machines/old-k8s-version-467811/id_rsa Username:docker}
I0229 18:34:28.992498 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHKeyPath
I0229 18:34:28.992660 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetSSHUsername
I0229 18:34:28.992820 53990 sshutil.go:53] new ssh client: &{IP:192.168.72.30 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18259-6402/.minikube/machines/old-k8s-version-467811/id_rsa Username:docker}
I0229 18:34:29.077406 53990 ssh_runner.go:195] Run: systemctl --version
I0229 18:34:29.107166 53990 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0229 18:34:29.114413 53990 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0229 18:34:29.114495 53990 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
I0229 18:34:29.128723 53990 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
I0229 18:34:29.155012 53990 cni.go:308] configured [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0229 18:34:29.155050 53990 start.go:475] detecting cgroup driver to use...
I0229 18:34:29.155194 53990 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0229 18:34:29.189681 53990 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.1"|' /etc/containerd/config.toml"
I0229 18:34:29.208262 53990 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0229 18:34:29.227551 53990 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0229 18:34:29.227748 53990 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0229 18:34:29.239936 53990 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0229 18:34:29.252386 53990 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0229 18:34:29.270039 53990 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0229 18:34:29.285216 53990 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0229 18:34:29.299942 53990 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0229 18:34:29.311956 53990 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0229 18:34:29.322487 53990 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0229 18:34:29.333087 53990 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0229 18:34:29.481542 53990 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0229 18:34:29.509290 53990 start.go:475] detecting cgroup driver to use...
I0229 18:34:29.509395 53990 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0229 18:34:29.528220 53990 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0229 18:34:29.551338 53990 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0229 18:34:29.572812 53990 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0229 18:34:29.589572 53990 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0229 18:34:29.604441 53990 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0229 18:34:29.633296 53990 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0229 18:34:29.650860 53990 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0229 18:34:29.674636 53990 ssh_runner.go:195] Run: which cri-dockerd
I0229 18:34:29.679665 53990 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0229 18:34:29.691038 53990 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0229 18:34:29.711155 53990 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0229 18:34:29.853462 53990 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0229 18:34:29.995486 53990 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0229 18:34:29.995701 53990 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0229 18:34:30.017180 53990 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0229 18:34:30.157763 53990 ssh_runner.go:195] Run: sudo systemctl restart docker
I0229 18:34:31.640649 53990 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.482771761s)
I0229 18:34:31.640812 53990 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0229 18:34:31.672659 53990 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0229 18:34:31.709597 53990 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 24.0.7 ...
I0229 18:34:31.709656 53990 main.go:141] libmachine: (old-k8s-version-467811) Calling .GetIP
I0229 18:34:31.712876 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:31.713338 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:44:95:0e", ip: ""} in network mk-old-k8s-version-467811: {Iface:virbr2 ExpiryTime:2024-02-29 19:34:16 +0000 UTC Type:0 Mac:52:54:00:44:95:0e Iaid: IPaddr:192.168.72.30 Prefix:24 Hostname:old-k8s-version-467811 Clientid:01:52:54:00:44:95:0e}
I0229 18:34:31.713363 53990 main.go:141] libmachine: (old-k8s-version-467811) DBG | domain old-k8s-version-467811 has defined IP address 192.168.72.30 and MAC address 52:54:00:44:95:0e in network mk-old-k8s-version-467811
I0229 18:34:31.713698 53990 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0229 18:34:31.719107 53990 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0229 18:34:31.736384 53990 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0229 18:34:31.736464 53990 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0229 18:34:31.756440 53990 docker.go:685] Got preloaded images:
I0229 18:34:31.756470 53990 docker.go:691] registry.k8s.io/kube-apiserver:v1.16.0 wasn't preloaded
I0229 18:34:31.756522 53990 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
I0229 18:34:31.768429 53990 ssh_runner.go:195] Run: which lz4
I0229 18:34:31.773425 53990 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0229 18:34:31.779081 53990 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0229 18:34:31.779121 53990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6402/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (369789069 bytes)
I0229 18:34:33.339142 53990 docker.go:649] Took 1.565750 seconds to copy over tarball
I0229 18:34:33.339230 53990 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0229 18:34:35.830277 53990 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.491017242s)
I0229 18:34:35.830306 53990 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0229 18:34:35.867468 53990 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
I0229 18:34:35.878987 53990 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2499 bytes)
I0229 18:34:35.903390 53990 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0229 18:34:36.025556 53990 ssh_runner.go:195] Run: sudo systemctl restart docker
I0229 18:34:37.682270 53990 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.656673513s)
I0229 18:34:37.682380 53990 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0229 18:34:37.714918 53990 docker.go:685] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0229 18:34:37.714936 53990 docker.go:691] registry.k8s.io/kube-apiserver:v1.16.0 wasn't preloaded
I0229 18:34:37.714945 53990 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.16.0 registry.k8s.io/kube-controller-manager:v1.16.0 registry.k8s.io/kube-scheduler:v1.16.0 registry.k8s.io/kube-proxy:v1.16.0 registry.k8s.io/pause:3.1 registry.k8s.io/etcd:3.3.15-0 registry.k8s.io/coredns:1.6.2 gcr.io/k8s-minikube/storage-provisioner:v5]
I0229 18:34:37.717268 53990 image.go:134] retrieving image: registry.k8s.io/etcd:3.3.15-0
I0229 18:34:37.717380 53990 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.16.0
I0229 18:34:37.717402 53990 image.go:134] retrieving image: registry.k8s.io/pause:3.1
I0229 18:34:37.717264 53990 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.2
I0229 18:34:37.717454 53990 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0229 18:34:37.717648 53990 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 18:34:37.717657 53990 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 18:34:37.717685 53990 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 18:34:37.718860 53990 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.2: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.2
I0229 18:34:37.719001 53990 image.go:177] daemon lookup for registry.k8s.io/etcd:3.3.15-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.3.15-0
I0229 18:34:37.719084 53990 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0229 18:34:37.719142 53990 image.go:177] daemon lookup for registry.k8s.io/pause:3.1: Error response from daemon: No such image: registry.k8s.io/pause:3.1
I0229 18:34:37.719172 53990 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 18:34:37.719300 53990 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 18:34:37.719072 53990 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.16.0
I0229 18:34:37.719391 53990 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 18:34:37.851096 53990 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.16.0
I0229 18:34:37.852836 53990 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.16.0
I0229 18:34:37.859293 53990 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.2
I0229 18:34:37.859453 53990 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.1
I0229 18:34:37.868936 53990 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.16.0
I0229 18:34:37.887966 53990 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.16.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.16.0" does not exist at hash "b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e" in container runtime
I0229 18:34:37.888040 53990 docker.go:337] Removing image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 18:34:37.888107 53990 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.16.0
I0229 18:34:37.892888 53990 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.16.0
I0229 18:34:37.894833 53990 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.16.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.16.0" does not exist at hash "301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a" in container runtime
I0229 18:34:37.894881 53990 docker.go:337] Removing image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 18:34:37.894937 53990 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.16.0
I0229 18:34:37.903178 53990 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.3.15-0
I0229 18:34:37.957084 53990 cache_images.go:116] "registry.k8s.io/pause:3.1" needs transfer: "registry.k8s.io/pause:3.1" does not exist at hash "da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e" in container runtime
I0229 18:34:37.957152 53990 cache_images.go:116] "registry.k8s.io/coredns:1.6.2" needs transfer: "registry.k8s.io/coredns:1.6.2" does not exist at hash "bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b" in container runtime
I0229 18:34:37.957202 53990 docker.go:337] Removing image: registry.k8s.io/pause:3.1
I0229 18:34:37.957215 53990 docker.go:337] Removing image: registry.k8s.io/coredns:1.6.2
I0229 18:34:37.957259 53990 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.16.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.16.0" does not exist at hash "06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d" in container runtime
I0229 18:34:37.957279 53990 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns:1.6.2
I0229 18:34:37.957308 53990 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.1
I0229 18:34:37.957291 53990 docker.go:337] Removing image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 18:34:37.957455 53990 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.16.0
I0229 18:34:37.991689 53990 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6402/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0
I0229 18:34:38.000485 53990 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.16.0" needs transfer: "registry.k8s.io/kube-proxy:v1.16.0" does not exist at hash "c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384" in container runtime
I0229 18:34:38.000541 53990 docker.go:337] Removing image: registry.k8s.io/kube-proxy:v1.16.0
I0229 18:34:38.000593 53990 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.16.0
I0229 18:34:38.000727 53990 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6402/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0
I0229 18:34:38.000793 53990 cache_images.go:116] "registry.k8s.io/etcd:3.3.15-0" needs transfer: "registry.k8s.io/etcd:3.3.15-0" does not exist at hash "b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed" in container runtime
I0229 18:34:38.000820 53990 docker.go:337] Removing image: registry.k8s.io/etcd:3.3.15-0
I0229 18:34:38.000859 53990 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.3.15-0
I0229 18:34:38.042910 53990 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6402/.minikube/cache/images/amd64/registry.k8s.io/pause_3.1
I0229 18:34:38.047717 53990 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6402/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2
I0229 18:34:38.052380 53990 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6402/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.16.0
I0229 18:34:38.060998 53990 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6402/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0
I0229 18:34:38.061072 53990 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6402/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.3.15-0
I0229 18:34:38.359210 53990 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0229 18:34:38.386801 53990 cache_images.go:92] LoadImages completed in 671.839501ms
W0229 18:34:38.386918 53990 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18259-6402/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18259-6402/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0: no such file or directory
I0229 18:34:38.386992 53990 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0229 18:34:38.423125 53990 cni.go:84] Creating CNI manager for ""
I0229 18:34:38.423158 53990 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0229 18:34:38.423176 53990 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0229 18:34:38.423199 53990 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.30 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-467811 NodeName:old-k8s-version-467811 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.30"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.30 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stat
icPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0229 18:34:38.423393 53990 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.30
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-467811"
kubeletExtraArgs:
node-ip: 192.168.72.30
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.30"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-467811
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.72.30:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0229 18:34:38.423503 53990 kubeadm.go:976] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-467811 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.72.30
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-467811 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0229 18:34:38.423577 53990 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0229 18:34:38.438566 53990 binaries.go:44] Found k8s binaries, skipping transfer
I0229 18:34:38.438650 53990 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0229 18:34:38.453359 53990 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (349 bytes)
I0229 18:34:38.477964 53990 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0229 18:34:38.502349 53990 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2178 bytes)
I0229 18:34:38.534066 53990 ssh_runner.go:195] Run: grep 192.168.72.30 control-plane.minikube.internal$ /etc/hosts
I0229 18:34:38.539990 53990 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.30 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0229 18:34:38.557291 53990 certs.go:56] Setting up /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811 for IP: 192.168.72.30
I0229 18:34:38.557327 53990 certs.go:190] acquiring lock for shared ca certs: {Name:mk2b1e0afe2a06bed6008eeccac41dd786e239ea Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:34:38.557524 53990 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/18259-6402/.minikube/ca.key
I0229 18:34:38.557588 53990 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/18259-6402/.minikube/proxy-client-ca.key
I0229 18:34:38.557647 53990 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/client.key
I0229 18:34:38.557666 53990 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/client.crt with IP's: []
I0229 18:34:38.638135 53990 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/client.crt ...
I0229 18:34:38.638167 53990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/client.crt: {Name:mk56f32ef252300376ddfc10e5de3f49a1214e1d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:34:38.638376 53990 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/client.key ...
I0229 18:34:38.638394 53990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/client.key: {Name:mk3e1333b883af66519f16943defd54a63c162ae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:34:38.638485 53990 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/apiserver.key.28caea67
I0229 18:34:38.638500 53990 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/apiserver.crt.28caea67 with IP's: [192.168.72.30 10.96.0.1 127.0.0.1 10.0.0.1]
I0229 18:34:38.898944 53990 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/apiserver.crt.28caea67 ...
I0229 18:34:38.898986 53990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/apiserver.crt.28caea67: {Name:mk8dff4862dad4ce3a08c4c46b19ee50c5f1d640 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:34:38.899184 53990 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/apiserver.key.28caea67 ...
I0229 18:34:38.899205 53990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/apiserver.key.28caea67: {Name:mkd434d47b82a38f024cc2430a84569a754f327d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:34:38.899326 53990 certs.go:337] copying /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/apiserver.crt.28caea67 -> /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/apiserver.crt
I0229 18:34:38.899443 53990 certs.go:341] copying /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/apiserver.key.28caea67 -> /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/apiserver.key
I0229 18:34:38.899545 53990 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/proxy-client.key
I0229 18:34:38.899569 53990 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/proxy-client.crt with IP's: []
I0229 18:34:39.044450 53990 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/proxy-client.crt ...
I0229 18:34:39.044491 53990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/proxy-client.crt: {Name:mk64319f3224aa460ff318ce74243456d77b0aa2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:34:39.044722 53990 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/proxy-client.key ...
I0229 18:34:39.044745 53990 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/proxy-client.key: {Name:mkde13ec3e514533928b1b0c78aca81e8a93802b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:34:39.045025 53990 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6402/.minikube/certs/home/jenkins/minikube-integration/18259-6402/.minikube/certs/13605.pem (1338 bytes)
W0229 18:34:39.045083 53990 certs.go:433] ignoring /home/jenkins/minikube-integration/18259-6402/.minikube/certs/home/jenkins/minikube-integration/18259-6402/.minikube/certs/13605_empty.pem, impossibly tiny 0 bytes
I0229 18:34:39.045103 53990 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6402/.minikube/certs/home/jenkins/minikube-integration/18259-6402/.minikube/certs/ca-key.pem (1675 bytes)
I0229 18:34:39.045143 53990 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6402/.minikube/certs/home/jenkins/minikube-integration/18259-6402/.minikube/certs/ca.pem (1078 bytes)
I0229 18:34:39.045182 53990 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6402/.minikube/certs/home/jenkins/minikube-integration/18259-6402/.minikube/certs/cert.pem (1123 bytes)
I0229 18:34:39.045209 53990 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6402/.minikube/certs/home/jenkins/minikube-integration/18259-6402/.minikube/certs/key.pem (1675 bytes)
I0229 18:34:39.045259 53990 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6402/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/18259-6402/.minikube/files/etc/ssl/certs/136052.pem (1708 bytes)
I0229 18:34:39.045783 53990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0229 18:34:39.078107 53990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0229 18:34:39.113355 53990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0229 18:34:39.148277 53990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6402/.minikube/profiles/old-k8s-version-467811/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0229 18:34:39.180788 53990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6402/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0229 18:34:39.215355 53990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6402/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0229 18:34:39.253008 53990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6402/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0229 18:34:39.291726 53990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6402/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0229 18:34:39.333718 53990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6402/.minikube/files/etc/ssl/certs/136052.pem --> /usr/share/ca-certificates/136052.pem (1708 bytes)
I0229 18:34:39.383526 53990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6402/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0229 18:34:39.424158 53990 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6402/.minikube/certs/13605.pem --> /usr/share/ca-certificates/13605.pem (1338 bytes)
I0229 18:34:39.462777 53990 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0229 18:34:39.491185 53990 ssh_runner.go:195] Run: openssl version
I0229 18:34:39.499846 53990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0229 18:34:39.517395 53990 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0229 18:34:39.524676 53990 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Feb 29 17:38 /usr/share/ca-certificates/minikubeCA.pem
I0229 18:34:39.524752 53990 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0229 18:34:39.533980 53990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0229 18:34:39.554539 53990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/13605.pem && ln -fs /usr/share/ca-certificates/13605.pem /etc/ssl/certs/13605.pem"
I0229 18:34:39.571825 53990 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/13605.pem
I0229 18:34:39.578984 53990 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Feb 29 17:42 /usr/share/ca-certificates/13605.pem
I0229 18:34:39.579057 53990 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/13605.pem
I0229 18:34:39.588042 53990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/13605.pem /etc/ssl/certs/51391683.0"
I0229 18:34:39.606277 53990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/136052.pem && ln -fs /usr/share/ca-certificates/136052.pem /etc/ssl/certs/136052.pem"
I0229 18:34:39.624185 53990 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/136052.pem
I0229 18:34:39.630834 53990 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Feb 29 17:42 /usr/share/ca-certificates/136052.pem
I0229 18:34:39.630895 53990 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/136052.pem
I0229 18:34:39.639268 53990 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/136052.pem /etc/ssl/certs/3ec20f2e.0"
I0229 18:34:39.657318 53990 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I0229 18:34:39.663077 53990 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
I0229 18:34:39.663163 53990 kubeadm.go:404] StartCluster: {Name:old-k8s-version-467811 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVe
rsion:v1.16.0 ClusterName:old-k8s-version-467811 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.72.30 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0229 18:34:39.663375 53990 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0229 18:34:39.689331 53990 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0229 18:34:39.705598 53990 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0229 18:34:39.721332 53990 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0229 18:34:39.737469 53990 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0229 18:34:39.737520 53990 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0229 18:34:39.888161 53990 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0229 18:34:39.888235 53990 kubeadm.go:322] [preflight] Running pre-flight checks
I0229 18:34:40.287298 53990 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0229 18:34:40.287422 53990 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0229 18:34:40.287531 53990 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0229 18:34:40.528115 53990 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0229 18:34:40.530839 53990 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0229 18:34:40.544232 53990 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0229 18:34:40.721748 53990 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0229 18:34:40.724394 53990 out.go:204] - Generating certificates and keys ...
I0229 18:34:40.724501 53990 kubeadm.go:322] [certs] Using existing ca certificate authority
I0229 18:34:40.724579 53990 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0229 18:34:40.942186 53990 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I0229 18:34:41.092727 53990 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I0229 18:34:41.227802 53990 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I0229 18:34:41.500011 53990 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I0229 18:34:41.578558 53990 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I0229 18:34:41.578848 53990 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [old-k8s-version-467811 localhost] and IPs [192.168.72.30 127.0.0.1 ::1]
I0229 18:34:42.060544 53990 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I0229 18:34:42.060874 53990 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-467811 localhost] and IPs [192.168.72.30 127.0.0.1 ::1]
I0229 18:34:42.292088 53990 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I0229 18:34:42.768555 53990 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I0229 18:34:43.025508 53990 kubeadm.go:322] [certs] Generating "sa" key and public key
I0229 18:34:43.025817 53990 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0229 18:34:43.562736 53990 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0229 18:34:43.980931 53990 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0229 18:34:44.101330 53990 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0229 18:34:44.171579 53990 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0229 18:34:44.172528 53990 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0229 18:34:44.174249 53990 out.go:204] - Booting up control plane ...
I0229 18:34:44.174379 53990 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0229 18:34:44.180611 53990 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0229 18:34:44.182430 53990 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0229 18:34:44.184045 53990 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0229 18:34:44.187894 53990 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0229 18:35:24.184992 53990 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0229 18:35:24.185697 53990 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:35:24.185984 53990 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:35:29.186541 53990 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:35:29.186844 53990 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:35:39.189963 53990 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:35:39.190202 53990 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:35:59.189826 53990 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:35:59.190065 53990 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:36:39.190391 53990 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:36:39.190997 53990 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:36:39.191022 53990 kubeadm.go:322]
I0229 18:36:39.191122 53990 kubeadm.go:322] Unfortunately, an error has occurred:
I0229 18:36:39.191228 53990 kubeadm.go:322] timed out waiting for the condition
I0229 18:36:39.191243 53990 kubeadm.go:322]
I0229 18:36:39.191322 53990 kubeadm.go:322] This error is likely caused by:
I0229 18:36:39.191404 53990 kubeadm.go:322] - The kubelet is not running
I0229 18:36:39.191672 53990 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0229 18:36:39.191689 53990 kubeadm.go:322]
I0229 18:36:39.191964 53990 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0229 18:36:39.192068 53990 kubeadm.go:322] - 'systemctl status kubelet'
I0229 18:36:39.192172 53990 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0229 18:36:39.192183 53990 kubeadm.go:322]
I0229 18:36:39.192446 53990 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0229 18:36:39.192685 53990 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0229 18:36:39.192866 53990 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0229 18:36:39.192983 53990 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0229 18:36:39.193149 53990 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0229 18:36:39.193249 53990 kubeadm.go:322] - 'docker logs CONTAINERID'
I0229 18:36:39.194509 53990 kubeadm.go:322] [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
I0229 18:36:39.194690 53990 kubeadm.go:322] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
I0229 18:36:39.194820 53990 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0229 18:36:39.194943 53990 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0229 18:36:39.195080 53990 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
W0229 18:36:39.195222 53990 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-467811 localhost] and IPs [192.168.72.30 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-467811 localhost] and IPs [192.168.72.30 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-467811 localhost] and IPs [192.168.72.30 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-467811 localhost] and IPs [192.168.72.30 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0229 18:36:39.195309 53990 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0229 18:36:39.681779 53990 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0229 18:36:39.698114 53990 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0229 18:36:39.709496 53990 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0229 18:36:39.709537 53990 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0229 18:36:39.881267 53990 kubeadm.go:322] [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
I0229 18:36:39.915206 53990 kubeadm.go:322] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
I0229 18:36:40.012379 53990 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0229 18:38:36.006516 53990 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0229 18:38:36.006633 53990 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
I0229 18:38:36.008331 53990 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0229 18:38:36.008391 53990 kubeadm.go:322] [preflight] Running pre-flight checks
I0229 18:38:36.008476 53990 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0229 18:38:36.008622 53990 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0229 18:38:36.008737 53990 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0229 18:38:36.008865 53990 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0229 18:38:36.008993 53990 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0229 18:38:36.009074 53990 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0229 18:38:36.009155 53990 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0229 18:38:36.011175 53990 out.go:204] - Generating certificates and keys ...
I0229 18:38:36.011292 53990 kubeadm.go:322] [certs] Using existing ca certificate authority
I0229 18:38:36.011405 53990 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0229 18:38:36.011524 53990 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0229 18:38:36.011629 53990 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority
I0229 18:38:36.011759 53990 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk
I0229 18:38:36.011847 53990 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority
I0229 18:38:36.011953 53990 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk
I0229 18:38:36.012034 53990 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk
I0229 18:38:36.012145 53990 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0229 18:38:36.012246 53990 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0229 18:38:36.012325 53990 kubeadm.go:322] [certs] Using the existing "sa" key
I0229 18:38:36.012412 53990 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0229 18:38:36.012477 53990 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0229 18:38:36.012522 53990 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0229 18:38:36.012577 53990 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0229 18:38:36.012648 53990 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0229 18:38:36.012754 53990 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0229 18:38:36.014285 53990 out.go:204] - Booting up control plane ...
I0229 18:38:36.014375 53990 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0229 18:38:36.014458 53990 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0229 18:38:36.014549 53990 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0229 18:38:36.014671 53990 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0229 18:38:36.014839 53990 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0229 18:38:36.014914 53990 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0229 18:38:36.014994 53990 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:38:36.015147 53990 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:38:36.015205 53990 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:38:36.015427 53990 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:38:36.015547 53990 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:38:36.015825 53990 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:38:36.015919 53990 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:38:36.016175 53990 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:38:36.016283 53990 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:38:36.016512 53990 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:38:36.016524 53990 kubeadm.go:322]
I0229 18:38:36.016592 53990 kubeadm.go:322] Unfortunately, an error has occurred:
I0229 18:38:36.016655 53990 kubeadm.go:322] timed out waiting for the condition
I0229 18:38:36.016686 53990 kubeadm.go:322]
I0229 18:38:36.016735 53990 kubeadm.go:322] This error is likely caused by:
I0229 18:38:36.016785 53990 kubeadm.go:322] - The kubelet is not running
I0229 18:38:36.016900 53990 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0229 18:38:36.016909 53990 kubeadm.go:322]
I0229 18:38:36.017031 53990 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0229 18:38:36.017081 53990 kubeadm.go:322] - 'systemctl status kubelet'
I0229 18:38:36.017126 53990 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0229 18:38:36.017137 53990 kubeadm.go:322]
I0229 18:38:36.017283 53990 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0229 18:38:36.017422 53990 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0229 18:38:36.017534 53990 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0229 18:38:36.017602 53990 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0229 18:38:36.017699 53990 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0229 18:38:36.017822 53990 kubeadm.go:406] StartCluster complete in 3m56.354664464s
I0229 18:38:36.017919 53990 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0229 18:38:36.018012 53990 kubeadm.go:322] - 'docker logs CONTAINERID'
I0229 18:38:36.050379 53990 logs.go:276] 0 containers: []
W0229 18:38:36.050404 53990 logs.go:278] No container was found matching "kube-apiserver"
I0229 18:38:36.050458 53990 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0229 18:38:36.073442 53990 logs.go:276] 0 containers: []
W0229 18:38:36.073477 53990 logs.go:278] No container was found matching "etcd"
I0229 18:38:36.073537 53990 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0229 18:38:36.102887 53990 logs.go:276] 0 containers: []
W0229 18:38:36.102915 53990 logs.go:278] No container was found matching "coredns"
I0229 18:38:36.102977 53990 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0229 18:38:36.126038 53990 logs.go:276] 0 containers: []
W0229 18:38:36.126065 53990 logs.go:278] No container was found matching "kube-scheduler"
I0229 18:38:36.126122 53990 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0229 18:38:36.149058 53990 logs.go:276] 0 containers: []
W0229 18:38:36.149089 53990 logs.go:278] No container was found matching "kube-proxy"
I0229 18:38:36.149155 53990 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0229 18:38:36.168804 53990 logs.go:276] 0 containers: []
W0229 18:38:36.168835 53990 logs.go:278] No container was found matching "kube-controller-manager"
I0229 18:38:36.168895 53990 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0229 18:38:36.189748 53990 logs.go:276] 0 containers: []
W0229 18:38:36.189779 53990 logs.go:278] No container was found matching "kindnet"
I0229 18:38:36.189793 53990 logs.go:123] Gathering logs for kubelet ...
I0229 18:38:36.189809 53990 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0229 18:38:36.246130 53990 logs.go:123] Gathering logs for dmesg ...
I0229 18:38:36.246163 53990 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0229 18:38:36.263150 53990 logs.go:123] Gathering logs for describe nodes ...
I0229 18:38:36.263179 53990 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0229 18:38:36.337294 53990 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0229 18:38:36.337320 53990 logs.go:123] Gathering logs for Docker ...
I0229 18:38:36.337341 53990 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0229 18:38:36.380441 53990 logs.go:123] Gathering logs for container status ...
I0229 18:38:36.380474 53990 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0229 18:38:36.448817 53990 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 18:38:36.448883 53990 out.go:239] *
*
W0229 18:38:36.448943 53990 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 18:38:36.448977 53990 out.go:239] *
*
W0229 18:38:36.449833 53990 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0229 18:38:36.453093 53990 out.go:177]
W0229 18:38:36.454435 53990 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 18:38:36.454495 53990 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0229 18:38:36.454525 53990 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0229 18:38:36.456057 53990 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-467811 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-467811 -n old-k8s-version-467811
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-467811 -n old-k8s-version-467811: exit status 6 (279.980121ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0229 18:38:36.780047 60554 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-467811" does not appear in /home/jenkins/minikube-integration/18259-6402/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-467811" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (283.46s)