=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-096771 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --kubernetes-version=v1.16.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-096771 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --kubernetes-version=v1.16.0: exit status 109 (4m43.205729249s)
-- stdout --
* [old-k8s-version-096771] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18063
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18063-115328/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18063-115328/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting control plane node old-k8s-version-096771 in cluster old-k8s-version-096771
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.16.0 on Docker 24.0.7 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0229 01:43:27.652494 163581 out.go:291] Setting OutFile to fd 1 ...
I0229 01:43:27.652644 163581 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0229 01:43:27.652657 163581 out.go:304] Setting ErrFile to fd 2...
I0229 01:43:27.652664 163581 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0229 01:43:27.652973 163581 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18063-115328/.minikube/bin
I0229 01:43:27.654161 163581 out.go:298] Setting JSON to false
I0229 01:43:27.655880 163581 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-2","uptime":5159,"bootTime":1709165849,"procs":296,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0229 01:43:27.656063 163581 start.go:139] virtualization: kvm guest
I0229 01:43:27.658256 163581 out.go:177] * [old-k8s-version-096771] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0229 01:43:27.659651 163581 out.go:177] - MINIKUBE_LOCATION=18063
I0229 01:43:27.659654 163581 notify.go:220] Checking for updates...
I0229 01:43:27.660996 163581 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0229 01:43:27.662357 163581 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18063-115328/kubeconfig
I0229 01:43:27.663672 163581 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18063-115328/.minikube
I0229 01:43:27.664988 163581 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0229 01:43:27.666277 163581 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0229 01:43:27.668129 163581 config.go:182] Loaded profile config "bridge-579291": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0229 01:43:27.668262 163581 config.go:182] Loaded profile config "flannel-579291": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0229 01:43:27.668399 163581 config.go:182] Loaded profile config "kubenet-579291": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0229 01:43:27.668522 163581 driver.go:392] Setting default libvirt URI to qemu:///system
I0229 01:43:27.722210 163581 out.go:177] * Using the kvm2 driver based on user configuration
I0229 01:43:27.723494 163581 start.go:299] selected driver: kvm2
I0229 01:43:27.723522 163581 start.go:903] validating driver "kvm2" against <nil>
I0229 01:43:27.723538 163581 start.go:914] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0229 01:43:27.724687 163581 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0229 01:43:27.724773 163581 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18063-115328/.minikube/bin:/home/jenkins/workspace/KVM_Linux_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0229 01:43:27.746336 163581 install.go:137] /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0229 01:43:27.746433 163581 start_flags.go:309] no existing cluster config was found, will generate one from the flags
I0229 01:43:27.746767 163581 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0229 01:43:27.746876 163581 cni.go:84] Creating CNI manager for ""
I0229 01:43:27.746916 163581 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0229 01:43:27.746931 163581 start_flags.go:323] config:
{Name:old-k8s-version-096771 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-096771 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR
untime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0229 01:43:27.747143 163581 iso.go:125] acquiring lock: {Name:mka80d573fa8b54775426ef2857d894d76900941 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0229 01:43:27.749949 163581 out.go:177] * Starting control plane node old-k8s-version-096771 in cluster old-k8s-version-096771
I0229 01:43:27.751383 163581 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0229 01:43:27.751429 163581 preload.go:148] Found local preload: /home/jenkins/minikube-integration/18063-115328/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4
I0229 01:43:27.751447 163581 cache.go:56] Caching tarball of preloaded images
I0229 01:43:27.751567 163581 preload.go:174] Found /home/jenkins/minikube-integration/18063-115328/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0229 01:43:27.751581 163581 cache.go:59] Finished verifying existence of preloaded tar for v1.16.0 on docker
I0229 01:43:27.751714 163581 profile.go:148] Saving config to /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/config.json ...
I0229 01:43:27.751741 163581 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/config.json: {Name:mk72a390350674ee683fc8e6e28419dbf3f25f55 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 01:43:27.751951 163581 start.go:365] acquiring machines lock for old-k8s-version-096771: {Name:mk4840bd51ce9e92879b51fa6af485d250291115 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0229 01:43:35.178958 163581 start.go:369] acquired machines lock for "old-k8s-version-096771" in 7.426927536s
I0229 01:43:35.179018 163581 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-096771 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-096771 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountM
Size:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0229 01:43:35.179142 163581 start.go:125] createHost starting for "" (driver="kvm2")
I0229 01:43:35.181596 163581 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0229 01:43:35.181863 163581 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2
I0229 01:43:35.181914 163581 main.go:141] libmachine: Launching plugin server for driver kvm2
I0229 01:43:35.199326 163581 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34143
I0229 01:43:35.199945 163581 main.go:141] libmachine: () Calling .GetVersion
I0229 01:43:35.200612 163581 main.go:141] libmachine: Using API Version 1
I0229 01:43:35.200642 163581 main.go:141] libmachine: () Calling .SetConfigRaw
I0229 01:43:35.200975 163581 main.go:141] libmachine: () Calling .GetMachineName
I0229 01:43:35.201194 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetMachineName
I0229 01:43:35.201431 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .DriverName
I0229 01:43:35.201608 163581 start.go:159] libmachine.API.Create for "old-k8s-version-096771" (driver="kvm2")
I0229 01:43:35.201645 163581 client.go:168] LocalClient.Create starting
I0229 01:43:35.201686 163581 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18063-115328/.minikube/certs/ca.pem
I0229 01:43:35.201735 163581 main.go:141] libmachine: Decoding PEM data...
I0229 01:43:35.201761 163581 main.go:141] libmachine: Parsing certificate...
I0229 01:43:35.201851 163581 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18063-115328/.minikube/certs/cert.pem
I0229 01:43:35.201889 163581 main.go:141] libmachine: Decoding PEM data...
I0229 01:43:35.201912 163581 main.go:141] libmachine: Parsing certificate...
I0229 01:43:35.201943 163581 main.go:141] libmachine: Running pre-create checks...
I0229 01:43:35.201965 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .PreCreateCheck
I0229 01:43:35.202379 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetConfigRaw
I0229 01:43:35.202812 163581 main.go:141] libmachine: Creating machine...
I0229 01:43:35.202830 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .Create
I0229 01:43:35.202984 163581 main.go:141] libmachine: (old-k8s-version-096771) Creating KVM machine...
I0229 01:43:35.204182 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found existing default KVM network
I0229 01:43:35.205640 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:35.205448 163653 network.go:212] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:87:c2:b8} reservation:<nil>}
I0229 01:43:35.206915 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:35.206815 163653 network.go:212] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:52:ff:02} reservation:<nil>}
I0229 01:43:35.208186 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:35.208093 163653 network.go:207] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00030cb90}
I0229 01:43:35.214058 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | trying to create private KVM network mk-old-k8s-version-096771 192.168.61.0/24...
I0229 01:43:35.287492 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | private KVM network mk-old-k8s-version-096771 192.168.61.0/24 created
I0229 01:43:35.287533 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:35.287449 163653 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18063-115328/.minikube
I0229 01:43:35.287548 163581 main.go:141] libmachine: (old-k8s-version-096771) Setting up store path in /home/jenkins/minikube-integration/18063-115328/.minikube/machines/old-k8s-version-096771 ...
I0229 01:43:35.287567 163581 main.go:141] libmachine: (old-k8s-version-096771) Building disk image from file:///home/jenkins/minikube-integration/18063-115328/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso
I0229 01:43:35.287624 163581 main.go:141] libmachine: (old-k8s-version-096771) Downloading /home/jenkins/minikube-integration/18063-115328/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18063-115328/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
I0229 01:43:35.545405 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:35.545277 163653 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18063-115328/.minikube/machines/old-k8s-version-096771/id_rsa...
I0229 01:43:35.701834 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:35.701704 163653 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18063-115328/.minikube/machines/old-k8s-version-096771/old-k8s-version-096771.rawdisk...
I0229 01:43:35.701864 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | Writing magic tar header
I0229 01:43:35.701893 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | Writing SSH key tar header
I0229 01:43:35.701933 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:35.701897 163653 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18063-115328/.minikube/machines/old-k8s-version-096771 ...
I0229 01:43:35.702086 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18063-115328/.minikube/machines/old-k8s-version-096771
I0229 01:43:35.702138 163581 main.go:141] libmachine: (old-k8s-version-096771) Setting executable bit set on /home/jenkins/minikube-integration/18063-115328/.minikube/machines/old-k8s-version-096771 (perms=drwx------)
I0229 01:43:35.702157 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18063-115328/.minikube/machines
I0229 01:43:35.702176 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18063-115328/.minikube
I0229 01:43:35.702191 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18063-115328
I0229 01:43:35.702211 163581 main.go:141] libmachine: (old-k8s-version-096771) Setting executable bit set on /home/jenkins/minikube-integration/18063-115328/.minikube/machines (perms=drwxr-xr-x)
I0229 01:43:35.702225 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0229 01:43:35.702239 163581 main.go:141] libmachine: (old-k8s-version-096771) Setting executable bit set on /home/jenkins/minikube-integration/18063-115328/.minikube (perms=drwxr-xr-x)
I0229 01:43:35.702254 163581 main.go:141] libmachine: (old-k8s-version-096771) Setting executable bit set on /home/jenkins/minikube-integration/18063-115328 (perms=drwxrwxr-x)
I0229 01:43:35.702265 163581 main.go:141] libmachine: (old-k8s-version-096771) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0229 01:43:35.702274 163581 main.go:141] libmachine: (old-k8s-version-096771) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0229 01:43:35.702285 163581 main.go:141] libmachine: (old-k8s-version-096771) Creating domain...
I0229 01:43:35.702319 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | Checking permissions on dir: /home/jenkins
I0229 01:43:35.702352 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | Checking permissions on dir: /home
I0229 01:43:35.702368 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | Skipping /home - not owner
I0229 01:43:35.703733 163581 main.go:141] libmachine: (old-k8s-version-096771) define libvirt domain using xml:
I0229 01:43:35.703757 163581 main.go:141] libmachine: (old-k8s-version-096771) <domain type='kvm'>
I0229 01:43:35.703768 163581 main.go:141] libmachine: (old-k8s-version-096771) <name>old-k8s-version-096771</name>
I0229 01:43:35.703776 163581 main.go:141] libmachine: (old-k8s-version-096771) <memory unit='MiB'>2200</memory>
I0229 01:43:35.703789 163581 main.go:141] libmachine: (old-k8s-version-096771) <vcpu>2</vcpu>
I0229 01:43:35.703799 163581 main.go:141] libmachine: (old-k8s-version-096771) <features>
I0229 01:43:35.703808 163581 main.go:141] libmachine: (old-k8s-version-096771) <acpi/>
I0229 01:43:35.703819 163581 main.go:141] libmachine: (old-k8s-version-096771) <apic/>
I0229 01:43:35.703829 163581 main.go:141] libmachine: (old-k8s-version-096771) <pae/>
I0229 01:43:35.703923 163581 main.go:141] libmachine: (old-k8s-version-096771)
I0229 01:43:35.703944 163581 main.go:141] libmachine: (old-k8s-version-096771) </features>
I0229 01:43:35.703956 163581 main.go:141] libmachine: (old-k8s-version-096771) <cpu mode='host-passthrough'>
I0229 01:43:35.703967 163581 main.go:141] libmachine: (old-k8s-version-096771)
I0229 01:43:35.703977 163581 main.go:141] libmachine: (old-k8s-version-096771) </cpu>
I0229 01:43:35.703986 163581 main.go:141] libmachine: (old-k8s-version-096771) <os>
I0229 01:43:35.703997 163581 main.go:141] libmachine: (old-k8s-version-096771) <type>hvm</type>
I0229 01:43:35.704007 163581 main.go:141] libmachine: (old-k8s-version-096771) <boot dev='cdrom'/>
I0229 01:43:35.704030 163581 main.go:141] libmachine: (old-k8s-version-096771) <boot dev='hd'/>
I0229 01:43:35.704042 163581 main.go:141] libmachine: (old-k8s-version-096771) <bootmenu enable='no'/>
I0229 01:43:35.704058 163581 main.go:141] libmachine: (old-k8s-version-096771) </os>
I0229 01:43:35.704074 163581 main.go:141] libmachine: (old-k8s-version-096771) <devices>
I0229 01:43:35.704086 163581 main.go:141] libmachine: (old-k8s-version-096771) <disk type='file' device='cdrom'>
I0229 01:43:35.704109 163581 main.go:141] libmachine: (old-k8s-version-096771) <source file='/home/jenkins/minikube-integration/18063-115328/.minikube/machines/old-k8s-version-096771/boot2docker.iso'/>
I0229 01:43:35.704124 163581 main.go:141] libmachine: (old-k8s-version-096771) <target dev='hdc' bus='scsi'/>
I0229 01:43:35.704136 163581 main.go:141] libmachine: (old-k8s-version-096771) <readonly/>
I0229 01:43:35.704146 163581 main.go:141] libmachine: (old-k8s-version-096771) </disk>
I0229 01:43:35.704156 163581 main.go:141] libmachine: (old-k8s-version-096771) <disk type='file' device='disk'>
I0229 01:43:35.704169 163581 main.go:141] libmachine: (old-k8s-version-096771) <driver name='qemu' type='raw' cache='default' io='threads' />
I0229 01:43:35.704193 163581 main.go:141] libmachine: (old-k8s-version-096771) <source file='/home/jenkins/minikube-integration/18063-115328/.minikube/machines/old-k8s-version-096771/old-k8s-version-096771.rawdisk'/>
I0229 01:43:35.704204 163581 main.go:141] libmachine: (old-k8s-version-096771) <target dev='hda' bus='virtio'/>
I0229 01:43:35.704213 163581 main.go:141] libmachine: (old-k8s-version-096771) </disk>
I0229 01:43:35.704223 163581 main.go:141] libmachine: (old-k8s-version-096771) <interface type='network'>
I0229 01:43:35.704235 163581 main.go:141] libmachine: (old-k8s-version-096771) <source network='mk-old-k8s-version-096771'/>
I0229 01:43:35.704244 163581 main.go:141] libmachine: (old-k8s-version-096771) <model type='virtio'/>
I0229 01:43:35.704251 163581 main.go:141] libmachine: (old-k8s-version-096771) </interface>
I0229 01:43:35.704265 163581 main.go:141] libmachine: (old-k8s-version-096771) <interface type='network'>
I0229 01:43:35.704273 163581 main.go:141] libmachine: (old-k8s-version-096771) <source network='default'/>
I0229 01:43:35.704278 163581 main.go:141] libmachine: (old-k8s-version-096771) <model type='virtio'/>
I0229 01:43:35.704286 163581 main.go:141] libmachine: (old-k8s-version-096771) </interface>
I0229 01:43:35.704290 163581 main.go:141] libmachine: (old-k8s-version-096771) <serial type='pty'>
I0229 01:43:35.704297 163581 main.go:141] libmachine: (old-k8s-version-096771) <target port='0'/>
I0229 01:43:35.704301 163581 main.go:141] libmachine: (old-k8s-version-096771) </serial>
I0229 01:43:35.704307 163581 main.go:141] libmachine: (old-k8s-version-096771) <console type='pty'>
I0229 01:43:35.704315 163581 main.go:141] libmachine: (old-k8s-version-096771) <target type='serial' port='0'/>
I0229 01:43:35.704322 163581 main.go:141] libmachine: (old-k8s-version-096771) </console>
I0229 01:43:35.704327 163581 main.go:141] libmachine: (old-k8s-version-096771) <rng model='virtio'>
I0229 01:43:35.704333 163581 main.go:141] libmachine: (old-k8s-version-096771) <backend model='random'>/dev/random</backend>
I0229 01:43:35.704342 163581 main.go:141] libmachine: (old-k8s-version-096771) </rng>
I0229 01:43:35.704347 163581 main.go:141] libmachine: (old-k8s-version-096771)
I0229 01:43:35.704353 163581 main.go:141] libmachine: (old-k8s-version-096771)
I0229 01:43:35.704358 163581 main.go:141] libmachine: (old-k8s-version-096771) </devices>
I0229 01:43:35.704364 163581 main.go:141] libmachine: (old-k8s-version-096771) </domain>
I0229 01:43:35.704372 163581 main.go:141] libmachine: (old-k8s-version-096771)
I0229 01:43:35.708809 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:0d:1d:93 in network default
I0229 01:43:35.709549 163581 main.go:141] libmachine: (old-k8s-version-096771) Ensuring networks are active...
I0229 01:43:35.709565 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:35.710327 163581 main.go:141] libmachine: (old-k8s-version-096771) Ensuring network default is active
I0229 01:43:35.710806 163581 main.go:141] libmachine: (old-k8s-version-096771) Ensuring network mk-old-k8s-version-096771 is active
I0229 01:43:35.711474 163581 main.go:141] libmachine: (old-k8s-version-096771) Getting domain xml...
I0229 01:43:35.712238 163581 main.go:141] libmachine: (old-k8s-version-096771) Creating domain...
I0229 01:43:36.964653 163581 main.go:141] libmachine: (old-k8s-version-096771) Waiting to get IP...
I0229 01:43:36.965593 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:36.966100 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | unable to find current IP address of domain old-k8s-version-096771 in network mk-old-k8s-version-096771
I0229 01:43:36.966151 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:36.966097 163653 retry.go:31] will retry after 293.777357ms: waiting for machine to come up
I0229 01:43:37.261606 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:37.262248 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | unable to find current IP address of domain old-k8s-version-096771 in network mk-old-k8s-version-096771
I0229 01:43:37.262276 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:37.262205 163653 retry.go:31] will retry after 375.802812ms: waiting for machine to come up
I0229 01:43:37.639743 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:37.640296 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | unable to find current IP address of domain old-k8s-version-096771 in network mk-old-k8s-version-096771
I0229 01:43:37.640321 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:37.640239 163653 retry.go:31] will retry after 386.878794ms: waiting for machine to come up
I0229 01:43:38.028876 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:38.029523 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | unable to find current IP address of domain old-k8s-version-096771 in network mk-old-k8s-version-096771
I0229 01:43:38.029558 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:38.029493 163653 retry.go:31] will retry after 405.202763ms: waiting for machine to come up
I0229 01:43:38.436050 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:38.436609 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | unable to find current IP address of domain old-k8s-version-096771 in network mk-old-k8s-version-096771
I0229 01:43:38.436637 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:38.436561 163653 retry.go:31] will retry after 666.257121ms: waiting for machine to come up
I0229 01:43:39.104315 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:39.104911 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | unable to find current IP address of domain old-k8s-version-096771 in network mk-old-k8s-version-096771
I0229 01:43:39.104942 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:39.104848 163653 retry.go:31] will retry after 917.882498ms: waiting for machine to come up
I0229 01:43:40.024476 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:40.025091 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | unable to find current IP address of domain old-k8s-version-096771 in network mk-old-k8s-version-096771
I0229 01:43:40.025126 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:40.025001 163653 retry.go:31] will retry after 1.076191024s: waiting for machine to come up
I0229 01:43:41.102776 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:41.103423 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | unable to find current IP address of domain old-k8s-version-096771 in network mk-old-k8s-version-096771
I0229 01:43:41.103458 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:41.103376 163653 retry.go:31] will retry after 1.096107137s: waiting for machine to come up
I0229 01:43:42.201765 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:42.202404 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | unable to find current IP address of domain old-k8s-version-096771 in network mk-old-k8s-version-096771
I0229 01:43:42.202428 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:42.202352 163653 retry.go:31] will retry after 1.563441628s: waiting for machine to come up
I0229 01:43:43.766881 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:43.767332 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | unable to find current IP address of domain old-k8s-version-096771 in network mk-old-k8s-version-096771
I0229 01:43:43.767354 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:43.767292 163653 retry.go:31] will retry after 2.307600272s: waiting for machine to come up
I0229 01:43:46.076408 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:46.077036 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | unable to find current IP address of domain old-k8s-version-096771 in network mk-old-k8s-version-096771
I0229 01:43:46.077056 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:46.076958 163653 retry.go:31] will retry after 2.28648061s: waiting for machine to come up
I0229 01:43:48.366549 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:48.367238 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | unable to find current IP address of domain old-k8s-version-096771 in network mk-old-k8s-version-096771
I0229 01:43:48.367266 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:48.367162 163653 retry.go:31] will retry after 2.330341516s: waiting for machine to come up
I0229 01:43:50.699673 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:50.700214 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | unable to find current IP address of domain old-k8s-version-096771 in network mk-old-k8s-version-096771
I0229 01:43:50.700246 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:50.700154 163653 retry.go:31] will retry after 3.749727122s: waiting for machine to come up
I0229 01:43:54.454055 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:54.454773 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | unable to find current IP address of domain old-k8s-version-096771 in network mk-old-k8s-version-096771
I0229 01:43:54.454805 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | I0229 01:43:54.454727 163653 retry.go:31] will retry after 4.741264871s: waiting for machine to come up
I0229 01:43:59.199083 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:59.199739 163581 main.go:141] libmachine: (old-k8s-version-096771) Found IP for machine: 192.168.61.59
I0229 01:43:59.199765 163581 main.go:141] libmachine: (old-k8s-version-096771) Reserving static IP address...
I0229 01:43:59.199781 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has current primary IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:59.200185 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-096771", mac: "52:54:00:82:00:09", ip: "192.168.61.59"} in network mk-old-k8s-version-096771
I0229 01:43:59.277050 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | Getting to WaitForSSH function...
I0229 01:43:59.277083 163581 main.go:141] libmachine: (old-k8s-version-096771) Reserved static IP address: 192.168.61.59
I0229 01:43:59.277092 163581 main.go:141] libmachine: (old-k8s-version-096771) Waiting for SSH to be available...
I0229 01:43:59.280864 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:59.281525 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:minikube Clientid:01:52:54:00:82:00:09}
I0229 01:43:59.281557 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:59.281765 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | Using SSH client type: external
I0229 01:43:59.281819 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | Using SSH private key: /home/jenkins/minikube-integration/18063-115328/.minikube/machines/old-k8s-version-096771/id_rsa (-rw-------)
I0229 01:43:59.281855 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.59 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18063-115328/.minikube/machines/old-k8s-version-096771/id_rsa -p 22] /usr/bin/ssh <nil>}
I0229 01:43:59.281874 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | About to run SSH command:
I0229 01:43:59.281893 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | exit 0
I0229 01:43:59.413796 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | SSH cmd err, output: <nil>:
I0229 01:43:59.414122 163581 main.go:141] libmachine: (old-k8s-version-096771) KVM machine creation complete!
I0229 01:43:59.414457 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetConfigRaw
I0229 01:43:59.415086 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .DriverName
I0229 01:43:59.415295 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .DriverName
I0229 01:43:59.415458 163581 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0229 01:43:59.415475 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetState
I0229 01:43:59.417133 163581 main.go:141] libmachine: Detecting operating system of created instance...
I0229 01:43:59.417156 163581 main.go:141] libmachine: Waiting for SSH to be available...
I0229 01:43:59.417163 163581 main.go:141] libmachine: Getting to WaitForSSH function...
I0229 01:43:59.417173 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHHostname
I0229 01:43:59.420191 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:59.420606 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:43:59.420634 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:59.420861 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHPort
I0229 01:43:59.421111 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:43:59.421316 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:43:59.421495 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHUsername
I0229 01:43:59.421680 163581 main.go:141] libmachine: Using SSH client type: native
I0229 01:43:59.421931 163581 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.61.59 22 <nil> <nil>}
I0229 01:43:59.421948 163581 main.go:141] libmachine: About to run SSH command:
exit 0
I0229 01:43:59.529490 163581 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0229 01:43:59.529524 163581 main.go:141] libmachine: Detecting the provisioner...
I0229 01:43:59.529536 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHHostname
I0229 01:43:59.532438 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:59.532838 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:43:59.532863 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:59.533085 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHPort
I0229 01:43:59.533309 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:43:59.533518 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:43:59.533703 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHUsername
I0229 01:43:59.533921 163581 main.go:141] libmachine: Using SSH client type: native
I0229 01:43:59.534151 163581 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.61.59 22 <nil> <nil>}
I0229 01:43:59.534169 163581 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0229 01:43:59.655041 163581 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0229 01:43:59.655135 163581 main.go:141] libmachine: found compatible host: buildroot
I0229 01:43:59.655152 163581 main.go:141] libmachine: Provisioning with buildroot...
I0229 01:43:59.655178 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetMachineName
I0229 01:43:59.655475 163581 buildroot.go:166] provisioning hostname "old-k8s-version-096771"
I0229 01:43:59.655527 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetMachineName
I0229 01:43:59.655731 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHHostname
I0229 01:43:59.658858 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:59.659335 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:43:59.659371 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:59.659590 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHPort
I0229 01:43:59.659794 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:43:59.659990 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:43:59.660176 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHUsername
I0229 01:43:59.660377 163581 main.go:141] libmachine: Using SSH client type: native
I0229 01:43:59.660605 163581 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.61.59 22 <nil> <nil>}
I0229 01:43:59.660625 163581 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-096771 && echo "old-k8s-version-096771" | sudo tee /etc/hostname
I0229 01:43:59.793550 163581 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-096771
I0229 01:43:59.793585 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHHostname
I0229 01:43:59.796877 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:59.797326 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:43:59.797359 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:59.797602 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHPort
I0229 01:43:59.797860 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:43:59.798091 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:43:59.798254 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHUsername
I0229 01:43:59.798460 163581 main.go:141] libmachine: Using SSH client type: native
I0229 01:43:59.798674 163581 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.61.59 22 <nil> <nil>}
I0229 01:43:59.798708 163581 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-096771' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-096771/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-096771' | sudo tee -a /etc/hosts;
fi
fi
I0229 01:43:59.918864 163581 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0229 01:43:59.918897 163581 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18063-115328/.minikube CaCertPath:/home/jenkins/minikube-integration/18063-115328/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18063-115328/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18063-115328/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18063-115328/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18063-115328/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18063-115328/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18063-115328/.minikube}
I0229 01:43:59.918945 163581 buildroot.go:174] setting up certificates
I0229 01:43:59.918958 163581 provision.go:83] configureAuth start
I0229 01:43:59.918989 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetMachineName
I0229 01:43:59.919337 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetIP
I0229 01:43:59.922226 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:59.922585 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:43:59.922607 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:59.922812 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHHostname
I0229 01:43:59.925422 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:59.925736 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:43:59.925762 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:43:59.925928 163581 provision.go:138] copyHostCerts
I0229 01:43:59.925989 163581 exec_runner.go:144] found /home/jenkins/minikube-integration/18063-115328/.minikube/ca.pem, removing ...
I0229 01:43:59.926002 163581 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18063-115328/.minikube/ca.pem
I0229 01:43:59.926069 163581 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18063-115328/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18063-115328/.minikube/ca.pem (1078 bytes)
I0229 01:43:59.926209 163581 exec_runner.go:144] found /home/jenkins/minikube-integration/18063-115328/.minikube/cert.pem, removing ...
I0229 01:43:59.926218 163581 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18063-115328/.minikube/cert.pem
I0229 01:43:59.926244 163581 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18063-115328/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18063-115328/.minikube/cert.pem (1123 bytes)
I0229 01:43:59.926387 163581 exec_runner.go:144] found /home/jenkins/minikube-integration/18063-115328/.minikube/key.pem, removing ...
I0229 01:43:59.926401 163581 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18063-115328/.minikube/key.pem
I0229 01:43:59.926432 163581 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18063-115328/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18063-115328/.minikube/key.pem (1679 bytes)
I0229 01:43:59.926508 163581 provision.go:112] generating server cert: /home/jenkins/minikube-integration/18063-115328/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18063-115328/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18063-115328/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-096771 san=[192.168.61.59 192.168.61.59 localhost 127.0.0.1 minikube old-k8s-version-096771]
I0229 01:44:00.029587 163581 provision.go:172] copyRemoteCerts
I0229 01:44:00.029654 163581 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0229 01:44:00.029685 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHHostname
I0229 01:44:00.032647 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:00.033120 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:44:00.033146 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:00.033341 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHPort
I0229 01:44:00.033562 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:44:00.033753 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHUsername
I0229 01:44:00.033970 163581 sshutil.go:53] new ssh client: &{IP:192.168.61.59 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18063-115328/.minikube/machines/old-k8s-version-096771/id_rsa Username:docker}
I0229 01:44:00.124471 163581 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-115328/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0229 01:44:00.153590 163581 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-115328/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I0229 01:44:00.179690 163581 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-115328/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0229 01:44:00.208458 163581 provision.go:86] duration metric: configureAuth took 289.479171ms
I0229 01:44:00.208491 163581 buildroot.go:189] setting minikube options for container-runtime
I0229 01:44:00.208760 163581 config.go:182] Loaded profile config "old-k8s-version-096771": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.16.0
I0229 01:44:00.208790 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .DriverName
I0229 01:44:00.209049 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHHostname
I0229 01:44:00.212070 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:00.212505 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:44:00.212534 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:00.212753 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHPort
I0229 01:44:00.212971 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:44:00.213155 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:44:00.213319 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHUsername
I0229 01:44:00.213525 163581 main.go:141] libmachine: Using SSH client type: native
I0229 01:44:00.213763 163581 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.61.59 22 <nil> <nil>}
I0229 01:44:00.213808 163581 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0229 01:44:00.327475 163581 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
I0229 01:44:00.327502 163581 buildroot.go:70] root file system type: tmpfs
I0229 01:44:00.327688 163581 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0229 01:44:00.327716 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHHostname
I0229 01:44:00.330871 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:00.331250 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:44:00.331307 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:00.331482 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHPort
I0229 01:44:00.331669 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:44:00.331879 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:44:00.332013 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHUsername
I0229 01:44:00.332170 163581 main.go:141] libmachine: Using SSH client type: native
I0229 01:44:00.332418 163581 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.61.59 22 <nil> <nil>}
I0229 01:44:00.332479 163581 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0229 01:44:00.461322 163581 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0229 01:44:00.461392 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHHostname
I0229 01:44:00.464589 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:00.465057 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:44:00.465089 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:00.465338 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHPort
I0229 01:44:00.465556 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:44:00.465759 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:44:00.465923 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHUsername
I0229 01:44:00.466077 163581 main.go:141] libmachine: Using SSH client type: native
I0229 01:44:00.466288 163581 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.61.59 22 <nil> <nil>}
I0229 01:44:00.466322 163581 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0229 01:44:01.613619 163581 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
I0229 01:44:01.613653 163581 main.go:141] libmachine: Checking connection to Docker...
I0229 01:44:01.613672 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetURL
I0229 01:44:01.615295 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | Using libvirt version 6000000
I0229 01:44:01.618219 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:01.618673 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:44:01.618694 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:01.618881 163581 main.go:141] libmachine: Docker is up and running!
I0229 01:44:01.618893 163581 main.go:141] libmachine: Reticulating splines...
I0229 01:44:01.618902 163581 client.go:171] LocalClient.Create took 26.417245077s
I0229 01:44:01.618932 163581 start.go:167] duration metric: libmachine.API.Create for "old-k8s-version-096771" took 26.417324988s
I0229 01:44:01.618947 163581 start.go:300] post-start starting for "old-k8s-version-096771" (driver="kvm2")
I0229 01:44:01.618960 163581 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0229 01:44:01.618982 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .DriverName
I0229 01:44:01.619270 163581 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0229 01:44:01.619301 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHHostname
I0229 01:44:01.621758 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:01.622105 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:44:01.622145 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:01.622308 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHPort
I0229 01:44:01.622571 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:44:01.622759 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHUsername
I0229 01:44:01.622966 163581 sshutil.go:53] new ssh client: &{IP:192.168.61.59 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18063-115328/.minikube/machines/old-k8s-version-096771/id_rsa Username:docker}
I0229 01:44:01.713048 163581 ssh_runner.go:195] Run: cat /etc/os-release
I0229 01:44:01.717904 163581 info.go:137] Remote host: Buildroot 2023.02.9
I0229 01:44:01.717931 163581 filesync.go:126] Scanning /home/jenkins/minikube-integration/18063-115328/.minikube/addons for local assets ...
I0229 01:44:01.718009 163581 filesync.go:126] Scanning /home/jenkins/minikube-integration/18063-115328/.minikube/files for local assets ...
I0229 01:44:01.718111 163581 filesync.go:149] local asset: /home/jenkins/minikube-integration/18063-115328/.minikube/files/etc/ssl/certs/1225952.pem -> 1225952.pem in /etc/ssl/certs
I0229 01:44:01.718222 163581 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0229 01:44:01.729349 163581 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-115328/.minikube/files/etc/ssl/certs/1225952.pem --> /etc/ssl/certs/1225952.pem (1708 bytes)
I0229 01:44:01.762961 163581 start.go:303] post-start completed in 143.995914ms
I0229 01:44:01.763016 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetConfigRaw
I0229 01:44:01.763648 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetIP
I0229 01:44:01.766507 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:01.766927 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:44:01.766962 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:01.767306 163581 profile.go:148] Saving config to /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/config.json ...
I0229 01:44:01.767485 163581 start.go:128] duration metric: createHost completed in 26.588332278s
I0229 01:44:01.767509 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHHostname
I0229 01:44:01.770020 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:01.770393 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:44:01.770421 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:01.770594 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHPort
I0229 01:44:01.770771 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:44:01.770931 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:44:01.771121 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHUsername
I0229 01:44:01.771292 163581 main.go:141] libmachine: Using SSH client type: native
I0229 01:44:01.771506 163581 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.61.59 22 <nil> <nil>}
I0229 01:44:01.771526 163581 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0229 01:44:01.886999 163581 main.go:141] libmachine: SSH cmd err, output: <nil>: 1709171041.869148326
I0229 01:44:01.887028 163581 fix.go:206] guest clock: 1709171041.869148326
I0229 01:44:01.887038 163581 fix.go:219] Guest: 2024-02-29 01:44:01.869148326 +0000 UTC Remote: 2024-02-29 01:44:01.767497513 +0000 UTC m=+34.178557596 (delta=101.650813ms)
I0229 01:44:01.887066 163581 fix.go:190] guest clock delta is within tolerance: 101.650813ms
I0229 01:44:01.887074 163581 start.go:83] releasing machines lock for "old-k8s-version-096771", held for 26.70808759s
I0229 01:44:01.887104 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .DriverName
I0229 01:44:01.887403 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetIP
I0229 01:44:01.890709 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:01.891123 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:44:01.891146 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:01.891391 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .DriverName
I0229 01:44:01.892230 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .DriverName
I0229 01:44:01.892457 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .DriverName
I0229 01:44:01.892573 163581 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0229 01:44:01.892617 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHHostname
I0229 01:44:01.892717 163581 ssh_runner.go:195] Run: cat /version.json
I0229 01:44:01.892744 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHHostname
I0229 01:44:01.895293 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:01.895397 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:01.895792 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:44:01.895828 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:01.895863 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:44:01.895882 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:01.896069 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHPort
I0229 01:44:01.896177 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHPort
I0229 01:44:01.896279 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:44:01.896362 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHKeyPath
I0229 01:44:01.896433 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHUsername
I0229 01:44:01.896511 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetSSHUsername
I0229 01:44:01.896589 163581 sshutil.go:53] new ssh client: &{IP:192.168.61.59 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18063-115328/.minikube/machines/old-k8s-version-096771/id_rsa Username:docker}
I0229 01:44:01.896642 163581 sshutil.go:53] new ssh client: &{IP:192.168.61.59 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18063-115328/.minikube/machines/old-k8s-version-096771/id_rsa Username:docker}
I0229 01:44:01.976003 163581 ssh_runner.go:195] Run: systemctl --version
I0229 01:44:02.002060 163581 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0229 01:44:02.008370 163581 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0229 01:44:02.008435 163581 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
I0229 01:44:02.020255 163581 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%p, " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
I0229 01:44:02.041684 163581 cni.go:308] configured [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0229 01:44:02.041721 163581 start.go:475] detecting cgroup driver to use...
I0229 01:44:02.041865 163581 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0229 01:44:02.070151 163581 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.1"|' /etc/containerd/config.toml"
I0229 01:44:02.090631 163581 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0229 01:44:02.114465 163581 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0229 01:44:02.114519 163581 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0229 01:44:02.127409 163581 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0229 01:44:02.140177 163581 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0229 01:44:02.153130 163581 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0229 01:44:02.164309 163581 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0229 01:44:02.176839 163581 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0229 01:44:02.190780 163581 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0229 01:44:02.205772 163581 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0229 01:44:02.220566 163581 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0229 01:44:02.378249 163581 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0229 01:44:02.407287 163581 start.go:475] detecting cgroup driver to use...
I0229 01:44:02.407364 163581 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0229 01:44:02.425866 163581 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0229 01:44:02.449553 163581 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0229 01:44:02.472607 163581 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0229 01:44:02.487249 163581 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0229 01:44:02.501394 163581 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0229 01:44:02.532641 163581 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0229 01:44:02.548034 163581 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0229 01:44:02.571060 163581 ssh_runner.go:195] Run: which cri-dockerd
I0229 01:44:02.575426 163581 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0229 01:44:02.584844 163581 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0229 01:44:02.603278 163581 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0229 01:44:02.750375 163581 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0229 01:44:02.893584 163581 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0229 01:44:02.893756 163581 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0229 01:44:02.912743 163581 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0229 01:44:03.053383 163581 ssh_runner.go:195] Run: sudo systemctl restart docker
I0229 01:44:04.492857 163581 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.439428542s)
I0229 01:44:04.492932 163581 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0229 01:44:04.519753 163581 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0229 01:44:04.552559 163581 out.go:204] * Preparing Kubernetes v1.16.0 on Docker 24.0.7 ...
I0229 01:44:04.552616 163581 main.go:141] libmachine: (old-k8s-version-096771) Calling .GetIP
I0229 01:44:04.555972 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:04.556450 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:00:09", ip: ""} in network mk-old-k8s-version-096771: {Iface:virbr3 ExpiryTime:2024-02-29 02:43:51 +0000 UTC Type:0 Mac:52:54:00:82:00:09 Iaid: IPaddr:192.168.61.59 Prefix:24 Hostname:old-k8s-version-096771 Clientid:01:52:54:00:82:00:09}
I0229 01:44:04.556487 163581 main.go:141] libmachine: (old-k8s-version-096771) DBG | domain old-k8s-version-096771 has defined IP address 192.168.61.59 and MAC address 52:54:00:82:00:09 in network mk-old-k8s-version-096771
I0229 01:44:04.556580 163581 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0229 01:44:04.561040 163581 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0229 01:44:04.577445 163581 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
I0229 01:44:04.577537 163581 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0229 01:44:04.597161 163581 docker.go:685] Got preloaded images:
I0229 01:44:04.597184 163581 docker.go:691] registry.k8s.io/kube-apiserver:v1.16.0 wasn't preloaded
I0229 01:44:04.597228 163581 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
I0229 01:44:04.612088 163581 ssh_runner.go:195] Run: which lz4
I0229 01:44:04.618332 163581 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0229 01:44:04.624258 163581 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0229 01:44:04.624290 163581 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-115328/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (369789069 bytes)
I0229 01:44:06.111682 163581 docker.go:649] Took 1.493382 seconds to copy over tarball
I0229 01:44:06.111744 163581 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0229 01:44:08.499977 163581 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.388201093s)
I0229 01:44:08.500011 163581 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0229 01:44:08.545175 163581 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
I0229 01:44:08.559339 163581 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2499 bytes)
I0229 01:44:08.579531 163581 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0229 01:44:08.750649 163581 ssh_runner.go:195] Run: sudo systemctl restart docker
I0229 01:44:12.491537 163581 ssh_runner.go:235] Completed: sudo systemctl restart docker: (3.740853018s)
I0229 01:44:12.491621 163581 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0229 01:44:12.510848 163581 docker.go:685] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/kube-apiserver:v1.16.0
k8s.gcr.io/kube-controller-manager:v1.16.0
k8s.gcr.io/kube-proxy:v1.16.0
k8s.gcr.io/kube-scheduler:v1.16.0
k8s.gcr.io/etcd:3.3.15-0
k8s.gcr.io/coredns:1.6.2
k8s.gcr.io/pause:3.1
-- /stdout --
I0229 01:44:12.510867 163581 docker.go:691] registry.k8s.io/kube-apiserver:v1.16.0 wasn't preloaded
I0229 01:44:12.510879 163581 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.16.0 registry.k8s.io/kube-controller-manager:v1.16.0 registry.k8s.io/kube-scheduler:v1.16.0 registry.k8s.io/kube-proxy:v1.16.0 registry.k8s.io/pause:3.1 registry.k8s.io/etcd:3.3.15-0 registry.k8s.io/coredns:1.6.2 gcr.io/k8s-minikube/storage-provisioner:v5]
I0229 01:44:12.512280 163581 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.16.0
I0229 01:44:12.512320 163581 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 01:44:12.512587 163581 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 01:44:12.512622 163581 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0229 01:44:12.512700 163581 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 01:44:12.512843 163581 image.go:134] retrieving image: registry.k8s.io/etcd:3.3.15-0
I0229 01:44:12.513332 163581 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 01:44:12.513467 163581 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 01:44:12.513578 163581 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.16.0
I0229 01:44:12.513651 163581 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.2
I0229 01:44:12.515033 163581 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0229 01:44:12.515200 163581 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 01:44:12.515286 163581 image.go:177] daemon lookup for registry.k8s.io/etcd:3.3.15-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.3.15-0
I0229 01:44:12.515622 163581 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.2: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.2
I0229 01:44:12.515705 163581 image.go:134] retrieving image: registry.k8s.io/pause:3.1
I0229 01:44:12.519442 163581 image.go:177] daemon lookup for registry.k8s.io/pause:3.1: Error response from daemon: No such image: registry.k8s.io/pause:3.1
I0229 01:44:12.645828 163581 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.2
I0229 01:44:12.654157 163581 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.1
I0229 01:44:12.654499 163581 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.16.0
I0229 01:44:12.657422 163581 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.16.0
I0229 01:44:12.664729 163581 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.16.0
I0229 01:44:12.664993 163581 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.16.0
I0229 01:44:12.677038 163581 cache_images.go:116] "registry.k8s.io/coredns:1.6.2" needs transfer: "registry.k8s.io/coredns:1.6.2" does not exist at hash "bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b" in container runtime
I0229 01:44:12.677095 163581 docker.go:337] Removing image: registry.k8s.io/coredns:1.6.2
I0229 01:44:12.677137 163581 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns:1.6.2
I0229 01:44:12.684326 163581 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.3.15-0
I0229 01:44:12.734882 163581 cache_images.go:116] "registry.k8s.io/pause:3.1" needs transfer: "registry.k8s.io/pause:3.1" does not exist at hash "da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e" in container runtime
I0229 01:44:12.734930 163581 docker.go:337] Removing image: registry.k8s.io/pause:3.1
I0229 01:44:12.734973 163581 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.1
I0229 01:44:12.744761 163581 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.16.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.16.0" does not exist at hash "06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d" in container runtime
I0229 01:44:12.744804 163581 docker.go:337] Removing image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 01:44:12.744847 163581 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.16.0
I0229 01:44:12.744943 163581 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.16.0" needs transfer: "registry.k8s.io/kube-proxy:v1.16.0" does not exist at hash "c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384" in container runtime
I0229 01:44:12.744966 163581 docker.go:337] Removing image: registry.k8s.io/kube-proxy:v1.16.0
I0229 01:44:12.744997 163581 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.16.0
I0229 01:44:12.745105 163581 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.16.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.16.0" does not exist at hash "b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e" in container runtime
I0229 01:44:12.745136 163581 docker.go:337] Removing image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 01:44:12.745162 163581 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.16.0
I0229 01:44:12.767973 163581 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.16.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.16.0" does not exist at hash "301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a" in container runtime
I0229 01:44:12.768029 163581 docker.go:337] Removing image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 01:44:12.768083 163581 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.16.0
I0229 01:44:12.792479 163581 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-115328/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2
I0229 01:44:12.792489 163581 cache_images.go:116] "registry.k8s.io/etcd:3.3.15-0" needs transfer: "registry.k8s.io/etcd:3.3.15-0" does not exist at hash "b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed" in container runtime
I0229 01:44:12.792551 163581 docker.go:337] Removing image: registry.k8s.io/etcd:3.3.15-0
I0229 01:44:12.792593 163581 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.3.15-0
I0229 01:44:12.823914 163581 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-115328/.minikube/cache/images/amd64/registry.k8s.io/pause_3.1
I0229 01:44:12.851322 163581 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-115328/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0
I0229 01:44:12.851390 163581 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-115328/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.16.0
I0229 01:44:12.851442 163581 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-115328/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0
I0229 01:44:12.854296 163581 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-115328/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0
I0229 01:44:12.860877 163581 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-115328/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.3.15-0
I0229 01:44:13.089251 163581 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0229 01:44:13.113256 163581 cache_images.go:92] LoadImages completed in 602.355284ms
W0229 01:44:13.113361 163581 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18063-115328/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18063-115328/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2: no such file or directory
I0229 01:44:13.113433 163581 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0229 01:44:13.148946 163581 cni.go:84] Creating CNI manager for ""
I0229 01:44:13.148977 163581 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
I0229 01:44:13.148997 163581 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0229 01:44:13.149028 163581 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.59 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-096771 NodeName:old-k8s-version-096771 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.59"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.59 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stat
icPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0229 01:44:13.149226 163581 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.59
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-096771"
kubeletExtraArgs:
node-ip: 192.168.61.59
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.59"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-096771
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.61.59:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0229 01:44:13.149348 163581 kubeadm.go:976] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-096771 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.61.59
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-096771 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0229 01:44:13.149426 163581 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0229 01:44:13.162363 163581 binaries.go:44] Found k8s binaries, skipping transfer
I0229 01:44:13.162460 163581 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0229 01:44:13.174951 163581 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (349 bytes)
I0229 01:44:13.194665 163581 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0229 01:44:13.214134 163581 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2178 bytes)
I0229 01:44:13.237139 163581 ssh_runner.go:195] Run: grep 192.168.61.59 control-plane.minikube.internal$ /etc/hosts
I0229 01:44:13.241729 163581 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.59 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0229 01:44:13.261085 163581 certs.go:56] Setting up /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771 for IP: 192.168.61.59
I0229 01:44:13.261124 163581 certs.go:190] acquiring lock for shared ca certs: {Name:mkeeef7429d1e308d27d608f1ba62d5b46b59bff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 01:44:13.261290 163581 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/18063-115328/.minikube/ca.key
I0229 01:44:13.261355 163581 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/18063-115328/.minikube/proxy-client-ca.key
I0229 01:44:13.261425 163581 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/client.key
I0229 01:44:13.261442 163581 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/client.crt with IP's: []
I0229 01:44:13.386386 163581 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/client.crt ...
I0229 01:44:13.386415 163581 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/client.crt: {Name:mkfc094b891edf3b0f61f75731b8b584ab560496 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 01:44:13.386574 163581 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/client.key ...
I0229 01:44:13.386594 163581 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/client.key: {Name:mk8ca1ec7f29944a097dc886adb084a1354f8ac8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 01:44:13.386699 163581 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/apiserver.key.a8f3ad05
I0229 01:44:13.386722 163581 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/apiserver.crt.a8f3ad05 with IP's: [192.168.61.59 10.96.0.1 127.0.0.1 10.0.0.1]
I0229 01:44:13.598315 163581 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/apiserver.crt.a8f3ad05 ...
I0229 01:44:13.598354 163581 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/apiserver.crt.a8f3ad05: {Name:mk7b68f979c9b015d93e869085a8e404be8e3d0a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 01:44:13.598540 163581 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/apiserver.key.a8f3ad05 ...
I0229 01:44:13.598561 163581 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/apiserver.key.a8f3ad05: {Name:mka63d30d76a7cbb9f16ee47e0a4421ce895db86 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 01:44:13.598661 163581 certs.go:337] copying /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/apiserver.crt.a8f3ad05 -> /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/apiserver.crt
I0229 01:44:13.598787 163581 certs.go:341] copying /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/apiserver.key.a8f3ad05 -> /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/apiserver.key
I0229 01:44:13.598891 163581 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/proxy-client.key
I0229 01:44:13.598916 163581 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/proxy-client.crt with IP's: []
I0229 01:44:13.672584 163581 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/proxy-client.crt ...
I0229 01:44:13.672614 163581 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/proxy-client.crt: {Name:mk6ff04638a277f196096d6e2e43dda138592b30 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 01:44:13.672776 163581 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/proxy-client.key ...
I0229 01:44:13.672790 163581 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/proxy-client.key: {Name:mkff2a1fed5ab026b0e3b03cf49fa81ee6f24afb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 01:44:13.672948 163581 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-115328/.minikube/certs/home/jenkins/minikube-integration/18063-115328/.minikube/certs/122595.pem (1338 bytes)
W0229 01:44:13.672984 163581 certs.go:433] ignoring /home/jenkins/minikube-integration/18063-115328/.minikube/certs/home/jenkins/minikube-integration/18063-115328/.minikube/certs/122595_empty.pem, impossibly tiny 0 bytes
I0229 01:44:13.672996 163581 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-115328/.minikube/certs/home/jenkins/minikube-integration/18063-115328/.minikube/certs/ca-key.pem (1675 bytes)
I0229 01:44:13.673019 163581 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-115328/.minikube/certs/home/jenkins/minikube-integration/18063-115328/.minikube/certs/ca.pem (1078 bytes)
I0229 01:44:13.673041 163581 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-115328/.minikube/certs/home/jenkins/minikube-integration/18063-115328/.minikube/certs/cert.pem (1123 bytes)
I0229 01:44:13.673065 163581 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-115328/.minikube/certs/home/jenkins/minikube-integration/18063-115328/.minikube/certs/key.pem (1679 bytes)
I0229 01:44:13.673097 163581 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-115328/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/18063-115328/.minikube/files/etc/ssl/certs/1225952.pem (1708 bytes)
I0229 01:44:13.673674 163581 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0229 01:44:13.711441 163581 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0229 01:44:13.745562 163581 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0229 01:44:13.782701 163581 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-115328/.minikube/profiles/old-k8s-version-096771/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0229 01:44:13.833035 163581 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-115328/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0229 01:44:13.864454 163581 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-115328/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0229 01:44:13.899858 163581 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-115328/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0229 01:44:13.930357 163581 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-115328/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0229 01:44:13.966477 163581 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-115328/.minikube/files/etc/ssl/certs/1225952.pem --> /usr/share/ca-certificates/1225952.pem (1708 bytes)
I0229 01:44:13.995896 163581 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-115328/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0229 01:44:14.030783 163581 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-115328/.minikube/certs/122595.pem --> /usr/share/ca-certificates/122595.pem (1338 bytes)
I0229 01:44:14.064208 163581 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0229 01:44:14.086764 163581 ssh_runner.go:195] Run: openssl version
I0229 01:44:14.095209 163581 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/122595.pem && ln -fs /usr/share/ca-certificates/122595.pem /etc/ssl/certs/122595.pem"
I0229 01:44:14.108552 163581 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/122595.pem
I0229 01:44:14.113882 163581 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Feb 29 00:52 /usr/share/ca-certificates/122595.pem
I0229 01:44:14.113944 163581 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/122595.pem
I0229 01:44:14.120372 163581 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/122595.pem /etc/ssl/certs/51391683.0"
I0229 01:44:14.134199 163581 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1225952.pem && ln -fs /usr/share/ca-certificates/1225952.pem /etc/ssl/certs/1225952.pem"
I0229 01:44:14.148118 163581 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1225952.pem
I0229 01:44:14.154441 163581 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Feb 29 00:52 /usr/share/ca-certificates/1225952.pem
I0229 01:44:14.154520 163581 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1225952.pem
I0229 01:44:14.161444 163581 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/1225952.pem /etc/ssl/certs/3ec20f2e.0"
I0229 01:44:14.175733 163581 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0229 01:44:14.189652 163581 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0229 01:44:14.195707 163581 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Feb 29 00:47 /usr/share/ca-certificates/minikubeCA.pem
I0229 01:44:14.195771 163581 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0229 01:44:14.202889 163581 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0229 01:44:14.218494 163581 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I0229 01:44:14.224755 163581 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
I0229 01:44:14.224815 163581 kubeadm.go:404] StartCluster: {Name:old-k8s-version-096771 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVe
rsion:v1.16.0 ClusterName:old-k8s-version-096771 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.61.59 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0229 01:44:14.224968 163581 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0229 01:44:14.247340 163581 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0229 01:44:14.263767 163581 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0229 01:44:14.278944 163581 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0229 01:44:14.292881 163581 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0229 01:44:14.292929 163581 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0229 01:44:14.453969 163581 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0229 01:44:14.454039 163581 kubeadm.go:322] [preflight] Running pre-flight checks
I0229 01:44:14.986932 163581 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0229 01:44:14.987091 163581 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0229 01:44:14.987186 163581 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0229 01:44:15.218131 163581 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0229 01:44:15.231353 163581 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0229 01:44:15.245626 163581 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0229 01:44:15.429493 163581 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0229 01:44:15.432350 163581 out.go:204] - Generating certificates and keys ...
I0229 01:44:15.432460 163581 kubeadm.go:322] [certs] Using existing ca certificate authority
I0229 01:44:15.432535 163581 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0229 01:44:16.277455 163581 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I0229 01:44:16.634161 163581 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I0229 01:44:16.817900 163581 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I0229 01:44:16.889397 163581 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I0229 01:44:17.027746 163581 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I0229 01:44:17.027922 163581 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [old-k8s-version-096771 localhost] and IPs [192.168.61.59 127.0.0.1 ::1]
I0229 01:44:17.166225 163581 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I0229 01:44:17.166400 163581 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-096771 localhost] and IPs [192.168.61.59 127.0.0.1 ::1]
I0229 01:44:17.551685 163581 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I0229 01:44:17.707126 163581 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I0229 01:44:17.852347 163581 kubeadm.go:322] [certs] Generating "sa" key and public key
I0229 01:44:17.852668 163581 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0229 01:44:17.995111 163581 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0229 01:44:18.116467 163581 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0229 01:44:18.368210 163581 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0229 01:44:18.498309 163581 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0229 01:44:18.499248 163581 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0229 01:44:18.501134 163581 out.go:204] - Booting up control plane ...
I0229 01:44:18.501259 163581 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0229 01:44:18.506885 163581 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0229 01:44:18.508303 163581 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0229 01:44:18.509195 163581 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0229 01:44:18.513917 163581 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0229 01:44:58.508332 163581 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0229 01:44:58.510214 163581 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 01:44:58.510464 163581 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 01:45:03.510931 163581 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 01:45:03.511214 163581 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 01:45:13.511273 163581 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 01:45:13.511541 163581 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 01:45:33.513480 163581 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 01:45:33.513754 163581 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 01:46:13.513014 163581 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 01:46:13.513476 163581 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 01:46:13.513520 163581 kubeadm.go:322]
I0229 01:46:13.513614 163581 kubeadm.go:322] Unfortunately, an error has occurred:
I0229 01:46:13.513707 163581 kubeadm.go:322] timed out waiting for the condition
I0229 01:46:13.513725 163581 kubeadm.go:322]
I0229 01:46:13.513838 163581 kubeadm.go:322] This error is likely caused by:
I0229 01:46:13.513894 163581 kubeadm.go:322] - The kubelet is not running
I0229 01:46:13.514049 163581 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0229 01:46:13.514078 163581 kubeadm.go:322]
I0229 01:46:13.514250 163581 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0229 01:46:13.514317 163581 kubeadm.go:322] - 'systemctl status kubelet'
I0229 01:46:13.514359 163581 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0229 01:46:13.514382 163581 kubeadm.go:322]
I0229 01:46:13.514535 163581 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0229 01:46:13.514685 163581 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0229 01:46:13.514795 163581 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0229 01:46:13.514881 163581 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0229 01:46:13.515005 163581 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0229 01:46:13.515057 163581 kubeadm.go:322] - 'docker logs CONTAINERID'
I0229 01:46:13.515513 163581 kubeadm.go:322] [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
I0229 01:46:13.515726 163581 kubeadm.go:322] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
I0229 01:46:13.515882 163581 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0229 01:46:13.516017 163581 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0229 01:46:13.516161 163581 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
W0229 01:46:13.516333 163581 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-096771 localhost] and IPs [192.168.61.59 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-096771 localhost] and IPs [192.168.61.59 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-096771 localhost] and IPs [192.168.61.59 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-096771 localhost] and IPs [192.168.61.59 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0229 01:46:13.516392 163581 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0229 01:46:13.969474 163581 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0229 01:46:13.984481 163581 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0229 01:46:13.994593 163581 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0229 01:46:13.994641 163581 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0229 01:46:14.142177 163581 kubeadm.go:322] [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
I0229 01:46:14.186300 163581 kubeadm.go:322] [WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
I0229 01:46:14.274258 163581 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0229 01:48:10.382854 163581 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0229 01:48:10.382964 163581 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
I0229 01:48:10.384282 163581 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0229 01:48:10.384354 163581 kubeadm.go:322] [preflight] Running pre-flight checks
I0229 01:48:10.384429 163581 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0229 01:48:10.384543 163581 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0229 01:48:10.384653 163581 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0229 01:48:10.384776 163581 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0229 01:48:10.384867 163581 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0229 01:48:10.384914 163581 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0229 01:48:10.384972 163581 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0229 01:48:10.386713 163581 out.go:204] - Generating certificates and keys ...
I0229 01:48:10.386803 163581 kubeadm.go:322] [certs] Using existing ca certificate authority
I0229 01:48:10.386860 163581 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0229 01:48:10.386923 163581 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0229 01:48:10.386999 163581 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority
I0229 01:48:10.387099 163581 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk
I0229 01:48:10.387182 163581 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority
I0229 01:48:10.387267 163581 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk
I0229 01:48:10.387349 163581 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk
I0229 01:48:10.387436 163581 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0229 01:48:10.387533 163581 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0229 01:48:10.387587 163581 kubeadm.go:322] [certs] Using the existing "sa" key
I0229 01:48:10.387676 163581 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0229 01:48:10.387761 163581 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0229 01:48:10.387854 163581 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0229 01:48:10.387911 163581 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0229 01:48:10.387987 163581 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0229 01:48:10.388072 163581 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0229 01:48:10.389629 163581 out.go:204] - Booting up control plane ...
I0229 01:48:10.389719 163581 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0229 01:48:10.389833 163581 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0229 01:48:10.389932 163581 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0229 01:48:10.390030 163581 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0229 01:48:10.390173 163581 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0229 01:48:10.390216 163581 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0229 01:48:10.390287 163581 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 01:48:10.390445 163581 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 01:48:10.390529 163581 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 01:48:10.390711 163581 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 01:48:10.390812 163581 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 01:48:10.391074 163581 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 01:48:10.391141 163581 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 01:48:10.391312 163581 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 01:48:10.391413 163581 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 01:48:10.391619 163581 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 01:48:10.391633 163581 kubeadm.go:322]
I0229 01:48:10.391684 163581 kubeadm.go:322] Unfortunately, an error has occurred:
I0229 01:48:10.391739 163581 kubeadm.go:322] timed out waiting for the condition
I0229 01:48:10.391750 163581 kubeadm.go:322]
I0229 01:48:10.391783 163581 kubeadm.go:322] This error is likely caused by:
I0229 01:48:10.391819 163581 kubeadm.go:322] - The kubelet is not running
I0229 01:48:10.391931 163581 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0229 01:48:10.391939 163581 kubeadm.go:322]
I0229 01:48:10.392063 163581 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0229 01:48:10.392111 163581 kubeadm.go:322] - 'systemctl status kubelet'
I0229 01:48:10.392155 163581 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0229 01:48:10.392163 163581 kubeadm.go:322]
I0229 01:48:10.392261 163581 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0229 01:48:10.392381 163581 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0229 01:48:10.392479 163581 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0229 01:48:10.392549 163581 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0229 01:48:10.392649 163581 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0229 01:48:10.392724 163581 kubeadm.go:322] - 'docker logs CONTAINERID'
I0229 01:48:10.392749 163581 kubeadm.go:406] StartCluster complete in 3m56.167937061s
I0229 01:48:10.392836 163581 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0229 01:48:10.417138 163581 logs.go:276] 0 containers: []
W0229 01:48:10.417157 163581 logs.go:278] No container was found matching "kube-apiserver"
I0229 01:48:10.417210 163581 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0229 01:48:10.434970 163581 logs.go:276] 0 containers: []
W0229 01:48:10.434993 163581 logs.go:278] No container was found matching "etcd"
I0229 01:48:10.435051 163581 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0229 01:48:10.452551 163581 logs.go:276] 0 containers: []
W0229 01:48:10.452579 163581 logs.go:278] No container was found matching "coredns"
I0229 01:48:10.452644 163581 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0229 01:48:10.469543 163581 logs.go:276] 0 containers: []
W0229 01:48:10.469566 163581 logs.go:278] No container was found matching "kube-scheduler"
I0229 01:48:10.469618 163581 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0229 01:48:10.485744 163581 logs.go:276] 0 containers: []
W0229 01:48:10.485787 163581 logs.go:278] No container was found matching "kube-proxy"
I0229 01:48:10.485857 163581 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0229 01:48:10.502871 163581 logs.go:276] 0 containers: []
W0229 01:48:10.502891 163581 logs.go:278] No container was found matching "kube-controller-manager"
I0229 01:48:10.502938 163581 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}
I0229 01:48:10.520796 163581 logs.go:276] 0 containers: []
W0229 01:48:10.520822 163581 logs.go:278] No container was found matching "kindnet"
I0229 01:48:10.520836 163581 logs.go:123] Gathering logs for dmesg ...
I0229 01:48:10.520850 163581 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0229 01:48:10.535557 163581 logs.go:123] Gathering logs for describe nodes ...
I0229 01:48:10.535582 163581 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0229 01:48:10.606599 163581 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0229 01:48:10.606622 163581 logs.go:123] Gathering logs for Docker ...
I0229 01:48:10.606638 163581 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"
I0229 01:48:10.648844 163581 logs.go:123] Gathering logs for container status ...
I0229 01:48:10.648878 163581 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0229 01:48:10.711068 163581 logs.go:123] Gathering logs for kubelet ...
I0229 01:48:10.711108 163581 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
W0229 01:48:10.775908 163581 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 01:48:10.775985 163581 out.go:239] *
*
W0229 01:48:10.776076 163581 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 01:48:10.776111 163581 out.go:239] *
*
W0229 01:48:10.776994 163581 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0229 01:48:10.780198 163581 out.go:177]
W0229 01:48:10.781807 163581 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.7. Latest validated version: 18.09
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 01:48:10.781912 163581 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0229 01:48:10.781946 163581 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0229 01:48:10.783349 163581 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-096771 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-096771 -n old-k8s-version-096771
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-096771 -n old-k8s-version-096771: exit status 6 (253.136608ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0229 01:48:11.084087 170256 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-096771" does not appear in /home/jenkins/minikube-integration/18063-115328/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-096771" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (283.52s)