=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-561577 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.16.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-561577 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.16.0: exit status 109 (5m2.707523021s)
-- stdout --
* [old-k8s-version-561577] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18259
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18259-6412/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18259-6412/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting control plane node old-k8s-version-561577 in cluster old-k8s-version-561577
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.16.0 on containerd 1.7.11 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0229 18:31:38.377856 41533 out.go:291] Setting OutFile to fd 1 ...
I0229 18:31:38.377991 41533 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0229 18:31:38.378001 41533 out.go:304] Setting ErrFile to fd 2...
I0229 18:31:38.378005 41533 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0229 18:31:38.378200 41533 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18259-6412/.minikube/bin
I0229 18:31:38.378786 41533 out.go:298] Setting JSON to false
I0229 18:31:38.379639 41533 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-5","uptime":4440,"bootTime":1709227059,"procs":207,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0229 18:31:38.379695 41533 start.go:139] virtualization: kvm guest
I0229 18:31:38.382111 41533 out.go:177] * [old-k8s-version-561577] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0229 18:31:38.383605 41533 out.go:177] - MINIKUBE_LOCATION=18259
I0229 18:31:38.383612 41533 notify.go:220] Checking for updates...
I0229 18:31:38.385081 41533 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0229 18:31:38.386685 41533 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18259-6412/kubeconfig
I0229 18:31:38.387892 41533 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18259-6412/.minikube
I0229 18:31:38.389142 41533 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0229 18:31:38.390678 41533 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0229 18:31:38.392200 41533 config.go:182] Loaded profile config "cert-expiration-829233": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.28.4
I0229 18:31:38.392292 41533 config.go:182] Loaded profile config "kubernetes-upgrade-907979": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
I0229 18:31:38.392398 41533 config.go:182] Loaded profile config "stopped-upgrade-475131": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.24.1
I0229 18:31:38.392481 41533 driver.go:392] Setting default libvirt URI to qemu:///system
I0229 18:31:38.426164 41533 out.go:177] * Using the kvm2 driver based on user configuration
I0229 18:31:38.427378 41533 start.go:299] selected driver: kvm2
I0229 18:31:38.427389 41533 start.go:903] validating driver "kvm2" against <nil>
I0229 18:31:38.427399 41533 start.go:914] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0229 18:31:38.428056 41533 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0229 18:31:38.428151 41533 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18259-6412/.minikube/bin:/home/jenkins/workspace/KVM_Linux_containerd_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0229 18:31:38.441930 41533 install.go:137] /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0229 18:31:38.441965 41533 start_flags.go:309] no existing cluster config was found, will generate one from the flags
I0229 18:31:38.442150 41533 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0229 18:31:38.442210 41533 cni.go:84] Creating CNI manager for ""
I0229 18:31:38.442223 41533 cni.go:146] "kvm2" driver + "containerd" runtime found, recommending bridge
I0229 18:31:38.442234 41533 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0229 18:31:38.442242 41533 start_flags.go:323] config:
{Name:old-k8s-version-561577 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-561577 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR
untime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0229 18:31:38.442356 41533 iso.go:125] acquiring lock: {Name:mkfdba4e88687e074c733f44da0c4de025dfd4cc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0229 18:31:38.443859 41533 out.go:177] * Starting control plane node old-k8s-version-561577 in cluster old-k8s-version-561577
I0229 18:31:38.444974 41533 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
I0229 18:31:38.444996 41533 preload.go:148] Found local preload: /home/jenkins/minikube-integration/18259-6412/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4
I0229 18:31:38.445003 41533 cache.go:56] Caching tarball of preloaded images
I0229 18:31:38.445058 41533 preload.go:174] Found /home/jenkins/minikube-integration/18259-6412/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
I0229 18:31:38.445067 41533 cache.go:59] Finished verifying existence of preloaded tar for v1.16.0 on containerd
I0229 18:31:38.445141 41533 profile.go:148] Saving config to /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/config.json ...
I0229 18:31:38.445157 41533 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/config.json: {Name:mk9e5dc95c177594a1139463be6d9cca893320eb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:31:38.445257 41533 start.go:365] acquiring machines lock for old-k8s-version-561577: {Name:mkf692a70c79b07a451e99e83525eaaa17684fbb Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0229 18:32:05.447345 41533 start.go:369] acquired machines lock for "old-k8s-version-561577" in 27.002028916s
I0229 18:32:05.447437 41533 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-561577 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-561577 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0229 18:32:05.447603 41533 start.go:125] createHost starting for "" (driver="kvm2")
I0229 18:32:05.450004 41533 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0229 18:32:05.450251 41533 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_containerd_integration/out/docker-machine-driver-kvm2
I0229 18:32:05.450304 41533 main.go:141] libmachine: Launching plugin server for driver kvm2
I0229 18:32:05.466827 41533 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42031
I0229 18:32:05.467281 41533 main.go:141] libmachine: () Calling .GetVersion
I0229 18:32:05.467788 41533 main.go:141] libmachine: Using API Version 1
I0229 18:32:05.467813 41533 main.go:141] libmachine: () Calling .SetConfigRaw
I0229 18:32:05.468501 41533 main.go:141] libmachine: () Calling .GetMachineName
I0229 18:32:05.468827 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetMachineName
I0229 18:32:05.470182 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .DriverName
I0229 18:32:05.470370 41533 start.go:159] libmachine.API.Create for "old-k8s-version-561577" (driver="kvm2")
I0229 18:32:05.470400 41533 client.go:168] LocalClient.Create starting
I0229 18:32:05.470463 41533 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18259-6412/.minikube/certs/ca.pem
I0229 18:32:05.470504 41533 main.go:141] libmachine: Decoding PEM data...
I0229 18:32:05.470525 41533 main.go:141] libmachine: Parsing certificate...
I0229 18:32:05.470619 41533 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18259-6412/.minikube/certs/cert.pem
I0229 18:32:05.470650 41533 main.go:141] libmachine: Decoding PEM data...
I0229 18:32:05.470677 41533 main.go:141] libmachine: Parsing certificate...
I0229 18:32:05.470720 41533 main.go:141] libmachine: Running pre-create checks...
I0229 18:32:05.470741 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .PreCreateCheck
I0229 18:32:05.471143 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetConfigRaw
I0229 18:32:05.471721 41533 main.go:141] libmachine: Creating machine...
I0229 18:32:05.471741 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .Create
I0229 18:32:05.471887 41533 main.go:141] libmachine: (old-k8s-version-561577) Creating KVM machine...
I0229 18:32:05.473139 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found existing default KVM network
I0229 18:32:05.474921 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:05.474776 41785 network.go:207] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000204bf0}
I0229 18:32:05.479969 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | trying to create private KVM network mk-old-k8s-version-561577 192.168.39.0/24...
I0229 18:32:05.547130 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | private KVM network mk-old-k8s-version-561577 192.168.39.0/24 created
I0229 18:32:05.547159 41533 main.go:141] libmachine: (old-k8s-version-561577) Setting up store path in /home/jenkins/minikube-integration/18259-6412/.minikube/machines/old-k8s-version-561577 ...
I0229 18:32:05.547173 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:05.547087 41785 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18259-6412/.minikube
I0229 18:32:05.547192 41533 main.go:141] libmachine: (old-k8s-version-561577) Building disk image from file:///home/jenkins/minikube-integration/18259-6412/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso
I0229 18:32:05.547243 41533 main.go:141] libmachine: (old-k8s-version-561577) Downloading /home/jenkins/minikube-integration/18259-6412/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18259-6412/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
I0229 18:32:05.774730 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:05.774592 41785 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18259-6412/.minikube/machines/old-k8s-version-561577/id_rsa...
I0229 18:32:05.921056 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:05.920943 41785 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18259-6412/.minikube/machines/old-k8s-version-561577/old-k8s-version-561577.rawdisk...
I0229 18:32:05.921085 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | Writing magic tar header
I0229 18:32:05.921098 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | Writing SSH key tar header
I0229 18:32:05.921115 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:05.921051 41785 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18259-6412/.minikube/machines/old-k8s-version-561577 ...
I0229 18:32:05.921129 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18259-6412/.minikube/machines/old-k8s-version-561577
I0229 18:32:05.921204 41533 main.go:141] libmachine: (old-k8s-version-561577) Setting executable bit set on /home/jenkins/minikube-integration/18259-6412/.minikube/machines/old-k8s-version-561577 (perms=drwx------)
I0229 18:32:05.921225 41533 main.go:141] libmachine: (old-k8s-version-561577) Setting executable bit set on /home/jenkins/minikube-integration/18259-6412/.minikube/machines (perms=drwxr-xr-x)
I0229 18:32:05.921233 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18259-6412/.minikube/machines
I0229 18:32:05.921242 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18259-6412/.minikube
I0229 18:32:05.921252 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18259-6412
I0229 18:32:05.921267 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0229 18:32:05.921280 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | Checking permissions on dir: /home/jenkins
I0229 18:32:05.921290 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | Checking permissions on dir: /home
I0229 18:32:05.921299 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | Skipping /home - not owner
I0229 18:32:05.921343 41533 main.go:141] libmachine: (old-k8s-version-561577) Setting executable bit set on /home/jenkins/minikube-integration/18259-6412/.minikube (perms=drwxr-xr-x)
I0229 18:32:05.921370 41533 main.go:141] libmachine: (old-k8s-version-561577) Setting executable bit set on /home/jenkins/minikube-integration/18259-6412 (perms=drwxrwxr-x)
I0229 18:32:05.921389 41533 main.go:141] libmachine: (old-k8s-version-561577) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0229 18:32:05.921403 41533 main.go:141] libmachine: (old-k8s-version-561577) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0229 18:32:05.921420 41533 main.go:141] libmachine: (old-k8s-version-561577) Creating domain...
I0229 18:32:05.922324 41533 main.go:141] libmachine: (old-k8s-version-561577) define libvirt domain using xml:
I0229 18:32:05.922344 41533 main.go:141] libmachine: (old-k8s-version-561577) <domain type='kvm'>
I0229 18:32:05.922351 41533 main.go:141] libmachine: (old-k8s-version-561577) <name>old-k8s-version-561577</name>
I0229 18:32:05.922357 41533 main.go:141] libmachine: (old-k8s-version-561577) <memory unit='MiB'>2200</memory>
I0229 18:32:05.922362 41533 main.go:141] libmachine: (old-k8s-version-561577) <vcpu>2</vcpu>
I0229 18:32:05.922371 41533 main.go:141] libmachine: (old-k8s-version-561577) <features>
I0229 18:32:05.922382 41533 main.go:141] libmachine: (old-k8s-version-561577) <acpi/>
I0229 18:32:05.922386 41533 main.go:141] libmachine: (old-k8s-version-561577) <apic/>
I0229 18:32:05.922392 41533 main.go:141] libmachine: (old-k8s-version-561577) <pae/>
I0229 18:32:05.922396 41533 main.go:141] libmachine: (old-k8s-version-561577)
I0229 18:32:05.922404 41533 main.go:141] libmachine: (old-k8s-version-561577) </features>
I0229 18:32:05.922408 41533 main.go:141] libmachine: (old-k8s-version-561577) <cpu mode='host-passthrough'>
I0229 18:32:05.922413 41533 main.go:141] libmachine: (old-k8s-version-561577)
I0229 18:32:05.922420 41533 main.go:141] libmachine: (old-k8s-version-561577) </cpu>
I0229 18:32:05.922424 41533 main.go:141] libmachine: (old-k8s-version-561577) <os>
I0229 18:32:05.922429 41533 main.go:141] libmachine: (old-k8s-version-561577) <type>hvm</type>
I0229 18:32:05.922434 41533 main.go:141] libmachine: (old-k8s-version-561577) <boot dev='cdrom'/>
I0229 18:32:05.922439 41533 main.go:141] libmachine: (old-k8s-version-561577) <boot dev='hd'/>
I0229 18:32:05.922444 41533 main.go:141] libmachine: (old-k8s-version-561577) <bootmenu enable='no'/>
I0229 18:32:05.922455 41533 main.go:141] libmachine: (old-k8s-version-561577) </os>
I0229 18:32:05.922463 41533 main.go:141] libmachine: (old-k8s-version-561577) <devices>
I0229 18:32:05.922469 41533 main.go:141] libmachine: (old-k8s-version-561577) <disk type='file' device='cdrom'>
I0229 18:32:05.922482 41533 main.go:141] libmachine: (old-k8s-version-561577) <source file='/home/jenkins/minikube-integration/18259-6412/.minikube/machines/old-k8s-version-561577/boot2docker.iso'/>
I0229 18:32:05.922493 41533 main.go:141] libmachine: (old-k8s-version-561577) <target dev='hdc' bus='scsi'/>
I0229 18:32:05.922498 41533 main.go:141] libmachine: (old-k8s-version-561577) <readonly/>
I0229 18:32:05.922503 41533 main.go:141] libmachine: (old-k8s-version-561577) </disk>
I0229 18:32:05.922507 41533 main.go:141] libmachine: (old-k8s-version-561577) <disk type='file' device='disk'>
I0229 18:32:05.922517 41533 main.go:141] libmachine: (old-k8s-version-561577) <driver name='qemu' type='raw' cache='default' io='threads' />
I0229 18:32:05.922524 41533 main.go:141] libmachine: (old-k8s-version-561577) <source file='/home/jenkins/minikube-integration/18259-6412/.minikube/machines/old-k8s-version-561577/old-k8s-version-561577.rawdisk'/>
I0229 18:32:05.922532 41533 main.go:141] libmachine: (old-k8s-version-561577) <target dev='hda' bus='virtio'/>
I0229 18:32:05.922537 41533 main.go:141] libmachine: (old-k8s-version-561577) </disk>
I0229 18:32:05.922559 41533 main.go:141] libmachine: (old-k8s-version-561577) <interface type='network'>
I0229 18:32:05.922571 41533 main.go:141] libmachine: (old-k8s-version-561577) <source network='mk-old-k8s-version-561577'/>
I0229 18:32:05.922576 41533 main.go:141] libmachine: (old-k8s-version-561577) <model type='virtio'/>
I0229 18:32:05.922584 41533 main.go:141] libmachine: (old-k8s-version-561577) </interface>
I0229 18:32:05.922615 41533 main.go:141] libmachine: (old-k8s-version-561577) <interface type='network'>
I0229 18:32:05.922636 41533 main.go:141] libmachine: (old-k8s-version-561577) <source network='default'/>
I0229 18:32:05.922646 41533 main.go:141] libmachine: (old-k8s-version-561577) <model type='virtio'/>
I0229 18:32:05.922654 41533 main.go:141] libmachine: (old-k8s-version-561577) </interface>
I0229 18:32:05.922668 41533 main.go:141] libmachine: (old-k8s-version-561577) <serial type='pty'>
I0229 18:32:05.922680 41533 main.go:141] libmachine: (old-k8s-version-561577) <target port='0'/>
I0229 18:32:05.922692 41533 main.go:141] libmachine: (old-k8s-version-561577) </serial>
I0229 18:32:05.922703 41533 main.go:141] libmachine: (old-k8s-version-561577) <console type='pty'>
I0229 18:32:05.922715 41533 main.go:141] libmachine: (old-k8s-version-561577) <target type='serial' port='0'/>
I0229 18:32:05.922735 41533 main.go:141] libmachine: (old-k8s-version-561577) </console>
I0229 18:32:05.922746 41533 main.go:141] libmachine: (old-k8s-version-561577) <rng model='virtio'>
I0229 18:32:05.922756 41533 main.go:141] libmachine: (old-k8s-version-561577) <backend model='random'>/dev/random</backend>
I0229 18:32:05.922769 41533 main.go:141] libmachine: (old-k8s-version-561577) </rng>
I0229 18:32:05.922779 41533 main.go:141] libmachine: (old-k8s-version-561577)
I0229 18:32:05.922787 41533 main.go:141] libmachine: (old-k8s-version-561577)
I0229 18:32:05.922797 41533 main.go:141] libmachine: (old-k8s-version-561577) </devices>
I0229 18:32:05.922816 41533 main.go:141] libmachine: (old-k8s-version-561577) </domain>
I0229 18:32:05.922839 41533 main.go:141] libmachine: (old-k8s-version-561577)
I0229 18:32:05.929553 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:11:19:5b in network default
I0229 18:32:05.930091 41533 main.go:141] libmachine: (old-k8s-version-561577) Ensuring networks are active...
I0229 18:32:05.930111 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:05.930866 41533 main.go:141] libmachine: (old-k8s-version-561577) Ensuring network default is active
I0229 18:32:05.931150 41533 main.go:141] libmachine: (old-k8s-version-561577) Ensuring network mk-old-k8s-version-561577 is active
I0229 18:32:05.931715 41533 main.go:141] libmachine: (old-k8s-version-561577) Getting domain xml...
I0229 18:32:05.932310 41533 main.go:141] libmachine: (old-k8s-version-561577) Creating domain...
I0229 18:32:07.138510 41533 main.go:141] libmachine: (old-k8s-version-561577) Waiting to get IP...
I0229 18:32:07.139247 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:07.139734 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | unable to find current IP address of domain old-k8s-version-561577 in network mk-old-k8s-version-561577
I0229 18:32:07.139805 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:07.139736 41785 retry.go:31] will retry after 254.349055ms: waiting for machine to come up
I0229 18:32:07.396082 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:07.396555 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | unable to find current IP address of domain old-k8s-version-561577 in network mk-old-k8s-version-561577
I0229 18:32:07.396588 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:07.396498 41785 retry.go:31] will retry after 293.265069ms: waiting for machine to come up
I0229 18:32:07.691066 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:07.691614 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | unable to find current IP address of domain old-k8s-version-561577 in network mk-old-k8s-version-561577
I0229 18:32:07.691642 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:07.691566 41785 retry.go:31] will retry after 401.848111ms: waiting for machine to come up
I0229 18:32:08.095077 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:08.095581 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | unable to find current IP address of domain old-k8s-version-561577 in network mk-old-k8s-version-561577
I0229 18:32:08.095610 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:08.095520 41785 retry.go:31] will retry after 465.902488ms: waiting for machine to come up
I0229 18:32:08.563119 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:08.563565 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | unable to find current IP address of domain old-k8s-version-561577 in network mk-old-k8s-version-561577
I0229 18:32:08.563596 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:08.563514 41785 retry.go:31] will retry after 746.061647ms: waiting for machine to come up
I0229 18:32:09.311047 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:09.311540 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | unable to find current IP address of domain old-k8s-version-561577 in network mk-old-k8s-version-561577
I0229 18:32:09.311567 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:09.311497 41785 retry.go:31] will retry after 669.919332ms: waiting for machine to come up
I0229 18:32:09.983369 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:09.983897 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | unable to find current IP address of domain old-k8s-version-561577 in network mk-old-k8s-version-561577
I0229 18:32:09.983926 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:09.983853 41785 retry.go:31] will retry after 740.330077ms: waiting for machine to come up
I0229 18:32:10.726255 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:10.726832 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | unable to find current IP address of domain old-k8s-version-561577 in network mk-old-k8s-version-561577
I0229 18:32:10.726855 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:10.726789 41785 retry.go:31] will retry after 1.373899377s: waiting for machine to come up
I0229 18:32:12.102093 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:12.102699 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | unable to find current IP address of domain old-k8s-version-561577 in network mk-old-k8s-version-561577
I0229 18:32:12.102723 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:12.102654 41785 retry.go:31] will retry after 1.380437528s: waiting for machine to come up
I0229 18:32:13.484202 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:13.484846 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | unable to find current IP address of domain old-k8s-version-561577 in network mk-old-k8s-version-561577
I0229 18:32:13.484879 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:13.484776 41785 retry.go:31] will retry after 1.902822682s: waiting for machine to come up
I0229 18:32:15.389601 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:15.390123 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | unable to find current IP address of domain old-k8s-version-561577 in network mk-old-k8s-version-561577
I0229 18:32:15.390154 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:15.390068 41785 retry.go:31] will retry after 2.186214319s: waiting for machine to come up
I0229 18:32:17.578848 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:17.579357 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | unable to find current IP address of domain old-k8s-version-561577 in network mk-old-k8s-version-561577
I0229 18:32:17.579388 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:17.579294 41785 retry.go:31] will retry after 2.282008825s: waiting for machine to come up
I0229 18:32:19.863704 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:19.864134 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | unable to find current IP address of domain old-k8s-version-561577 in network mk-old-k8s-version-561577
I0229 18:32:19.864154 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:19.864096 41785 retry.go:31] will retry after 3.221566982s: waiting for machine to come up
I0229 18:32:23.086798 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:23.087258 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | unable to find current IP address of domain old-k8s-version-561577 in network mk-old-k8s-version-561577
I0229 18:32:23.087281 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:23.087202 41785 retry.go:31] will retry after 3.725691028s: waiting for machine to come up
I0229 18:32:26.814353 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:26.814980 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | unable to find current IP address of domain old-k8s-version-561577 in network mk-old-k8s-version-561577
I0229 18:32:26.815012 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | I0229 18:32:26.814935 41785 retry.go:31] will retry after 5.756739559s: waiting for machine to come up
I0229 18:32:32.574113 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:32.574610 41533 main.go:141] libmachine: (old-k8s-version-561577) Found IP for machine: 192.168.39.66
I0229 18:32:32.574637 41533 main.go:141] libmachine: (old-k8s-version-561577) Reserving static IP address...
I0229 18:32:32.574653 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has current primary IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:32.574958 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-561577", mac: "52:54:00:88:1b:5b", ip: "192.168.39.66"} in network mk-old-k8s-version-561577
I0229 18:32:32.645241 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | Getting to WaitForSSH function...
I0229 18:32:32.645268 41533 main.go:141] libmachine: (old-k8s-version-561577) Reserved static IP address: 192.168.39.66
I0229 18:32:32.645284 41533 main.go:141] libmachine: (old-k8s-version-561577) Waiting for SSH to be available...
I0229 18:32:32.648312 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:32.648667 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:1b:5b", ip: ""} in network mk-old-k8s-version-561577: {Iface:virbr3 ExpiryTime:2024-02-29 19:32:21 +0000 UTC Type:0 Mac:52:54:00:88:1b:5b Iaid: IPaddr:192.168.39.66 Prefix:24 Hostname:minikube Clientid:01:52:54:00:88:1b:5b}
I0229 18:32:32.648698 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:32.648837 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | Using SSH client type: external
I0229 18:32:32.648878 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | Using SSH private key: /home/jenkins/minikube-integration/18259-6412/.minikube/machines/old-k8s-version-561577/id_rsa (-rw-------)
I0229 18:32:32.648914 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.66 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18259-6412/.minikube/machines/old-k8s-version-561577/id_rsa -p 22] /usr/bin/ssh <nil>}
I0229 18:32:32.648931 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | About to run SSH command:
I0229 18:32:32.648949 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | exit 0
I0229 18:32:32.780062 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | SSH cmd err, output: <nil>:
I0229 18:32:32.780317 41533 main.go:141] libmachine: (old-k8s-version-561577) KVM machine creation complete!
I0229 18:32:32.780664 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetConfigRaw
I0229 18:32:32.781251 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .DriverName
I0229 18:32:32.781461 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .DriverName
I0229 18:32:32.781683 41533 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0229 18:32:32.781702 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetState
I0229 18:32:32.783276 41533 main.go:141] libmachine: Detecting operating system of created instance...
I0229 18:32:32.783292 41533 main.go:141] libmachine: Waiting for SSH to be available...
I0229 18:32:32.783302 41533 main.go:141] libmachine: Getting to WaitForSSH function...
I0229 18:32:32.783312 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHHostname
I0229 18:32:32.785916 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:32.786535 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:1b:5b", ip: ""} in network mk-old-k8s-version-561577: {Iface:virbr3 ExpiryTime:2024-02-29 19:32:21 +0000 UTC Type:0 Mac:52:54:00:88:1b:5b Iaid: IPaddr:192.168.39.66 Prefix:24 Hostname:old-k8s-version-561577 Clientid:01:52:54:00:88:1b:5b}
I0229 18:32:32.786580 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:32.786756 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHPort
I0229 18:32:32.786967 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHKeyPath
I0229 18:32:32.787185 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHKeyPath
I0229 18:32:32.787365 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHUsername
I0229 18:32:32.787559 41533 main.go:141] libmachine: Using SSH client type: native
I0229 18:32:32.787801 41533 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.66 22 <nil> <nil>}
I0229 18:32:32.787817 41533 main.go:141] libmachine: About to run SSH command:
exit 0
I0229 18:32:32.903262 41533 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0229 18:32:32.903285 41533 main.go:141] libmachine: Detecting the provisioner...
I0229 18:32:32.903295 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHHostname
I0229 18:32:32.906449 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:32.906908 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:1b:5b", ip: ""} in network mk-old-k8s-version-561577: {Iface:virbr3 ExpiryTime:2024-02-29 19:32:21 +0000 UTC Type:0 Mac:52:54:00:88:1b:5b Iaid: IPaddr:192.168.39.66 Prefix:24 Hostname:old-k8s-version-561577 Clientid:01:52:54:00:88:1b:5b}
I0229 18:32:32.906941 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:32.907145 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHPort
I0229 18:32:32.907373 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHKeyPath
I0229 18:32:32.907543 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHKeyPath
I0229 18:32:32.907670 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHUsername
I0229 18:32:32.907835 41533 main.go:141] libmachine: Using SSH client type: native
I0229 18:32:32.908054 41533 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.66 22 <nil> <nil>}
I0229 18:32:32.908074 41533 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0229 18:32:33.031673 41533 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0229 18:32:33.031754 41533 main.go:141] libmachine: found compatible host: buildroot
I0229 18:32:33.031768 41533 main.go:141] libmachine: Provisioning with buildroot...
I0229 18:32:33.031783 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetMachineName
I0229 18:32:33.032008 41533 buildroot.go:166] provisioning hostname "old-k8s-version-561577"
I0229 18:32:33.032029 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetMachineName
I0229 18:32:33.032195 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHHostname
I0229 18:32:33.034866 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.035261 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:1b:5b", ip: ""} in network mk-old-k8s-version-561577: {Iface:virbr3 ExpiryTime:2024-02-29 19:32:21 +0000 UTC Type:0 Mac:52:54:00:88:1b:5b Iaid: IPaddr:192.168.39.66 Prefix:24 Hostname:old-k8s-version-561577 Clientid:01:52:54:00:88:1b:5b}
I0229 18:32:33.035301 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.035381 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHPort
I0229 18:32:33.035568 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHKeyPath
I0229 18:32:33.035734 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHKeyPath
I0229 18:32:33.035922 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHUsername
I0229 18:32:33.036072 41533 main.go:141] libmachine: Using SSH client type: native
I0229 18:32:33.036234 41533 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.66 22 <nil> <nil>}
I0229 18:32:33.036245 41533 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-561577 && echo "old-k8s-version-561577" | sudo tee /etc/hostname
I0229 18:32:33.171241 41533 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-561577
I0229 18:32:33.171273 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHHostname
I0229 18:32:33.174049 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.174372 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:1b:5b", ip: ""} in network mk-old-k8s-version-561577: {Iface:virbr3 ExpiryTime:2024-02-29 19:32:21 +0000 UTC Type:0 Mac:52:54:00:88:1b:5b Iaid: IPaddr:192.168.39.66 Prefix:24 Hostname:old-k8s-version-561577 Clientid:01:52:54:00:88:1b:5b}
I0229 18:32:33.174401 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.174520 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHPort
I0229 18:32:33.174734 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHKeyPath
I0229 18:32:33.174917 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHKeyPath
I0229 18:32:33.175070 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHUsername
I0229 18:32:33.175259 41533 main.go:141] libmachine: Using SSH client type: native
I0229 18:32:33.175407 41533 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.66 22 <nil> <nil>}
I0229 18:32:33.175424 41533 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-561577' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-561577/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-561577' | sudo tee -a /etc/hosts;
fi
fi
I0229 18:32:33.302023 41533 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0229 18:32:33.302051 41533 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18259-6412/.minikube CaCertPath:/home/jenkins/minikube-integration/18259-6412/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18259-6412/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18259-6412/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18259-6412/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18259-6412/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18259-6412/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18259-6412/.minikube}
I0229 18:32:33.302091 41533 buildroot.go:174] setting up certificates
I0229 18:32:33.302099 41533 provision.go:83] configureAuth start
I0229 18:32:33.302108 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetMachineName
I0229 18:32:33.302405 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetIP
I0229 18:32:33.305380 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.305724 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:1b:5b", ip: ""} in network mk-old-k8s-version-561577: {Iface:virbr3 ExpiryTime:2024-02-29 19:32:21 +0000 UTC Type:0 Mac:52:54:00:88:1b:5b Iaid: IPaddr:192.168.39.66 Prefix:24 Hostname:old-k8s-version-561577 Clientid:01:52:54:00:88:1b:5b}
I0229 18:32:33.305752 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.305897 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHHostname
I0229 18:32:33.308247 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.308654 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:1b:5b", ip: ""} in network mk-old-k8s-version-561577: {Iface:virbr3 ExpiryTime:2024-02-29 19:32:21 +0000 UTC Type:0 Mac:52:54:00:88:1b:5b Iaid: IPaddr:192.168.39.66 Prefix:24 Hostname:old-k8s-version-561577 Clientid:01:52:54:00:88:1b:5b}
I0229 18:32:33.308686 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.308884 41533 provision.go:138] copyHostCerts
I0229 18:32:33.308938 41533 exec_runner.go:144] found /home/jenkins/minikube-integration/18259-6412/.minikube/ca.pem, removing ...
I0229 18:32:33.308955 41533 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18259-6412/.minikube/ca.pem
I0229 18:32:33.309006 41533 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18259-6412/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18259-6412/.minikube/ca.pem (1078 bytes)
I0229 18:32:33.309083 41533 exec_runner.go:144] found /home/jenkins/minikube-integration/18259-6412/.minikube/cert.pem, removing ...
I0229 18:32:33.309091 41533 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18259-6412/.minikube/cert.pem
I0229 18:32:33.309110 41533 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18259-6412/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18259-6412/.minikube/cert.pem (1123 bytes)
I0229 18:32:33.309159 41533 exec_runner.go:144] found /home/jenkins/minikube-integration/18259-6412/.minikube/key.pem, removing ...
I0229 18:32:33.309165 41533 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18259-6412/.minikube/key.pem
I0229 18:32:33.309182 41533 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18259-6412/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18259-6412/.minikube/key.pem (1675 bytes)
I0229 18:32:33.309220 41533 provision.go:112] generating server cert: /home/jenkins/minikube-integration/18259-6412/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18259-6412/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18259-6412/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-561577 san=[192.168.39.66 192.168.39.66 localhost 127.0.0.1 minikube old-k8s-version-561577]
I0229 18:32:33.409876 41533 provision.go:172] copyRemoteCerts
I0229 18:32:33.409932 41533 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0229 18:32:33.409957 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHHostname
I0229 18:32:33.412655 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.412973 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:1b:5b", ip: ""} in network mk-old-k8s-version-561577: {Iface:virbr3 ExpiryTime:2024-02-29 19:32:21 +0000 UTC Type:0 Mac:52:54:00:88:1b:5b Iaid: IPaddr:192.168.39.66 Prefix:24 Hostname:old-k8s-version-561577 Clientid:01:52:54:00:88:1b:5b}
I0229 18:32:33.413025 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.413184 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHPort
I0229 18:32:33.413392 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHKeyPath
I0229 18:32:33.413538 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHUsername
I0229 18:32:33.413694 41533 sshutil.go:53] new ssh client: &{IP:192.168.39.66 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18259-6412/.minikube/machines/old-k8s-version-561577/id_rsa Username:docker}
I0229 18:32:33.501793 41533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6412/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0229 18:32:33.531300 41533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6412/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I0229 18:32:33.559515 41533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6412/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0229 18:32:33.588247 41533 provision.go:86] duration metric: configureAuth took 286.134911ms
I0229 18:32:33.588275 41533 buildroot.go:189] setting minikube options for container-runtime
I0229 18:32:33.588592 41533 config.go:182] Loaded profile config "old-k8s-version-561577": Driver=kvm2, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
I0229 18:32:33.588625 41533 main.go:141] libmachine: Checking connection to Docker...
I0229 18:32:33.588644 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetURL
I0229 18:32:33.589871 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | Using libvirt version 6000000
I0229 18:32:33.592135 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.592452 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:1b:5b", ip: ""} in network mk-old-k8s-version-561577: {Iface:virbr3 ExpiryTime:2024-02-29 19:32:21 +0000 UTC Type:0 Mac:52:54:00:88:1b:5b Iaid: IPaddr:192.168.39.66 Prefix:24 Hostname:old-k8s-version-561577 Clientid:01:52:54:00:88:1b:5b}
I0229 18:32:33.592482 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.592628 41533 main.go:141] libmachine: Docker is up and running!
I0229 18:32:33.592645 41533 main.go:141] libmachine: Reticulating splines...
I0229 18:32:33.592652 41533 client.go:171] LocalClient.Create took 28.122245232s
I0229 18:32:33.592674 41533 start.go:167] duration metric: libmachine.API.Create for "old-k8s-version-561577" took 28.122307729s
I0229 18:32:33.592683 41533 start.go:300] post-start starting for "old-k8s-version-561577" (driver="kvm2")
I0229 18:32:33.592692 41533 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0229 18:32:33.592711 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .DriverName
I0229 18:32:33.592934 41533 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0229 18:32:33.592957 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHHostname
I0229 18:32:33.594939 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.595276 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:1b:5b", ip: ""} in network mk-old-k8s-version-561577: {Iface:virbr3 ExpiryTime:2024-02-29 19:32:21 +0000 UTC Type:0 Mac:52:54:00:88:1b:5b Iaid: IPaddr:192.168.39.66 Prefix:24 Hostname:old-k8s-version-561577 Clientid:01:52:54:00:88:1b:5b}
I0229 18:32:33.595312 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.595407 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHPort
I0229 18:32:33.595587 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHKeyPath
I0229 18:32:33.595778 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHUsername
I0229 18:32:33.595934 41533 sshutil.go:53] new ssh client: &{IP:192.168.39.66 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18259-6412/.minikube/machines/old-k8s-version-561577/id_rsa Username:docker}
I0229 18:32:33.686737 41533 ssh_runner.go:195] Run: cat /etc/os-release
I0229 18:32:33.691676 41533 info.go:137] Remote host: Buildroot 2023.02.9
I0229 18:32:33.691704 41533 filesync.go:126] Scanning /home/jenkins/minikube-integration/18259-6412/.minikube/addons for local assets ...
I0229 18:32:33.691779 41533 filesync.go:126] Scanning /home/jenkins/minikube-integration/18259-6412/.minikube/files for local assets ...
I0229 18:32:33.691886 41533 filesync.go:149] local asset: /home/jenkins/minikube-integration/18259-6412/.minikube/files/etc/ssl/certs/137212.pem -> 137212.pem in /etc/ssl/certs
I0229 18:32:33.692010 41533 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0229 18:32:33.703911 41533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6412/.minikube/files/etc/ssl/certs/137212.pem --> /etc/ssl/certs/137212.pem (1708 bytes)
I0229 18:32:33.735972 41533 start.go:303] post-start completed in 143.275025ms
I0229 18:32:33.736029 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetConfigRaw
I0229 18:32:33.736597 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetIP
I0229 18:32:33.739383 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.739691 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:1b:5b", ip: ""} in network mk-old-k8s-version-561577: {Iface:virbr3 ExpiryTime:2024-02-29 19:32:21 +0000 UTC Type:0 Mac:52:54:00:88:1b:5b Iaid: IPaddr:192.168.39.66 Prefix:24 Hostname:old-k8s-version-561577 Clientid:01:52:54:00:88:1b:5b}
I0229 18:32:33.739720 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.739970 41533 profile.go:148] Saving config to /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/config.json ...
I0229 18:32:33.740184 41533 start.go:128] duration metric: createHost completed in 28.29256691s
I0229 18:32:33.740214 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHHostname
I0229 18:32:33.742687 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.743017 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:1b:5b", ip: ""} in network mk-old-k8s-version-561577: {Iface:virbr3 ExpiryTime:2024-02-29 19:32:21 +0000 UTC Type:0 Mac:52:54:00:88:1b:5b Iaid: IPaddr:192.168.39.66 Prefix:24 Hostname:old-k8s-version-561577 Clientid:01:52:54:00:88:1b:5b}
I0229 18:32:33.743044 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.743205 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHPort
I0229 18:32:33.743337 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHKeyPath
I0229 18:32:33.743478 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHKeyPath
I0229 18:32:33.743665 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHUsername
I0229 18:32:33.743828 41533 main.go:141] libmachine: Using SSH client type: native
I0229 18:32:33.743998 41533 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.66 22 <nil> <nil>}
I0229 18:32:33.744011 41533 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0229 18:32:33.874077 41533 main.go:141] libmachine: SSH cmd err, output: <nil>: 1709231553.849244501
I0229 18:32:33.874104 41533 fix.go:206] guest clock: 1709231553.849244501
I0229 18:32:33.874114 41533 fix.go:219] Guest: 2024-02-29 18:32:33.849244501 +0000 UTC Remote: 2024-02-29 18:32:33.740199433 +0000 UTC m=+55.408613058 (delta=109.045068ms)
I0229 18:32:33.874139 41533 fix.go:190] guest clock delta is within tolerance: 109.045068ms
I0229 18:32:33.874146 41533 start.go:83] releasing machines lock for "old-k8s-version-561577", held for 28.426759225s
I0229 18:32:33.874170 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .DriverName
I0229 18:32:33.874517 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetIP
I0229 18:32:33.877680 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.878084 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:1b:5b", ip: ""} in network mk-old-k8s-version-561577: {Iface:virbr3 ExpiryTime:2024-02-29 19:32:21 +0000 UTC Type:0 Mac:52:54:00:88:1b:5b Iaid: IPaddr:192.168.39.66 Prefix:24 Hostname:old-k8s-version-561577 Clientid:01:52:54:00:88:1b:5b}
I0229 18:32:33.878132 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.878308 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .DriverName
I0229 18:32:33.878873 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .DriverName
I0229 18:32:33.879032 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .DriverName
I0229 18:32:33.879113 41533 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0229 18:32:33.879165 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHHostname
I0229 18:32:33.879390 41533 ssh_runner.go:195] Run: cat /version.json
I0229 18:32:33.879435 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHHostname
I0229 18:32:33.882013 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.882238 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.882398 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:1b:5b", ip: ""} in network mk-old-k8s-version-561577: {Iface:virbr3 ExpiryTime:2024-02-29 19:32:21 +0000 UTC Type:0 Mac:52:54:00:88:1b:5b Iaid: IPaddr:192.168.39.66 Prefix:24 Hostname:old-k8s-version-561577 Clientid:01:52:54:00:88:1b:5b}
I0229 18:32:33.882444 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.882660 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:1b:5b", ip: ""} in network mk-old-k8s-version-561577: {Iface:virbr3 ExpiryTime:2024-02-29 19:32:21 +0000 UTC Type:0 Mac:52:54:00:88:1b:5b Iaid: IPaddr:192.168.39.66 Prefix:24 Hostname:old-k8s-version-561577 Clientid:01:52:54:00:88:1b:5b}
I0229 18:32:33.882698 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHPort
I0229 18:32:33.882724 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:33.882843 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHPort
I0229 18:32:33.882902 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHKeyPath
I0229 18:32:33.882986 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHKeyPath
I0229 18:32:33.883113 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHUsername
I0229 18:32:33.883201 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetSSHUsername
I0229 18:32:33.883327 41533 sshutil.go:53] new ssh client: &{IP:192.168.39.66 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18259-6412/.minikube/machines/old-k8s-version-561577/id_rsa Username:docker}
I0229 18:32:33.883419 41533 sshutil.go:53] new ssh client: &{IP:192.168.39.66 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18259-6412/.minikube/machines/old-k8s-version-561577/id_rsa Username:docker}
I0229 18:32:33.978176 41533 ssh_runner.go:195] Run: systemctl --version
I0229 18:32:34.004917 41533 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0229 18:32:34.012879 41533 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0229 18:32:34.012963 41533 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0229 18:32:34.032655 41533 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0229 18:32:34.032682 41533 start.go:475] detecting cgroup driver to use...
I0229 18:32:34.032757 41533 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0229 18:32:34.071493 41533 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0229 18:32:34.091159 41533 docker.go:217] disabling cri-docker service (if available) ...
I0229 18:32:34.091227 41533 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0229 18:32:34.106834 41533 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0229 18:32:34.128445 41533 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0229 18:32:34.257358 41533 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0229 18:32:34.421016 41533 docker.go:233] disabling docker service ...
I0229 18:32:34.421081 41533 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0229 18:32:34.436631 41533 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0229 18:32:34.450427 41533 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0229 18:32:34.575742 41533 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0229 18:32:34.706347 41533 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0229 18:32:34.721956 41533 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0229 18:32:34.742562 41533 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.1"|' /etc/containerd/config.toml"
I0229 18:32:34.753768 41533 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0229 18:32:34.764781 41533 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0229 18:32:34.764832 41533 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0229 18:32:34.777808 41533 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0229 18:32:34.790046 41533 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0229 18:32:34.802054 41533 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0229 18:32:34.815500 41533 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0229 18:32:34.828915 41533 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0229 18:32:34.841046 41533 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0229 18:32:34.851817 41533 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0229 18:32:34.851892 41533 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0229 18:32:34.867456 41533 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0229 18:32:34.879693 41533 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0229 18:32:35.010088 41533 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0229 18:32:35.045199 41533 start.go:522] Will wait 60s for socket path /run/containerd/containerd.sock
I0229 18:32:35.045275 41533 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0229 18:32:35.050125 41533 retry.go:31] will retry after 1.183054284s: stat /run/containerd/containerd.sock: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/run/containerd/containerd.sock': No such file or directory
I0229 18:32:36.233695 41533 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0229 18:32:36.239927 41533 start.go:543] Will wait 60s for crictl version
I0229 18:32:36.239991 41533 ssh_runner.go:195] Run: which crictl
I0229 18:32:36.245131 41533 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0229 18:32:36.295121 41533 start.go:559] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: v1.7.11
RuntimeApiVersion: v1
I0229 18:32:36.295198 41533 ssh_runner.go:195] Run: containerd --version
I0229 18:32:36.330133 41533 ssh_runner.go:195] Run: containerd --version
I0229 18:32:36.360920 41533 out.go:177] * Preparing Kubernetes v1.16.0 on containerd 1.7.11 ...
I0229 18:32:36.362134 41533 main.go:141] libmachine: (old-k8s-version-561577) Calling .GetIP
I0229 18:32:36.364939 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:36.365355 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:88:1b:5b", ip: ""} in network mk-old-k8s-version-561577: {Iface:virbr3 ExpiryTime:2024-02-29 19:32:21 +0000 UTC Type:0 Mac:52:54:00:88:1b:5b Iaid: IPaddr:192.168.39.66 Prefix:24 Hostname:old-k8s-version-561577 Clientid:01:52:54:00:88:1b:5b}
I0229 18:32:36.365395 41533 main.go:141] libmachine: (old-k8s-version-561577) DBG | domain old-k8s-version-561577 has defined IP address 192.168.39.66 and MAC address 52:54:00:88:1b:5b in network mk-old-k8s-version-561577
I0229 18:32:36.365660 41533 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0229 18:32:36.370346 41533 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0229 18:32:36.384654 41533 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
I0229 18:32:36.384712 41533 ssh_runner.go:195] Run: sudo crictl images --output json
I0229 18:32:36.423197 41533 containerd.go:608] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0229 18:32:36.423269 41533 ssh_runner.go:195] Run: which lz4
I0229 18:32:36.428040 41533 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0229 18:32:36.432758 41533 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0229 18:32:36.432783 41533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6412/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (440628646 bytes)
I0229 18:32:38.364114 41533 containerd.go:548] Took 1.936087 seconds to copy over tarball
I0229 18:32:38.364191 41533 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0229 18:32:41.130324 41533 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.766104272s)
I0229 18:32:41.130355 41533 containerd.go:555] Took 2.766211 seconds to extract the tarball
I0229 18:32:41.130366 41533 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0229 18:32:41.174594 41533 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0229 18:32:41.300494 41533 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0229 18:32:41.330444 41533 ssh_runner.go:195] Run: sudo crictl images --output json
I0229 18:32:41.371029 41533 retry.go:31] will retry after 228.31915ms: sudo crictl images --output json: Process exited with status 1
stdout:
stderr:
time="2024-02-29T18:32:41Z" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///run/containerd/containerd.sock\": rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial unix /run/containerd/containerd.sock: connect: no such file or directory\""
I0229 18:32:41.600528 41533 ssh_runner.go:195] Run: sudo crictl images --output json
I0229 18:32:41.640570 41533 containerd.go:608] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0229 18:32:41.640596 41533 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.16.0 registry.k8s.io/kube-controller-manager:v1.16.0 registry.k8s.io/kube-scheduler:v1.16.0 registry.k8s.io/kube-proxy:v1.16.0 registry.k8s.io/pause:3.1 registry.k8s.io/etcd:3.3.15-0 registry.k8s.io/coredns:1.6.2 gcr.io/k8s-minikube/storage-provisioner:v5]
I0229 18:32:41.640640 41533 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0229 18:32:41.640687 41533 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.16.0
I0229 18:32:41.640706 41533 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 18:32:41.640712 41533 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 18:32:41.640687 41533 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 18:32:41.640788 41533 image.go:134] retrieving image: registry.k8s.io/pause:3.1
I0229 18:32:41.640895 41533 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.2
I0229 18:32:41.640790 41533 image.go:134] retrieving image: registry.k8s.io/etcd:3.3.15-0
I0229 18:32:41.642135 41533 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 18:32:41.642382 41533 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.16.0
I0229 18:32:41.642397 41533 image.go:177] daemon lookup for registry.k8s.io/etcd:3.3.15-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.3.15-0
I0229 18:32:41.642442 41533 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.2: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.2
I0229 18:32:41.642445 41533 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 18:32:41.642382 41533 image.go:177] daemon lookup for registry.k8s.io/pause:3.1: Error response from daemon: No such image: registry.k8s.io/pause:3.1
I0229 18:32:41.642462 41533 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 18:32:41.642512 41533 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0229 18:32:41.885884 41533 containerd.go:252] Checking existence of image with name "registry.k8s.io/kube-apiserver:v1.16.0" and sha "b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e"
I0229 18:32:41.885931 41533 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images check
I0229 18:32:41.971528 41533 containerd.go:252] Checking existence of image with name "registry.k8s.io/pause:3.1" and sha "da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e"
I0229 18:32:41.971610 41533 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images check
I0229 18:32:41.979347 41533 containerd.go:252] Checking existence of image with name "registry.k8s.io/etcd:3.3.15-0" and sha "b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed"
I0229 18:32:41.979404 41533 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images check
I0229 18:32:41.981291 41533 containerd.go:252] Checking existence of image with name "registry.k8s.io/kube-scheduler:v1.16.0" and sha "301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a"
I0229 18:32:41.981340 41533 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images check
I0229 18:32:41.990072 41533 containerd.go:252] Checking existence of image with name "registry.k8s.io/kube-proxy:v1.16.0" and sha "c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384"
I0229 18:32:41.990133 41533 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images check
I0229 18:32:42.013641 41533 containerd.go:252] Checking existence of image with name "registry.k8s.io/kube-controller-manager:v1.16.0" and sha "06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d"
I0229 18:32:42.013703 41533 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images check
I0229 18:32:42.026166 41533 containerd.go:252] Checking existence of image with name "registry.k8s.io/coredns:1.6.2" and sha "bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b"
I0229 18:32:42.026234 41533 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images check
I0229 18:32:42.130500 41533 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.16.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.16.0" does not exist at hash "b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e" in container runtime
I0229 18:32:42.130558 41533 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 18:32:42.130626 41533 ssh_runner.go:195] Run: which crictl
I0229 18:32:42.944517 41533 cache_images.go:116] "registry.k8s.io/pause:3.1" needs transfer: "registry.k8s.io/pause:3.1" does not exist at hash "da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e" in container runtime
I0229 18:32:42.944557 41533 cri.go:218] Removing image: registry.k8s.io/pause:3.1
I0229 18:32:42.944597 41533 ssh_runner.go:195] Run: which crictl
I0229 18:32:43.021340 41533 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images check: (1.039977157s)
I0229 18:32:43.021453 41533 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.16.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.16.0" does not exist at hash "301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a" in container runtime
I0229 18:32:43.021487 41533 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 18:32:43.021533 41533 ssh_runner.go:195] Run: which crictl
I0229 18:32:43.022329 41533 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images check: (1.042905944s)
I0229 18:32:43.022383 41533 cache_images.go:116] "registry.k8s.io/etcd:3.3.15-0" needs transfer: "registry.k8s.io/etcd:3.3.15-0" does not exist at hash "b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed" in container runtime
I0229 18:32:43.022415 41533 cri.go:218] Removing image: registry.k8s.io/etcd:3.3.15-0
I0229 18:32:43.022452 41533 ssh_runner.go:195] Run: which crictl
I0229 18:32:43.077496 41533 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images check: (1.08733833s)
I0229 18:32:43.077574 41533 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.16.0" needs transfer: "registry.k8s.io/kube-proxy:v1.16.0" does not exist at hash "c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384" in container runtime
I0229 18:32:43.077603 41533 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.16.0
I0229 18:32:43.077651 41533 ssh_runner.go:195] Run: which crictl
I0229 18:32:43.077830 41533 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images check: (1.064107783s)
I0229 18:32:43.077890 41533 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.16.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.16.0" does not exist at hash "06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d" in container runtime
I0229 18:32:43.077918 41533 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 18:32:43.077965 41533 ssh_runner.go:195] Run: which crictl
I0229 18:32:43.078418 41533 ssh_runner.go:235] Completed: sudo ctr -n=k8s.io images check: (1.052163563s)
I0229 18:32:43.078455 41533 cache_images.go:116] "registry.k8s.io/coredns:1.6.2" needs transfer: "registry.k8s.io/coredns:1.6.2" does not exist at hash "bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b" in container runtime
I0229 18:32:43.078477 41533 cri.go:218] Removing image: registry.k8s.io/coredns:1.6.2
I0229 18:32:43.078498 41533 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.16.0
I0229 18:32:43.078507 41533 ssh_runner.go:195] Run: which crictl
I0229 18:32:43.078541 41533 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.16.0
I0229 18:32:43.078500 41533 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.1
I0229 18:32:43.078891 41533 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.3.15-0
I0229 18:32:43.083032 41533 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.16.0
I0229 18:32:43.102823 41533 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.16.0
I0229 18:32:43.234254 41533 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6412/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0
I0229 18:32:43.234304 41533 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.6.2
I0229 18:32:43.234323 41533 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6412/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0
I0229 18:32:43.234363 41533 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6412/.minikube/cache/images/amd64/registry.k8s.io/pause_3.1
I0229 18:32:43.234426 41533 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6412/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.3.15-0
I0229 18:32:43.239801 41533 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6412/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0
I0229 18:32:43.239826 41533 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6412/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.16.0
I0229 18:32:43.280116 41533 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6412/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2
I0229 18:32:43.507973 41533 containerd.go:252] Checking existence of image with name "gcr.io/k8s-minikube/storage-provisioner:v5" and sha "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562"
I0229 18:32:43.508042 41533 ssh_runner.go:195] Run: sudo ctr -n=k8s.io images check
I0229 18:32:43.716186 41533 cache_images.go:92] LoadImages completed in 2.075563631s
W0229 18:32:43.716272 41533 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18259-6412/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18259-6412/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0: no such file or directory
I0229 18:32:43.716336 41533 ssh_runner.go:195] Run: sudo crictl info
I0229 18:32:43.768371 41533 cni.go:84] Creating CNI manager for ""
I0229 18:32:43.768407 41533 cni.go:146] "kvm2" driver + "containerd" runtime found, recommending bridge
I0229 18:32:43.768428 41533 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0229 18:32:43.768452 41533 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.66 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-561577 NodeName:old-k8s-version-561577 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.66"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.66 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.c
rt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0229 18:32:43.768610 41533 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.66
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /run/containerd/containerd.sock
name: "old-k8s-version-561577"
kubeletExtraArgs:
node-ip: 192.168.39.66
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.66"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-561577
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.39.66:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0229 18:32:43.768695 41533 kubeadm.go:976] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-561577 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.66
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-561577 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0229 18:32:43.768758 41533 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0229 18:32:43.783891 41533 binaries.go:44] Found k8s binaries, skipping transfer
I0229 18:32:43.783977 41533 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0229 18:32:43.794631 41533 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (443 bytes)
I0229 18:32:43.818133 41533 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0229 18:32:43.844430 41533 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2185 bytes)
I0229 18:32:43.870243 41533 ssh_runner.go:195] Run: grep 192.168.39.66 control-plane.minikube.internal$ /etc/hosts
I0229 18:32:43.874866 41533 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.66 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0229 18:32:43.890305 41533 certs.go:56] Setting up /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577 for IP: 192.168.39.66
I0229 18:32:43.890336 41533 certs.go:190] acquiring lock for shared ca certs: {Name:mk2dadf741a26f46fb193aefceea30d228c16c80 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:32:43.890463 41533 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/18259-6412/.minikube/ca.key
I0229 18:32:43.890527 41533 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/18259-6412/.minikube/proxy-client-ca.key
I0229 18:32:43.890608 41533 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/client.key
I0229 18:32:43.890626 41533 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/client.crt with IP's: []
I0229 18:32:44.305849 41533 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/client.crt ...
I0229 18:32:44.305884 41533 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/client.crt: {Name:mk22751a1d36ed02f959a4404c6b26c4ec74c17a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:32:44.306086 41533 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/client.key ...
I0229 18:32:44.306112 41533 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/client.key: {Name:mk74b3449a907a51aefdd5e2c94bbfbe7b48cc19 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:32:44.306242 41533 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/apiserver.key.b02ae5fc
I0229 18:32:44.306262 41533 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/apiserver.crt.b02ae5fc with IP's: [192.168.39.66 10.96.0.1 127.0.0.1 10.0.0.1]
I0229 18:32:44.450174 41533 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/apiserver.crt.b02ae5fc ...
I0229 18:32:44.450209 41533 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/apiserver.crt.b02ae5fc: {Name:mk1e6178b56044ef5cae53646e4821badd7e335e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:32:44.450411 41533 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/apiserver.key.b02ae5fc ...
I0229 18:32:44.450434 41533 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/apiserver.key.b02ae5fc: {Name:mkec6fdb6bcbd3f3e919e5a8f601248934c594e3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:32:44.450540 41533 certs.go:337] copying /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/apiserver.crt.b02ae5fc -> /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/apiserver.crt
I0229 18:32:44.450685 41533 certs.go:341] copying /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/apiserver.key.b02ae5fc -> /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/apiserver.key
I0229 18:32:44.450771 41533 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/proxy-client.key
I0229 18:32:44.450794 41533 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/proxy-client.crt with IP's: []
I0229 18:32:44.642244 41533 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/proxy-client.crt ...
I0229 18:32:44.642286 41533 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/proxy-client.crt: {Name:mk57bf6e0cb56441997b715a276151098a05be2a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:32:44.642452 41533 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/proxy-client.key ...
I0229 18:32:44.642465 41533 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/proxy-client.key: {Name:mk56d36289d9743a39c8f1eb27707c4c982d23fa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:32:44.642656 41533 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6412/.minikube/certs/home/jenkins/minikube-integration/18259-6412/.minikube/certs/13721.pem (1338 bytes)
W0229 18:32:44.642700 41533 certs.go:433] ignoring /home/jenkins/minikube-integration/18259-6412/.minikube/certs/home/jenkins/minikube-integration/18259-6412/.minikube/certs/13721_empty.pem, impossibly tiny 0 bytes
I0229 18:32:44.642713 41533 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6412/.minikube/certs/home/jenkins/minikube-integration/18259-6412/.minikube/certs/ca-key.pem (1675 bytes)
I0229 18:32:44.642743 41533 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6412/.minikube/certs/home/jenkins/minikube-integration/18259-6412/.minikube/certs/ca.pem (1078 bytes)
I0229 18:32:44.642767 41533 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6412/.minikube/certs/home/jenkins/minikube-integration/18259-6412/.minikube/certs/cert.pem (1123 bytes)
I0229 18:32:44.642790 41533 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6412/.minikube/certs/home/jenkins/minikube-integration/18259-6412/.minikube/certs/key.pem (1675 bytes)
I0229 18:32:44.642826 41533 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6412/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/18259-6412/.minikube/files/etc/ssl/certs/137212.pem (1708 bytes)
I0229 18:32:44.643374 41533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0229 18:32:44.674099 41533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0229 18:32:44.705440 41533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0229 18:32:44.732793 41533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6412/.minikube/profiles/old-k8s-version-561577/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0229 18:32:44.769614 41533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6412/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0229 18:32:44.800626 41533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6412/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0229 18:32:44.834724 41533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6412/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0229 18:32:44.865920 41533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6412/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0229 18:32:44.894557 41533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6412/.minikube/certs/13721.pem --> /usr/share/ca-certificates/13721.pem (1338 bytes)
I0229 18:32:44.925721 41533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6412/.minikube/files/etc/ssl/certs/137212.pem --> /usr/share/ca-certificates/137212.pem (1708 bytes)
I0229 18:32:44.955195 41533 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6412/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0229 18:32:44.989196 41533 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0229 18:32:45.009160 41533 ssh_runner.go:195] Run: openssl version
I0229 18:32:45.016274 41533 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/13721.pem && ln -fs /usr/share/ca-certificates/13721.pem /etc/ssl/certs/13721.pem"
I0229 18:32:45.030056 41533 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/13721.pem
I0229 18:32:45.035268 41533 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Feb 29 17:48 /usr/share/ca-certificates/13721.pem
I0229 18:32:45.035327 41533 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/13721.pem
I0229 18:32:45.042007 41533 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/13721.pem /etc/ssl/certs/51391683.0"
I0229 18:32:45.054785 41533 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/137212.pem && ln -fs /usr/share/ca-certificates/137212.pem /etc/ssl/certs/137212.pem"
I0229 18:32:45.067200 41533 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/137212.pem
I0229 18:32:45.072254 41533 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Feb 29 17:48 /usr/share/ca-certificates/137212.pem
I0229 18:32:45.072309 41533 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/137212.pem
I0229 18:32:45.078944 41533 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/137212.pem /etc/ssl/certs/3ec20f2e.0"
I0229 18:32:45.091894 41533 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0229 18:32:45.109276 41533 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0229 18:32:45.115742 41533 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Feb 29 17:41 /usr/share/ca-certificates/minikubeCA.pem
I0229 18:32:45.115796 41533 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0229 18:32:45.124170 41533 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0229 18:32:45.141576 41533 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I0229 18:32:45.146892 41533 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
I0229 18:32:45.146947 41533 kubeadm.go:404] StartCluster: {Name:old-k8s-version-561577 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVe
rsion:v1.16.0 ClusterName:old-k8s-version-561577 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.39.66 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Moun
tMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0229 18:32:45.147037 41533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0229 18:32:45.147115 41533 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0229 18:32:45.203687 41533 cri.go:89] found id: ""
I0229 18:32:45.203749 41533 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0229 18:32:45.216835 41533 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0229 18:32:45.229136 41533 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0229 18:32:45.240432 41533 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0229 18:32:45.240480 41533 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0229 18:32:45.359937 41533 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0229 18:32:45.360066 41533 kubeadm.go:322] [preflight] Running pre-flight checks
I0229 18:32:45.617411 41533 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0229 18:32:45.617603 41533 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0229 18:32:45.617752 41533 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0229 18:32:45.899192 41533 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0229 18:32:45.901554 41533 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0229 18:32:45.915323 41533 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0229 18:32:46.069942 41533 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0229 18:32:46.072453 41533 out.go:204] - Generating certificates and keys ...
I0229 18:32:46.072576 41533 kubeadm.go:322] [certs] Using existing ca certificate authority
I0229 18:32:46.072698 41533 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0229 18:32:46.240117 41533 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I0229 18:32:46.356404 41533 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I0229 18:32:46.605636 41533 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I0229 18:32:46.716709 41533 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I0229 18:32:46.907844 41533 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I0229 18:32:46.908284 41533 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [old-k8s-version-561577 localhost] and IPs [192.168.39.66 127.0.0.1 ::1]
I0229 18:32:47.147521 41533 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I0229 18:32:47.147898 41533 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-561577 localhost] and IPs [192.168.39.66 127.0.0.1 ::1]
I0229 18:32:47.273591 41533 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I0229 18:32:47.338991 41533 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I0229 18:32:47.636139 41533 kubeadm.go:322] [certs] Generating "sa" key and public key
I0229 18:32:47.637176 41533 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0229 18:32:47.804096 41533 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0229 18:32:48.063778 41533 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0229 18:32:48.238381 41533 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0229 18:32:48.442695 41533 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0229 18:32:48.444324 41533 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0229 18:32:48.446516 41533 out.go:204] - Booting up control plane ...
I0229 18:32:48.446675 41533 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0229 18:32:48.456838 41533 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0229 18:32:48.458497 41533 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0229 18:32:48.459368 41533 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0229 18:32:48.462011 41533 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0229 18:33:28.458440 41533 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0229 18:33:28.458575 41533 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:33:28.458863 41533 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:33:33.458756 41533 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:33:33.459041 41533 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:33:43.458478 41533 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:33:43.458827 41533 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:34:03.459045 41533 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:34:03.459329 41533 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:34:43.461221 41533 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:34:43.461476 41533 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:34:43.461512 41533 kubeadm.go:322]
I0229 18:34:43.461575 41533 kubeadm.go:322] Unfortunately, an error has occurred:
I0229 18:34:43.461743 41533 kubeadm.go:322] timed out waiting for the condition
I0229 18:34:43.461760 41533 kubeadm.go:322]
I0229 18:34:43.461802 41533 kubeadm.go:322] This error is likely caused by:
I0229 18:34:43.461868 41533 kubeadm.go:322] - The kubelet is not running
I0229 18:34:43.462009 41533 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0229 18:34:43.462020 41533 kubeadm.go:322]
I0229 18:34:43.462152 41533 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0229 18:34:43.462196 41533 kubeadm.go:322] - 'systemctl status kubelet'
I0229 18:34:43.462253 41533 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0229 18:34:43.462261 41533 kubeadm.go:322]
I0229 18:34:43.462395 41533 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0229 18:34:43.462558 41533 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0229 18:34:43.462673 41533 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0229 18:34:43.462745 41533 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0229 18:34:43.462836 41533 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0229 18:34:43.462876 41533 kubeadm.go:322] - 'docker logs CONTAINERID'
I0229 18:34:43.464180 41533 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0229 18:34:43.464302 41533 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0229 18:34:43.464404 41533 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
W0229 18:34:43.464543 41533 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-561577 localhost] and IPs [192.168.39.66 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-561577 localhost] and IPs [192.168.39.66 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-561577 localhost] and IPs [192.168.39.66 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-561577 localhost] and IPs [192.168.39.66 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0229 18:34:43.464604 41533 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
I0229 18:34:43.941001 41533 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0229 18:34:43.956091 41533 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0229 18:34:43.966793 41533 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0229 18:34:43.966840 41533 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0229 18:34:44.027760 41533 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0229 18:34:44.027837 41533 kubeadm.go:322] [preflight] Running pre-flight checks
I0229 18:34:44.169758 41533 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0229 18:34:44.169916 41533 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0229 18:34:44.170051 41533 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0229 18:34:44.378519 41533 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0229 18:34:44.379512 41533 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0229 18:34:44.387865 41533 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0229 18:34:44.512904 41533 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0229 18:34:44.514771 41533 out.go:204] - Generating certificates and keys ...
I0229 18:34:44.514895 41533 kubeadm.go:322] [certs] Using existing ca certificate authority
I0229 18:34:44.519321 41533 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0229 18:34:44.519522 41533 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0229 18:34:44.519695 41533 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority
I0229 18:34:44.519877 41533 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk
I0229 18:34:44.520001 41533 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority
I0229 18:34:44.520185 41533 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk
I0229 18:34:44.520350 41533 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk
I0229 18:34:44.520564 41533 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0229 18:34:44.520766 41533 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0229 18:34:44.520863 41533 kubeadm.go:322] [certs] Using the existing "sa" key
I0229 18:34:44.521001 41533 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0229 18:34:44.848909 41533 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0229 18:34:44.981812 41533 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0229 18:34:45.229575 41533 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0229 18:34:45.404582 41533 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0229 18:34:45.405539 41533 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0229 18:34:45.409097 41533 out.go:204] - Booting up control plane ...
I0229 18:34:45.409218 41533 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0229 18:34:45.413929 41533 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0229 18:34:45.414979 41533 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0229 18:34:45.415845 41533 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0229 18:34:45.418702 41533 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0229 18:35:25.421804 41533 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0229 18:35:25.422481 41533 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:35:25.422733 41533 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:35:30.423665 41533 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:35:30.423915 41533 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:35:40.424299 41533 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:35:40.424522 41533 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:36:00.424143 41533 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:36:00.424391 41533 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:36:40.424351 41533 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:36:40.424578 41533 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:36:40.424599 41533 kubeadm.go:322]
I0229 18:36:40.424651 41533 kubeadm.go:322] Unfortunately, an error has occurred:
I0229 18:36:40.424699 41533 kubeadm.go:322] timed out waiting for the condition
I0229 18:36:40.424708 41533 kubeadm.go:322]
I0229 18:36:40.424756 41533 kubeadm.go:322] This error is likely caused by:
I0229 18:36:40.424790 41533 kubeadm.go:322] - The kubelet is not running
I0229 18:36:40.424950 41533 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0229 18:36:40.424967 41533 kubeadm.go:322]
I0229 18:36:40.425115 41533 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0229 18:36:40.425166 41533 kubeadm.go:322] - 'systemctl status kubelet'
I0229 18:36:40.425205 41533 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0229 18:36:40.425216 41533 kubeadm.go:322]
I0229 18:36:40.425357 41533 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0229 18:36:40.425467 41533 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0229 18:36:40.425583 41533 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0229 18:36:40.425654 41533 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0229 18:36:40.425765 41533 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0229 18:36:40.425813 41533 kubeadm.go:322] - 'docker logs CONTAINERID'
I0229 18:36:40.426648 41533 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0229 18:36:40.426768 41533 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0229 18:36:40.426891 41533 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
I0229 18:36:40.426946 41533 kubeadm.go:406] StartCluster complete in 3m55.2800036s
I0229 18:36:40.426993 41533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0229 18:36:40.427055 41533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0229 18:36:40.477588 41533 cri.go:89] found id: ""
I0229 18:36:40.477611 41533 logs.go:276] 0 containers: []
W0229 18:36:40.477624 41533 logs.go:278] No container was found matching "kube-apiserver"
I0229 18:36:40.477629 41533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0229 18:36:40.477681 41533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0229 18:36:40.515615 41533 cri.go:89] found id: ""
I0229 18:36:40.515638 41533 logs.go:276] 0 containers: []
W0229 18:36:40.515653 41533 logs.go:278] No container was found matching "etcd"
I0229 18:36:40.515661 41533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0229 18:36:40.515739 41533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0229 18:36:40.561137 41533 cri.go:89] found id: ""
I0229 18:36:40.561171 41533 logs.go:276] 0 containers: []
W0229 18:36:40.561182 41533 logs.go:278] No container was found matching "coredns"
I0229 18:36:40.561193 41533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0229 18:36:40.561249 41533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0229 18:36:40.608424 41533 cri.go:89] found id: ""
I0229 18:36:40.608452 41533 logs.go:276] 0 containers: []
W0229 18:36:40.608461 41533 logs.go:278] No container was found matching "kube-scheduler"
I0229 18:36:40.608467 41533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0229 18:36:40.608517 41533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0229 18:36:40.664528 41533 cri.go:89] found id: ""
I0229 18:36:40.664557 41533 logs.go:276] 0 containers: []
W0229 18:36:40.664568 41533 logs.go:278] No container was found matching "kube-proxy"
I0229 18:36:40.664576 41533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0229 18:36:40.664630 41533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0229 18:36:40.707656 41533 cri.go:89] found id: ""
I0229 18:36:40.707684 41533 logs.go:276] 0 containers: []
W0229 18:36:40.707696 41533 logs.go:278] No container was found matching "kube-controller-manager"
I0229 18:36:40.707706 41533 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0229 18:36:40.707777 41533 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0229 18:36:40.745670 41533 cri.go:89] found id: ""
I0229 18:36:40.745700 41533 logs.go:276] 0 containers: []
W0229 18:36:40.745711 41533 logs.go:278] No container was found matching "kindnet"
I0229 18:36:40.745724 41533 logs.go:123] Gathering logs for containerd ...
I0229 18:36:40.745737 41533 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0229 18:36:40.779255 41533 logs.go:123] Gathering logs for container status ...
I0229 18:36:40.779284 41533 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0229 18:36:40.825429 41533 logs.go:123] Gathering logs for kubelet ...
I0229 18:36:40.825457 41533 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0229 18:36:40.873415 41533 logs.go:123] Gathering logs for dmesg ...
I0229 18:36:40.873452 41533 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0229 18:36:40.890876 41533 logs.go:123] Gathering logs for describe nodes ...
I0229 18:36:40.890902 41533 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0229 18:36:41.022194 41533 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
W0229 18:36:41.022233 41533 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 18:36:41.022276 41533 out.go:239] *
*
W0229 18:36:41.022335 41533 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 18:36:41.022361 41533 out.go:239] *
*
W0229 18:36:41.023506 41533 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0229 18:36:41.026891 41533 out.go:177]
W0229 18:36:41.028113 41533 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 18:36:41.028153 41533 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0229 18:36:41.028170 41533 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0229 18:36:41.029630 41533 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-561577 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=containerd --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-561577 -n old-k8s-version-561577
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-561577 -n old-k8s-version-561577: exit status 6 (252.889664ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0229 18:36:41.309587 44148 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-561577" does not appear in /home/jenkins/minikube-integration/18259-6412/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-561577" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (303.00s)