=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-275488 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.16.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-275488 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.16.0: exit status 109 (4m52.970349562s)
-- stdout --
* [old-k8s-version-275488] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18063
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18063-316644/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18063-316644/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting control plane node old-k8s-version-275488 in cluster old-k8s-version-275488
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.16.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0229 02:20:07.906055 363058 out.go:291] Setting OutFile to fd 1 ...
I0229 02:20:07.906343 363058 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0229 02:20:07.906357 363058 out.go:304] Setting ErrFile to fd 2...
I0229 02:20:07.906365 363058 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0229 02:20:07.906658 363058 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18063-316644/.minikube/bin
I0229 02:20:07.907393 363058 out.go:298] Setting JSON to false
I0229 02:20:07.908721 363058 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":7351,"bootTime":1709165857,"procs":302,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0229 02:20:07.908823 363058 start.go:139] virtualization: kvm guest
I0229 02:20:07.910817 363058 out.go:177] * [old-k8s-version-275488] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0229 02:20:07.912605 363058 out.go:177] - MINIKUBE_LOCATION=18063
I0229 02:20:07.912674 363058 notify.go:220] Checking for updates...
I0229 02:20:07.914202 363058 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0229 02:20:07.915841 363058 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18063-316644/kubeconfig
I0229 02:20:07.917230 363058 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18063-316644/.minikube
I0229 02:20:07.918644 363058 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0229 02:20:07.919911 363058 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0229 02:20:07.921525 363058 config.go:182] Loaded profile config "bridge-117441": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0229 02:20:07.921700 363058 config.go:182] Loaded profile config "enable-default-cni-117441": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0229 02:20:07.921839 363058 config.go:182] Loaded profile config "flannel-117441": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0229 02:20:07.921972 363058 driver.go:392] Setting default libvirt URI to qemu:///system
I0229 02:20:07.966378 363058 out.go:177] * Using the kvm2 driver based on user configuration
I0229 02:20:07.967780 363058 start.go:299] selected driver: kvm2
I0229 02:20:07.967801 363058 start.go:903] validating driver "kvm2" against <nil>
I0229 02:20:07.967817 363058 start.go:914] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0229 02:20:07.968957 363058 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0229 02:20:07.969055 363058 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18063-316644/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0229 02:20:07.986467 363058 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0229 02:20:07.986523 363058 start_flags.go:309] no existing cluster config was found, will generate one from the flags
I0229 02:20:07.986803 363058 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0229 02:20:07.986938 363058 cni.go:84] Creating CNI manager for ""
I0229 02:20:07.986952 363058 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0229 02:20:07.986965 363058 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0229 02:20:07.986972 363058 start_flags.go:323] config:
{Name:old-k8s-version-275488 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-275488 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR
untime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0229 02:20:07.987158 363058 iso.go:125] acquiring lock: {Name:mk974d80da9153d6536889d8696366d0e5af7a8f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0229 02:20:07.988992 363058 out.go:177] * Starting control plane node old-k8s-version-275488 in cluster old-k8s-version-275488
I0229 02:20:07.990348 363058 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
I0229 02:20:07.990394 363058 preload.go:148] Found local preload: /home/jenkins/minikube-integration/18063-316644/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4
I0229 02:20:07.990408 363058 cache.go:56] Caching tarball of preloaded images
I0229 02:20:07.990496 363058 preload.go:174] Found /home/jenkins/minikube-integration/18063-316644/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0229 02:20:07.990512 363058 cache.go:59] Finished verifying existence of preloaded tar for v1.16.0 on crio
I0229 02:20:07.990618 363058 profile.go:148] Saving config to /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/config.json ...
I0229 02:20:07.990640 363058 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/config.json: {Name:mkc0cc21b63f0140c2cc6dc19b218f02752c0283 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 02:20:07.990764 363058 start.go:365] acquiring machines lock for old-k8s-version-275488: {Name:mk054f668739379f9a67a6c82b7639150486ee84 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0229 02:20:22.017212 363058 start.go:369] acquired machines lock for "old-k8s-version-275488" in 14.026416242s
I0229 02:20:22.017301 363058 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-275488 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-275488 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0229 02:20:22.017454 363058 start.go:125] createHost starting for "" (driver="kvm2")
I0229 02:20:22.019241 363058 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0229 02:20:22.019484 363058 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0229 02:20:22.019525 363058 main.go:141] libmachine: Launching plugin server for driver kvm2
I0229 02:20:22.037171 363058 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43007
I0229 02:20:22.037595 363058 main.go:141] libmachine: () Calling .GetVersion
I0229 02:20:22.038281 363058 main.go:141] libmachine: Using API Version 1
I0229 02:20:22.038310 363058 main.go:141] libmachine: () Calling .SetConfigRaw
I0229 02:20:22.038727 363058 main.go:141] libmachine: () Calling .GetMachineName
I0229 02:20:22.038981 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetMachineName
I0229 02:20:22.039163 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .DriverName
I0229 02:20:22.039457 363058 start.go:159] libmachine.API.Create for "old-k8s-version-275488" (driver="kvm2")
I0229 02:20:22.039497 363058 client.go:168] LocalClient.Create starting
I0229 02:20:22.039533 363058 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18063-316644/.minikube/certs/ca.pem
I0229 02:20:22.039571 363058 main.go:141] libmachine: Decoding PEM data...
I0229 02:20:22.039591 363058 main.go:141] libmachine: Parsing certificate...
I0229 02:20:22.039708 363058 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18063-316644/.minikube/certs/cert.pem
I0229 02:20:22.039741 363058 main.go:141] libmachine: Decoding PEM data...
I0229 02:20:22.039760 363058 main.go:141] libmachine: Parsing certificate...
I0229 02:20:22.039788 363058 main.go:141] libmachine: Running pre-create checks...
I0229 02:20:22.039801 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .PreCreateCheck
I0229 02:20:22.040200 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetConfigRaw
I0229 02:20:22.040667 363058 main.go:141] libmachine: Creating machine...
I0229 02:20:22.040684 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .Create
I0229 02:20:22.040848 363058 main.go:141] libmachine: (old-k8s-version-275488) Creating KVM machine...
I0229 02:20:22.041971 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found existing default KVM network
I0229 02:20:22.043929 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:22.043764 363213 network.go:207] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002720d0}
I0229 02:20:22.049227 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | trying to create private KVM network mk-old-k8s-version-275488 192.168.39.0/24...
I0229 02:20:22.125556 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | private KVM network mk-old-k8s-version-275488 192.168.39.0/24 created
I0229 02:20:22.125621 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:22.125447 363213 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18063-316644/.minikube
I0229 02:20:22.125646 363058 main.go:141] libmachine: (old-k8s-version-275488) Setting up store path in /home/jenkins/minikube-integration/18063-316644/.minikube/machines/old-k8s-version-275488 ...
I0229 02:20:22.125669 363058 main.go:141] libmachine: (old-k8s-version-275488) Building disk image from file:///home/jenkins/minikube-integration/18063-316644/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso
I0229 02:20:22.125692 363058 main.go:141] libmachine: (old-k8s-version-275488) Downloading /home/jenkins/minikube-integration/18063-316644/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18063-316644/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
I0229 02:20:22.415955 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:22.415789 363213 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18063-316644/.minikube/machines/old-k8s-version-275488/id_rsa...
I0229 02:20:22.827675 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:22.827555 363213 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18063-316644/.minikube/machines/old-k8s-version-275488/old-k8s-version-275488.rawdisk...
I0229 02:20:22.827714 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | Writing magic tar header
I0229 02:20:22.827737 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | Writing SSH key tar header
I0229 02:20:22.827755 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:22.827708 363213 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18063-316644/.minikube/machines/old-k8s-version-275488 ...
I0229 02:20:22.827821 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18063-316644/.minikube/machines/old-k8s-version-275488
I0229 02:20:22.827888 363058 main.go:141] libmachine: (old-k8s-version-275488) Setting executable bit set on /home/jenkins/minikube-integration/18063-316644/.minikube/machines/old-k8s-version-275488 (perms=drwx------)
I0229 02:20:22.827913 363058 main.go:141] libmachine: (old-k8s-version-275488) Setting executable bit set on /home/jenkins/minikube-integration/18063-316644/.minikube/machines (perms=drwxr-xr-x)
I0229 02:20:22.827929 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18063-316644/.minikube/machines
I0229 02:20:22.827941 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18063-316644/.minikube
I0229 02:20:22.827951 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18063-316644
I0229 02:20:22.827965 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0229 02:20:22.827975 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | Checking permissions on dir: /home/jenkins
I0229 02:20:22.827989 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | Checking permissions on dir: /home
I0229 02:20:22.827998 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | Skipping /home - not owner
I0229 02:20:22.828011 363058 main.go:141] libmachine: (old-k8s-version-275488) Setting executable bit set on /home/jenkins/minikube-integration/18063-316644/.minikube (perms=drwxr-xr-x)
I0229 02:20:22.828031 363058 main.go:141] libmachine: (old-k8s-version-275488) Setting executable bit set on /home/jenkins/minikube-integration/18063-316644 (perms=drwxrwxr-x)
I0229 02:20:22.828045 363058 main.go:141] libmachine: (old-k8s-version-275488) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0229 02:20:22.828059 363058 main.go:141] libmachine: (old-k8s-version-275488) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0229 02:20:22.828071 363058 main.go:141] libmachine: (old-k8s-version-275488) Creating domain...
I0229 02:20:22.829253 363058 main.go:141] libmachine: (old-k8s-version-275488) define libvirt domain using xml:
I0229 02:20:22.829282 363058 main.go:141] libmachine: (old-k8s-version-275488) <domain type='kvm'>
I0229 02:20:22.829305 363058 main.go:141] libmachine: (old-k8s-version-275488) <name>old-k8s-version-275488</name>
I0229 02:20:22.829321 363058 main.go:141] libmachine: (old-k8s-version-275488) <memory unit='MiB'>2200</memory>
I0229 02:20:22.829339 363058 main.go:141] libmachine: (old-k8s-version-275488) <vcpu>2</vcpu>
I0229 02:20:22.829354 363058 main.go:141] libmachine: (old-k8s-version-275488) <features>
I0229 02:20:22.829364 363058 main.go:141] libmachine: (old-k8s-version-275488) <acpi/>
I0229 02:20:22.829371 363058 main.go:141] libmachine: (old-k8s-version-275488) <apic/>
I0229 02:20:22.829388 363058 main.go:141] libmachine: (old-k8s-version-275488) <pae/>
I0229 02:20:22.829402 363058 main.go:141] libmachine: (old-k8s-version-275488)
I0229 02:20:22.829411 363058 main.go:141] libmachine: (old-k8s-version-275488) </features>
I0229 02:20:22.829428 363058 main.go:141] libmachine: (old-k8s-version-275488) <cpu mode='host-passthrough'>
I0229 02:20:22.829436 363058 main.go:141] libmachine: (old-k8s-version-275488)
I0229 02:20:22.829443 363058 main.go:141] libmachine: (old-k8s-version-275488) </cpu>
I0229 02:20:22.829451 363058 main.go:141] libmachine: (old-k8s-version-275488) <os>
I0229 02:20:22.829458 363058 main.go:141] libmachine: (old-k8s-version-275488) <type>hvm</type>
I0229 02:20:22.829467 363058 main.go:141] libmachine: (old-k8s-version-275488) <boot dev='cdrom'/>
I0229 02:20:22.829474 363058 main.go:141] libmachine: (old-k8s-version-275488) <boot dev='hd'/>
I0229 02:20:22.829481 363058 main.go:141] libmachine: (old-k8s-version-275488) <bootmenu enable='no'/>
I0229 02:20:22.829487 363058 main.go:141] libmachine: (old-k8s-version-275488) </os>
I0229 02:20:22.829494 363058 main.go:141] libmachine: (old-k8s-version-275488) <devices>
I0229 02:20:22.829506 363058 main.go:141] libmachine: (old-k8s-version-275488) <disk type='file' device='cdrom'>
I0229 02:20:22.829537 363058 main.go:141] libmachine: (old-k8s-version-275488) <source file='/home/jenkins/minikube-integration/18063-316644/.minikube/machines/old-k8s-version-275488/boot2docker.iso'/>
I0229 02:20:22.829545 363058 main.go:141] libmachine: (old-k8s-version-275488) <target dev='hdc' bus='scsi'/>
I0229 02:20:22.829554 363058 main.go:141] libmachine: (old-k8s-version-275488) <readonly/>
I0229 02:20:22.829561 363058 main.go:141] libmachine: (old-k8s-version-275488) </disk>
I0229 02:20:22.829571 363058 main.go:141] libmachine: (old-k8s-version-275488) <disk type='file' device='disk'>
I0229 02:20:22.829585 363058 main.go:141] libmachine: (old-k8s-version-275488) <driver name='qemu' type='raw' cache='default' io='threads' />
I0229 02:20:22.829602 363058 main.go:141] libmachine: (old-k8s-version-275488) <source file='/home/jenkins/minikube-integration/18063-316644/.minikube/machines/old-k8s-version-275488/old-k8s-version-275488.rawdisk'/>
I0229 02:20:22.829610 363058 main.go:141] libmachine: (old-k8s-version-275488) <target dev='hda' bus='virtio'/>
I0229 02:20:22.829615 363058 main.go:141] libmachine: (old-k8s-version-275488) </disk>
I0229 02:20:22.829620 363058 main.go:141] libmachine: (old-k8s-version-275488) <interface type='network'>
I0229 02:20:22.829626 363058 main.go:141] libmachine: (old-k8s-version-275488) <source network='mk-old-k8s-version-275488'/>
I0229 02:20:22.829630 363058 main.go:141] libmachine: (old-k8s-version-275488) <model type='virtio'/>
I0229 02:20:22.829635 363058 main.go:141] libmachine: (old-k8s-version-275488) </interface>
I0229 02:20:22.829640 363058 main.go:141] libmachine: (old-k8s-version-275488) <interface type='network'>
I0229 02:20:22.829645 363058 main.go:141] libmachine: (old-k8s-version-275488) <source network='default'/>
I0229 02:20:22.829649 363058 main.go:141] libmachine: (old-k8s-version-275488) <model type='virtio'/>
I0229 02:20:22.829725 363058 main.go:141] libmachine: (old-k8s-version-275488) </interface>
I0229 02:20:22.829749 363058 main.go:141] libmachine: (old-k8s-version-275488) <serial type='pty'>
I0229 02:20:22.829761 363058 main.go:141] libmachine: (old-k8s-version-275488) <target port='0'/>
I0229 02:20:22.829769 363058 main.go:141] libmachine: (old-k8s-version-275488) </serial>
I0229 02:20:22.829777 363058 main.go:141] libmachine: (old-k8s-version-275488) <console type='pty'>
I0229 02:20:22.829786 363058 main.go:141] libmachine: (old-k8s-version-275488) <target type='serial' port='0'/>
I0229 02:20:22.829794 363058 main.go:141] libmachine: (old-k8s-version-275488) </console>
I0229 02:20:22.829801 363058 main.go:141] libmachine: (old-k8s-version-275488) <rng model='virtio'>
I0229 02:20:22.829811 363058 main.go:141] libmachine: (old-k8s-version-275488) <backend model='random'>/dev/random</backend>
I0229 02:20:22.829822 363058 main.go:141] libmachine: (old-k8s-version-275488) </rng>
I0229 02:20:22.829831 363058 main.go:141] libmachine: (old-k8s-version-275488)
I0229 02:20:22.829837 363058 main.go:141] libmachine: (old-k8s-version-275488)
I0229 02:20:22.829845 363058 main.go:141] libmachine: (old-k8s-version-275488) </devices>
I0229 02:20:22.829852 363058 main.go:141] libmachine: (old-k8s-version-275488) </domain>
I0229 02:20:22.829863 363058 main.go:141] libmachine: (old-k8s-version-275488)
I0229 02:20:22.834599 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:c7:39:27 in network default
I0229 02:20:22.835423 363058 main.go:141] libmachine: (old-k8s-version-275488) Ensuring networks are active...
I0229 02:20:22.835454 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:22.836315 363058 main.go:141] libmachine: (old-k8s-version-275488) Ensuring network default is active
I0229 02:20:22.836667 363058 main.go:141] libmachine: (old-k8s-version-275488) Ensuring network mk-old-k8s-version-275488 is active
I0229 02:20:22.837550 363058 main.go:141] libmachine: (old-k8s-version-275488) Getting domain xml...
I0229 02:20:22.838671 363058 main.go:141] libmachine: (old-k8s-version-275488) Creating domain...
I0229 02:20:24.452123 363058 main.go:141] libmachine: (old-k8s-version-275488) Waiting to get IP...
I0229 02:20:24.453154 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:24.454005 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | unable to find current IP address of domain old-k8s-version-275488 in network mk-old-k8s-version-275488
I0229 02:20:24.454040 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:24.453998 363213 retry.go:31] will retry after 198.557883ms: waiting for machine to come up
I0229 02:20:24.654661 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:24.655621 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | unable to find current IP address of domain old-k8s-version-275488 in network mk-old-k8s-version-275488
I0229 02:20:24.655643 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:24.655572 363213 retry.go:31] will retry after 261.325972ms: waiting for machine to come up
I0229 02:20:24.918586 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:24.919154 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | unable to find current IP address of domain old-k8s-version-275488 in network mk-old-k8s-version-275488
I0229 02:20:24.919178 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:24.919089 363213 retry.go:31] will retry after 481.432058ms: waiting for machine to come up
I0229 02:20:25.401952 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:25.402734 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | unable to find current IP address of domain old-k8s-version-275488 in network mk-old-k8s-version-275488
I0229 02:20:25.402767 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:25.402675 363213 retry.go:31] will retry after 408.529073ms: waiting for machine to come up
I0229 02:20:25.813536 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:25.814083 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | unable to find current IP address of domain old-k8s-version-275488 in network mk-old-k8s-version-275488
I0229 02:20:25.814112 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:25.814020 363213 retry.go:31] will retry after 721.315372ms: waiting for machine to come up
I0229 02:20:26.537580 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:26.538173 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | unable to find current IP address of domain old-k8s-version-275488 in network mk-old-k8s-version-275488
I0229 02:20:26.538199 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:26.538077 363213 retry.go:31] will retry after 876.02338ms: waiting for machine to come up
I0229 02:20:27.415529 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:27.416168 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | unable to find current IP address of domain old-k8s-version-275488 in network mk-old-k8s-version-275488
I0229 02:20:27.416195 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:27.416125 363213 retry.go:31] will retry after 980.922336ms: waiting for machine to come up
I0229 02:20:28.398518 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:28.399062 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | unable to find current IP address of domain old-k8s-version-275488 in network mk-old-k8s-version-275488
I0229 02:20:28.399092 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:28.398991 363213 retry.go:31] will retry after 1.082024041s: waiting for machine to come up
I0229 02:20:29.482747 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:29.483531 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | unable to find current IP address of domain old-k8s-version-275488 in network mk-old-k8s-version-275488
I0229 02:20:29.483562 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:29.483480 363213 retry.go:31] will retry after 1.13907019s: waiting for machine to come up
I0229 02:20:30.624186 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:30.624753 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | unable to find current IP address of domain old-k8s-version-275488 in network mk-old-k8s-version-275488
I0229 02:20:30.624780 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:30.624676 363213 retry.go:31] will retry after 2.149650932s: waiting for machine to come up
I0229 02:20:32.776033 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:32.776562 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | unable to find current IP address of domain old-k8s-version-275488 in network mk-old-k8s-version-275488
I0229 02:20:32.776589 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:32.776517 363213 retry.go:31] will retry after 2.325818907s: waiting for machine to come up
I0229 02:20:35.104606 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:35.105227 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | unable to find current IP address of domain old-k8s-version-275488 in network mk-old-k8s-version-275488
I0229 02:20:35.105264 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:35.105174 363213 retry.go:31] will retry after 2.340619097s: waiting for machine to come up
I0229 02:20:37.447905 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:37.448473 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | unable to find current IP address of domain old-k8s-version-275488 in network mk-old-k8s-version-275488
I0229 02:20:37.448501 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:37.448411 363213 retry.go:31] will retry after 4.042567195s: waiting for machine to come up
I0229 02:20:41.495474 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:41.496087 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | unable to find current IP address of domain old-k8s-version-275488 in network mk-old-k8s-version-275488
I0229 02:20:41.496116 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:41.496030 363213 retry.go:31] will retry after 3.786356857s: waiting for machine to come up
I0229 02:20:45.284896 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:45.285495 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | unable to find current IP address of domain old-k8s-version-275488 in network mk-old-k8s-version-275488
I0229 02:20:45.285532 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | I0229 02:20:45.285468 363213 retry.go:31] will retry after 6.931043433s: waiting for machine to come up
I0229 02:20:52.218153 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:52.218928 363058 main.go:141] libmachine: (old-k8s-version-275488) Found IP for machine: 192.168.39.160
I0229 02:20:52.218983 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has current primary IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:52.218998 363058 main.go:141] libmachine: (old-k8s-version-275488) Reserving static IP address...
I0229 02:20:52.219337 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-275488", mac: "52:54:00:6c:fc:74", ip: "192.168.39.160"} in network mk-old-k8s-version-275488
I0229 02:20:52.342073 363058 main.go:141] libmachine: (old-k8s-version-275488) Reserved static IP address: 192.168.39.160
I0229 02:20:52.342106 363058 main.go:141] libmachine: (old-k8s-version-275488) Waiting for SSH to be available...
I0229 02:20:52.342117 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | Getting to WaitForSSH function...
I0229 02:20:52.345596 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:52.346193 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:minikube Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:52.346246 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:52.346642 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | Using SSH client type: external
I0229 02:20:52.346671 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | Using SSH private key: /home/jenkins/minikube-integration/18063-316644/.minikube/machines/old-k8s-version-275488/id_rsa (-rw-------)
I0229 02:20:52.346704 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.160 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18063-316644/.minikube/machines/old-k8s-version-275488/id_rsa -p 22] /usr/bin/ssh <nil>}
I0229 02:20:52.346724 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | About to run SSH command:
I0229 02:20:52.346771 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | exit 0
I0229 02:20:52.474829 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | SSH cmd err, output: <nil>:
I0229 02:20:52.475149 363058 main.go:141] libmachine: (old-k8s-version-275488) KVM machine creation complete!
I0229 02:20:52.475484 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetConfigRaw
I0229 02:20:52.492297 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .DriverName
I0229 02:20:52.492609 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .DriverName
I0229 02:20:52.492841 363058 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0229 02:20:52.492864 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetState
I0229 02:20:52.494282 363058 main.go:141] libmachine: Detecting operating system of created instance...
I0229 02:20:52.494299 363058 main.go:141] libmachine: Waiting for SSH to be available...
I0229 02:20:52.494305 363058 main.go:141] libmachine: Getting to WaitForSSH function...
I0229 02:20:52.494312 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHHostname
I0229 02:20:52.497024 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:52.497401 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:minikube Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:52.497433 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:52.497619 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHPort
I0229 02:20:52.497796 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHKeyPath
I0229 02:20:52.497999 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHKeyPath
I0229 02:20:52.498181 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHUsername
I0229 02:20:52.498512 363058 main.go:141] libmachine: Using SSH client type: native
I0229 02:20:52.498780 363058 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.160 22 <nil> <nil>}
I0229 02:20:52.498799 363058 main.go:141] libmachine: About to run SSH command:
exit 0
I0229 02:20:52.610508 363058 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0229 02:20:52.610544 363058 main.go:141] libmachine: Detecting the provisioner...
I0229 02:20:52.610558 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHHostname
I0229 02:20:52.613610 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:52.614734 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:old-k8s-version-275488 Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:52.614763 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:52.615002 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHPort
I0229 02:20:52.615225 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHKeyPath
I0229 02:20:52.615423 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHKeyPath
I0229 02:20:52.615591 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHUsername
I0229 02:20:52.615780 363058 main.go:141] libmachine: Using SSH client type: native
I0229 02:20:52.616017 363058 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.160 22 <nil> <nil>}
I0229 02:20:52.616032 363058 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0229 02:20:52.727986 363058 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0229 02:20:52.728103 363058 main.go:141] libmachine: found compatible host: buildroot
I0229 02:20:52.728121 363058 main.go:141] libmachine: Provisioning with buildroot...
I0229 02:20:52.728133 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetMachineName
I0229 02:20:52.728425 363058 buildroot.go:166] provisioning hostname "old-k8s-version-275488"
I0229 02:20:52.728461 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetMachineName
I0229 02:20:52.728688 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHHostname
I0229 02:20:52.731757 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:52.732122 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:old-k8s-version-275488 Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:52.732155 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:52.732400 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHPort
I0229 02:20:52.732630 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHKeyPath
I0229 02:20:52.732784 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHKeyPath
I0229 02:20:52.732948 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHUsername
I0229 02:20:52.733143 363058 main.go:141] libmachine: Using SSH client type: native
I0229 02:20:52.733365 363058 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.160 22 <nil> <nil>}
I0229 02:20:52.733384 363058 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-275488 && echo "old-k8s-version-275488" | sudo tee /etc/hostname
I0229 02:20:52.873534 363058 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-275488
I0229 02:20:52.873569 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHHostname
I0229 02:20:52.876827 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:52.877282 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:old-k8s-version-275488 Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:52.877309 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:52.877473 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHPort
I0229 02:20:52.877702 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHKeyPath
I0229 02:20:52.877921 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHKeyPath
I0229 02:20:52.878136 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHUsername
I0229 02:20:52.878340 363058 main.go:141] libmachine: Using SSH client type: native
I0229 02:20:52.878574 363058 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.160 22 <nil> <nil>}
I0229 02:20:52.878599 363058 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-275488' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-275488/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-275488' | sudo tee -a /etc/hosts;
fi
fi
I0229 02:20:53.010154 363058 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0229 02:20:53.010187 363058 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18063-316644/.minikube CaCertPath:/home/jenkins/minikube-integration/18063-316644/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18063-316644/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18063-316644/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18063-316644/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18063-316644/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18063-316644/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18063-316644/.minikube}
I0229 02:20:53.010215 363058 buildroot.go:174] setting up certificates
I0229 02:20:53.010246 363058 provision.go:83] configureAuth start
I0229 02:20:53.010261 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetMachineName
I0229 02:20:53.010619 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetIP
I0229 02:20:53.013826 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:53.014332 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:old-k8s-version-275488 Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:53.014363 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:53.014557 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHHostname
I0229 02:20:53.016766 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:53.017063 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:old-k8s-version-275488 Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:53.017105 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:53.017206 363058 provision.go:138] copyHostCerts
I0229 02:20:53.017278 363058 exec_runner.go:144] found /home/jenkins/minikube-integration/18063-316644/.minikube/ca.pem, removing ...
I0229 02:20:53.017303 363058 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18063-316644/.minikube/ca.pem
I0229 02:20:53.017413 363058 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18063-316644/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18063-316644/.minikube/ca.pem (1082 bytes)
I0229 02:20:53.017621 363058 exec_runner.go:144] found /home/jenkins/minikube-integration/18063-316644/.minikube/cert.pem, removing ...
I0229 02:20:53.017639 363058 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18063-316644/.minikube/cert.pem
I0229 02:20:53.017692 363058 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18063-316644/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18063-316644/.minikube/cert.pem (1123 bytes)
I0229 02:20:53.017853 363058 exec_runner.go:144] found /home/jenkins/minikube-integration/18063-316644/.minikube/key.pem, removing ...
I0229 02:20:53.017869 363058 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18063-316644/.minikube/key.pem
I0229 02:20:53.017916 363058 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18063-316644/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18063-316644/.minikube/key.pem (1675 bytes)
I0229 02:20:53.018019 363058 provision.go:112] generating server cert: /home/jenkins/minikube-integration/18063-316644/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18063-316644/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18063-316644/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-275488 san=[192.168.39.160 192.168.39.160 localhost 127.0.0.1 minikube old-k8s-version-275488]
I0229 02:20:53.249139 363058 provision.go:172] copyRemoteCerts
I0229 02:20:53.249197 363058 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0229 02:20:53.249224 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHHostname
I0229 02:20:53.252409 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:53.252822 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:old-k8s-version-275488 Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:53.252870 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:53.253072 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHPort
I0229 02:20:53.253294 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHKeyPath
I0229 02:20:53.253489 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHUsername
I0229 02:20:53.253719 363058 sshutil.go:53] new ssh client: &{IP:192.168.39.160 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18063-316644/.minikube/machines/old-k8s-version-275488/id_rsa Username:docker}
I0229 02:20:53.351449 363058 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-316644/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0229 02:20:53.383424 363058 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-316644/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I0229 02:20:53.418852 363058 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-316644/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0229 02:20:53.447850 363058 provision.go:86] duration metric: configureAuth took 437.587663ms
I0229 02:20:53.447886 363058 buildroot.go:189] setting minikube options for container-runtime
I0229 02:20:53.448119 363058 config.go:182] Loaded profile config "old-k8s-version-275488": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0229 02:20:53.448223 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHHostname
I0229 02:20:53.450925 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:53.451304 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:old-k8s-version-275488 Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:53.451339 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:53.451495 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHPort
I0229 02:20:53.451709 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHKeyPath
I0229 02:20:53.451892 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHKeyPath
I0229 02:20:53.452041 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHUsername
I0229 02:20:53.452199 363058 main.go:141] libmachine: Using SSH client type: native
I0229 02:20:53.452409 363058 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.160 22 <nil> <nil>}
I0229 02:20:53.452433 363058 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0229 02:20:53.775733 363058 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0229 02:20:53.775770 363058 main.go:141] libmachine: Checking connection to Docker...
I0229 02:20:53.775781 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetURL
I0229 02:20:53.777156 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | Using libvirt version 6000000
I0229 02:20:53.779353 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:53.779694 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:old-k8s-version-275488 Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:53.779728 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:53.779928 363058 main.go:141] libmachine: Docker is up and running!
I0229 02:20:53.779945 363058 main.go:141] libmachine: Reticulating splines...
I0229 02:20:53.779953 363058 client.go:171] LocalClient.Create took 31.740444271s
I0229 02:20:53.779981 363058 start.go:167] duration metric: libmachine.API.Create for "old-k8s-version-275488" took 31.740525216s
I0229 02:20:53.779995 363058 start.go:300] post-start starting for "old-k8s-version-275488" (driver="kvm2")
I0229 02:20:53.780008 363058 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0229 02:20:53.780028 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .DriverName
I0229 02:20:53.780286 363058 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0229 02:20:53.780314 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHHostname
I0229 02:20:53.782569 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:53.782926 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:old-k8s-version-275488 Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:53.782963 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:53.783045 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHPort
I0229 02:20:53.783238 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHKeyPath
I0229 02:20:53.783407 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHUsername
I0229 02:20:53.783553 363058 sshutil.go:53] new ssh client: &{IP:192.168.39.160 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18063-316644/.minikube/machines/old-k8s-version-275488/id_rsa Username:docker}
I0229 02:20:53.875337 363058 ssh_runner.go:195] Run: cat /etc/os-release
I0229 02:20:53.881906 363058 info.go:137] Remote host: Buildroot 2023.02.9
I0229 02:20:53.881936 363058 filesync.go:126] Scanning /home/jenkins/minikube-integration/18063-316644/.minikube/addons for local assets ...
I0229 02:20:53.882010 363058 filesync.go:126] Scanning /home/jenkins/minikube-integration/18063-316644/.minikube/files for local assets ...
I0229 02:20:53.882131 363058 filesync.go:149] local asset: /home/jenkins/minikube-integration/18063-316644/.minikube/files/etc/ssl/certs/3238852.pem -> 3238852.pem in /etc/ssl/certs
I0229 02:20:53.882300 363058 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0229 02:20:53.898364 363058 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-316644/.minikube/files/etc/ssl/certs/3238852.pem --> /etc/ssl/certs/3238852.pem (1708 bytes)
I0229 02:20:53.936047 363058 start.go:303] post-start completed in 156.034847ms
I0229 02:20:53.936105 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetConfigRaw
I0229 02:20:53.936788 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetIP
I0229 02:20:53.940551 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:53.940925 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:old-k8s-version-275488 Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:53.940956 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:53.941330 363058 profile.go:148] Saving config to /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/config.json ...
I0229 02:20:53.941574 363058 start.go:128] duration metric: createHost completed in 31.92410676s
I0229 02:20:53.941601 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHHostname
I0229 02:20:53.944417 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:53.944935 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:old-k8s-version-275488 Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:53.944973 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:53.945129 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHPort
I0229 02:20:53.945328 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHKeyPath
I0229 02:20:53.945484 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHKeyPath
I0229 02:20:53.945617 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHUsername
I0229 02:20:53.945771 363058 main.go:141] libmachine: Using SSH client type: native
I0229 02:20:53.945950 363058 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.160 22 <nil> <nil>}
I0229 02:20:53.945961 363058 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0229 02:20:54.061100 363058 main.go:141] libmachine: SSH cmd err, output: <nil>: 1709173254.049821133
I0229 02:20:54.061138 363058 fix.go:206] guest clock: 1709173254.049821133
I0229 02:20:54.061149 363058 fix.go:219] Guest: 2024-02-29 02:20:54.049821133 +0000 UTC Remote: 2024-02-29 02:20:53.941588876 +0000 UTC m=+46.089794284 (delta=108.232257ms)
I0229 02:20:54.061190 363058 fix.go:190] guest clock delta is within tolerance: 108.232257ms
I0229 02:20:54.061200 363058 start.go:83] releasing machines lock for "old-k8s-version-275488", held for 32.043938959s
I0229 02:20:54.061237 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .DriverName
I0229 02:20:54.061532 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetIP
I0229 02:20:54.065101 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:54.065591 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:old-k8s-version-275488 Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:54.065626 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:54.065785 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .DriverName
I0229 02:20:54.066417 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .DriverName
I0229 02:20:54.066648 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .DriverName
I0229 02:20:54.066742 363058 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0229 02:20:54.066800 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHHostname
I0229 02:20:54.066884 363058 ssh_runner.go:195] Run: cat /version.json
I0229 02:20:54.066910 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHHostname
I0229 02:20:54.069747 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:54.070103 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:54.070140 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:old-k8s-version-275488 Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:54.070154 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:54.070454 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHPort
I0229 02:20:54.070559 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:old-k8s-version-275488 Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:54.070579 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:54.070608 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHKeyPath
I0229 02:20:54.070726 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHPort
I0229 02:20:54.070770 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHUsername
I0229 02:20:54.070895 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHKeyPath
I0229 02:20:54.070886 363058 sshutil.go:53] new ssh client: &{IP:192.168.39.160 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18063-316644/.minikube/machines/old-k8s-version-275488/id_rsa Username:docker}
I0229 02:20:54.071047 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetSSHUsername
I0229 02:20:54.071214 363058 sshutil.go:53] new ssh client: &{IP:192.168.39.160 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18063-316644/.minikube/machines/old-k8s-version-275488/id_rsa Username:docker}
I0229 02:20:54.184924 363058 ssh_runner.go:195] Run: systemctl --version
I0229 02:20:54.194946 363058 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0229 02:20:54.397736 363058 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0229 02:20:54.405995 363058 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0229 02:20:54.406076 363058 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0229 02:20:54.432005 363058 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0229 02:20:54.432037 363058 start.go:475] detecting cgroup driver to use...
I0229 02:20:54.432117 363058 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0229 02:20:54.454790 363058 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0229 02:20:54.474902 363058 docker.go:217] disabling cri-docker service (if available) ...
I0229 02:20:54.474966 363058 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0229 02:20:54.495660 363058 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0229 02:20:54.513877 363058 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0229 02:20:54.722370 363058 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0229 02:20:54.927820 363058 docker.go:233] disabling docker service ...
I0229 02:20:54.927879 363058 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0229 02:20:54.951381 363058 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0229 02:20:54.974946 363058 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0229 02:20:55.136835 363058 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0229 02:20:55.281965 363058 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0229 02:20:55.304264 363058 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0229 02:20:55.329017 363058 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.1" pause image...
I0229 02:20:55.329092 363058 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I0229 02:20:55.344850 363058 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0229 02:20:55.344923 363058 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0229 02:20:55.360449 363058 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0229 02:20:55.377570 363058 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0229 02:20:55.395131 363058 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0229 02:20:55.412337 363058 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0229 02:20:55.430364 363058 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0229 02:20:55.430444 363058 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0229 02:20:55.453268 363058 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0229 02:20:55.468529 363058 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0229 02:20:55.655490 363058 ssh_runner.go:195] Run: sudo systemctl restart crio
I0229 02:20:55.875535 363058 start.go:522] Will wait 60s for socket path /var/run/crio/crio.sock
I0229 02:20:55.875622 363058 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0229 02:20:55.881681 363058 start.go:543] Will wait 60s for crictl version
I0229 02:20:55.881767 363058 ssh_runner.go:195] Run: which crictl
I0229 02:20:55.886491 363058 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0229 02:20:55.932665 363058 start.go:559] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0229 02:20:55.932753 363058 ssh_runner.go:195] Run: crio --version
I0229 02:20:55.980820 363058 ssh_runner.go:195] Run: crio --version
I0229 02:20:56.028937 363058 out.go:177] * Preparing Kubernetes v1.16.0 on CRI-O 1.29.1 ...
I0229 02:20:56.030401 363058 main.go:141] libmachine: (old-k8s-version-275488) Calling .GetIP
I0229 02:20:56.033611 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:56.034054 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:fc:74", ip: ""} in network mk-old-k8s-version-275488: {Iface:virbr2 ExpiryTime:2024-02-29 03:20:40 +0000 UTC Type:0 Mac:52:54:00:6c:fc:74 Iaid: IPaddr:192.168.39.160 Prefix:24 Hostname:old-k8s-version-275488 Clientid:01:52:54:00:6c:fc:74}
I0229 02:20:56.034080 363058 main.go:141] libmachine: (old-k8s-version-275488) DBG | domain old-k8s-version-275488 has defined IP address 192.168.39.160 and MAC address 52:54:00:6c:fc:74 in network mk-old-k8s-version-275488
I0229 02:20:56.034356 363058 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0229 02:20:56.042908 363058 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0229 02:20:56.064842 363058 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
I0229 02:20:56.064895 363058 ssh_runner.go:195] Run: sudo crictl images --output json
I0229 02:20:56.126454 363058 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0229 02:20:56.126542 363058 ssh_runner.go:195] Run: which lz4
I0229 02:20:56.132911 363058 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0229 02:20:56.140563 363058 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0229 02:20:56.140604 363058 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-316644/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (441050307 bytes)
I0229 02:20:58.650802 363058 crio.go:444] Took 2.517938 seconds to copy over tarball
I0229 02:20:58.650911 363058 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0229 02:21:01.744985 363058 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.094023729s)
I0229 02:21:01.745025 363058 crio.go:451] Took 3.094189 seconds to extract the tarball
I0229 02:21:01.745036 363058 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0229 02:21:01.817330 363058 ssh_runner.go:195] Run: sudo crictl images --output json
I0229 02:21:01.886778 363058 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0229 02:21:01.886812 363058 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.16.0 registry.k8s.io/kube-controller-manager:v1.16.0 registry.k8s.io/kube-scheduler:v1.16.0 registry.k8s.io/kube-proxy:v1.16.0 registry.k8s.io/pause:3.1 registry.k8s.io/etcd:3.3.15-0 registry.k8s.io/coredns:1.6.2 gcr.io/k8s-minikube/storage-provisioner:v5]
I0229 02:21:01.886865 363058 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0229 02:21:01.886904 363058 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 02:21:01.886925 363058 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 02:21:01.886960 363058 image.go:134] retrieving image: registry.k8s.io/pause:3.1
I0229 02:21:01.886884 363058 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.16.0
I0229 02:21:01.887234 363058 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 02:21:01.887250 363058 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.2
I0229 02:21:01.887309 363058 image.go:134] retrieving image: registry.k8s.io/etcd:3.3.15-0
I0229 02:21:01.888687 363058 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 02:21:01.890016 363058 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.2: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.2
I0229 02:21:01.890024 363058 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0229 02:21:01.890029 363058 image.go:177] daemon lookup for registry.k8s.io/etcd:3.3.15-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.3.15-0
I0229 02:21:01.890046 363058 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 02:21:01.890044 363058 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 02:21:01.890124 363058 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.16.0
I0229 02:21:01.890130 363058 image.go:177] daemon lookup for registry.k8s.io/pause:3.1: Error response from daemon: No such image: registry.k8s.io/pause:3.1
I0229 02:21:02.014904 363058 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.1
I0229 02:21:02.015371 363058 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.2
I0229 02:21:02.017873 363058 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.16.0
I0229 02:21:02.022681 363058 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.16.0
I0229 02:21:02.028005 363058 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.3.15-0
I0229 02:21:02.030272 363058 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.16.0
I0229 02:21:02.050514 363058 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.16.0
I0229 02:21:02.212805 363058 cache_images.go:116] "registry.k8s.io/pause:3.1" needs transfer: "registry.k8s.io/pause:3.1" does not exist at hash "da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e" in container runtime
I0229 02:21:02.212860 363058 cri.go:218] Removing image: registry.k8s.io/pause:3.1
I0229 02:21:02.212915 363058 ssh_runner.go:195] Run: which crictl
I0229 02:21:02.212910 363058 cache_images.go:116] "registry.k8s.io/coredns:1.6.2" needs transfer: "registry.k8s.io/coredns:1.6.2" does not exist at hash "bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b" in container runtime
I0229 02:21:02.213014 363058 cri.go:218] Removing image: registry.k8s.io/coredns:1.6.2
I0229 02:21:02.213060 363058 ssh_runner.go:195] Run: which crictl
I0229 02:21:02.265275 363058 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.16.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.16.0" does not exist at hash "06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d" in container runtime
I0229 02:21:02.265335 363058 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 02:21:02.265369 363058 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.16.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.16.0" does not exist at hash "301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a" in container runtime
I0229 02:21:02.265396 363058 ssh_runner.go:195] Run: which crictl
I0229 02:21:02.265410 363058 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 02:21:02.265457 363058 ssh_runner.go:195] Run: which crictl
I0229 02:21:02.276698 363058 cache_images.go:116] "registry.k8s.io/etcd:3.3.15-0" needs transfer: "registry.k8s.io/etcd:3.3.15-0" does not exist at hash "b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed" in container runtime
I0229 02:21:02.276728 363058 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.16.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.16.0" does not exist at hash "b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e" in container runtime
I0229 02:21:02.276758 363058 cri.go:218] Removing image: registry.k8s.io/etcd:3.3.15-0
I0229 02:21:02.276760 363058 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 02:21:02.276761 363058 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.16.0" needs transfer: "registry.k8s.io/kube-proxy:v1.16.0" does not exist at hash "c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384" in container runtime
I0229 02:21:02.276809 363058 ssh_runner.go:195] Run: which crictl
I0229 02:21:02.276815 363058 ssh_runner.go:195] Run: which crictl
I0229 02:21:02.276829 363058 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.6.2
I0229 02:21:02.276832 363058 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.16.0
I0229 02:21:02.276899 363058 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.1
I0229 02:21:02.276902 363058 ssh_runner.go:195] Run: which crictl
I0229 02:21:02.276940 363058 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.16.0
I0229 02:21:02.276973 363058 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.16.0
I0229 02:21:02.370070 363058 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-316644/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2
I0229 02:21:02.370157 363058 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.16.0
I0229 02:21:02.370179 363058 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.3.15-0
I0229 02:21:02.404985 363058 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-316644/.minikube/cache/images/amd64/registry.k8s.io/pause_3.1
I0229 02:21:02.404985 363058 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-316644/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0
I0229 02:21:02.405041 363058 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.16.0
I0229 02:21:02.405071 363058 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-316644/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.16.0
I0229 02:21:02.465904 363058 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-316644/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.3.15-0
I0229 02:21:02.466041 363058 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-316644/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0
I0229 02:21:02.490534 363058 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18063-316644/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0
I0229 02:21:02.871562 363058 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0229 02:21:03.026520 363058 cache_images.go:92] LoadImages completed in 1.139689307s
W0229 02:21:03.026605 363058 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18063-316644/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18063-316644/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2: no such file or directory
I0229 02:21:03.026681 363058 ssh_runner.go:195] Run: crio config
I0229 02:21:03.106348 363058 cni.go:84] Creating CNI manager for ""
I0229 02:21:03.106375 363058 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0229 02:21:03.106397 363058 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0229 02:21:03.106423 363058 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.160 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-275488 NodeName:old-k8s-version-275488 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.160"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.160 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0229 02:21:03.106627 363058 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.160
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-275488"
kubeletExtraArgs:
node-ip: 192.168.39.160
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.160"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-275488
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.39.160:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0229 02:21:03.106747 363058 kubeadm.go:976] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-275488 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.160
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-275488 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0229 02:21:03.106811 363058 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0229 02:21:03.123576 363058 binaries.go:44] Found k8s binaries, skipping transfer
I0229 02:21:03.123659 363058 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0229 02:21:03.136318 363058 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0229 02:21:03.163917 363058 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0229 02:21:03.188542 363058 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2181 bytes)
I0229 02:21:03.221230 363058 ssh_runner.go:195] Run: grep 192.168.39.160 control-plane.minikube.internal$ /etc/hosts
I0229 02:21:03.227480 363058 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.160 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0229 02:21:03.247905 363058 certs.go:56] Setting up /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488 for IP: 192.168.39.160
I0229 02:21:03.247939 363058 certs.go:190] acquiring lock for shared ca certs: {Name:mkd6f028899ecf4e22eb84fb292b7189bb17fab0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 02:21:03.248102 363058 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/18063-316644/.minikube/ca.key
I0229 02:21:03.248165 363058 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/18063-316644/.minikube/proxy-client-ca.key
I0229 02:21:03.248226 363058 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/client.key
I0229 02:21:03.248245 363058 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/client.crt with IP's: []
I0229 02:21:03.336172 363058 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/client.crt ...
I0229 02:21:03.336210 363058 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/client.crt: {Name:mk5b1d658acc3c772765fbc38ed9bac1511e524d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 02:21:03.336401 363058 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/client.key ...
I0229 02:21:03.336425 363058 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/client.key: {Name:mkb6c9dddd55ab16332314555be0d57591420912 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 02:21:03.336502 363058 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/apiserver.key.80b25619
I0229 02:21:03.336518 363058 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/apiserver.crt.80b25619 with IP's: [192.168.39.160 10.96.0.1 127.0.0.1 10.0.0.1]
I0229 02:21:03.573871 363058 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/apiserver.crt.80b25619 ...
I0229 02:21:03.573897 363058 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/apiserver.crt.80b25619: {Name:mk401ff0871f9cb3f938920afd1c458d74e459b6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 02:21:03.574086 363058 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/apiserver.key.80b25619 ...
I0229 02:21:03.574106 363058 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/apiserver.key.80b25619: {Name:mk790915b3cd4d74e4db0b89cb37e186bd28a0ac Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 02:21:03.574199 363058 certs.go:337] copying /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/apiserver.crt.80b25619 -> /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/apiserver.crt
I0229 02:21:03.574345 363058 certs.go:341] copying /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/apiserver.key.80b25619 -> /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/apiserver.key
I0229 02:21:03.574430 363058 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/proxy-client.key
I0229 02:21:03.574450 363058 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/proxy-client.crt with IP's: []
I0229 02:21:03.751835 363058 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/proxy-client.crt ...
I0229 02:21:03.751863 363058 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/proxy-client.crt: {Name:mk4abe644dee28f4a63715df6cded861078d14d1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 02:21:03.752009 363058 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/proxy-client.key ...
I0229 02:21:03.752022 363058 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/proxy-client.key: {Name:mk0f7451576196f2010f77fb0ff6276984dc4ba2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 02:21:03.752188 363058 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-316644/.minikube/certs/home/jenkins/minikube-integration/18063-316644/.minikube/certs/323885.pem (1338 bytes)
W0229 02:21:03.752225 363058 certs.go:433] ignoring /home/jenkins/minikube-integration/18063-316644/.minikube/certs/home/jenkins/minikube-integration/18063-316644/.minikube/certs/323885_empty.pem, impossibly tiny 0 bytes
I0229 02:21:03.752237 363058 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-316644/.minikube/certs/home/jenkins/minikube-integration/18063-316644/.minikube/certs/ca-key.pem (1679 bytes)
I0229 02:21:03.752259 363058 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-316644/.minikube/certs/home/jenkins/minikube-integration/18063-316644/.minikube/certs/ca.pem (1082 bytes)
I0229 02:21:03.752284 363058 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-316644/.minikube/certs/home/jenkins/minikube-integration/18063-316644/.minikube/certs/cert.pem (1123 bytes)
I0229 02:21:03.752304 363058 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-316644/.minikube/certs/home/jenkins/minikube-integration/18063-316644/.minikube/certs/key.pem (1675 bytes)
I0229 02:21:03.752342 363058 certs.go:437] found cert: /home/jenkins/minikube-integration/18063-316644/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/18063-316644/.minikube/files/etc/ssl/certs/3238852.pem (1708 bytes)
I0229 02:21:03.753022 363058 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0229 02:21:03.788697 363058 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0229 02:21:03.817368 363058 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0229 02:21:03.847566 363058 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-316644/.minikube/profiles/old-k8s-version-275488/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0229 02:21:03.876548 363058 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-316644/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0229 02:21:03.909475 363058 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-316644/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0229 02:21:03.944466 363058 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-316644/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0229 02:21:03.975089 363058 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-316644/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0229 02:21:04.009058 363058 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-316644/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0229 02:21:04.039669 363058 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-316644/.minikube/certs/323885.pem --> /usr/share/ca-certificates/323885.pem (1338 bytes)
I0229 02:21:04.067948 363058 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18063-316644/.minikube/files/etc/ssl/certs/3238852.pem --> /usr/share/ca-certificates/3238852.pem (1708 bytes)
I0229 02:21:04.096813 363058 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0229 02:21:04.115887 363058 ssh_runner.go:195] Run: openssl version
I0229 02:21:04.122443 363058 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0229 02:21:04.135235 363058 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0229 02:21:04.140445 363058 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Feb 29 01:12 /usr/share/ca-certificates/minikubeCA.pem
I0229 02:21:04.140525 363058 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0229 02:21:04.147472 363058 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0229 02:21:04.162392 363058 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/323885.pem && ln -fs /usr/share/ca-certificates/323885.pem /etc/ssl/certs/323885.pem"
I0229 02:21:04.175438 363058 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/323885.pem
I0229 02:21:04.180602 363058 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Feb 29 01:21 /usr/share/ca-certificates/323885.pem
I0229 02:21:04.180664 363058 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/323885.pem
I0229 02:21:04.187655 363058 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/323885.pem /etc/ssl/certs/51391683.0"
I0229 02:21:04.201133 363058 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3238852.pem && ln -fs /usr/share/ca-certificates/3238852.pem /etc/ssl/certs/3238852.pem"
I0229 02:21:04.217716 363058 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3238852.pem
I0229 02:21:04.225309 363058 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Feb 29 01:21 /usr/share/ca-certificates/3238852.pem
I0229 02:21:04.225396 363058 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3238852.pem
I0229 02:21:04.232154 363058 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/3238852.pem /etc/ssl/certs/3ec20f2e.0"
I0229 02:21:04.252273 363058 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I0229 02:21:04.258754 363058 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
I0229 02:21:04.258806 363058 kubeadm.go:404] StartCluster: {Name:old-k8s-version-275488 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVe
rsion:v1.16.0 ClusterName:old-k8s-version-275488 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.39.160 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0229 02:21:04.258889 363058 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0229 02:21:04.258953 363058 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0229 02:21:04.306971 363058 cri.go:89] found id: ""
I0229 02:21:04.307049 363058 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0229 02:21:04.320705 363058 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0229 02:21:04.333620 363058 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0229 02:21:04.346105 363058 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0229 02:21:04.346148 363058 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0229 02:21:04.814110 363058 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0229 02:23:03.367227 363058 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0229 02:23:03.367347 363058 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
I0229 02:23:03.368996 363058 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0229 02:23:03.369076 363058 kubeadm.go:322] [preflight] Running pre-flight checks
I0229 02:23:03.369188 363058 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0229 02:23:03.369319 363058 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0229 02:23:03.369445 363058 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0229 02:23:03.369573 363058 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0229 02:23:03.369676 363058 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0229 02:23:03.369744 363058 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0229 02:23:03.369818 363058 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0229 02:23:03.371478 363058 out.go:204] - Generating certificates and keys ...
I0229 02:23:03.371589 363058 kubeadm.go:322] [certs] Using existing ca certificate authority
I0229 02:23:03.371674 363058 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0229 02:23:03.371758 363058 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I0229 02:23:03.371834 363058 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I0229 02:23:03.371904 363058 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I0229 02:23:03.371956 363058 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I0229 02:23:03.372016 363058 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I0229 02:23:03.372161 363058 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [old-k8s-version-275488 localhost] and IPs [192.168.39.160 127.0.0.1 ::1]
I0229 02:23:03.372218 363058 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I0229 02:23:03.372355 363058 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-275488 localhost] and IPs [192.168.39.160 127.0.0.1 ::1]
I0229 02:23:03.372426 363058 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I0229 02:23:03.372496 363058 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I0229 02:23:03.372546 363058 kubeadm.go:322] [certs] Generating "sa" key and public key
I0229 02:23:03.372609 363058 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0229 02:23:03.372666 363058 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0229 02:23:03.372723 363058 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0229 02:23:03.372802 363058 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0229 02:23:03.372863 363058 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0229 02:23:03.372936 363058 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0229 02:23:03.375213 363058 out.go:204] - Booting up control plane ...
I0229 02:23:03.375319 363058 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0229 02:23:03.375401 363058 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0229 02:23:03.375479 363058 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0229 02:23:03.375574 363058 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0229 02:23:03.375751 363058 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0229 02:23:03.375817 363058 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0229 02:23:03.375896 363058 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:23:03.376097 363058 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:23:03.376175 363058 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:23:03.376399 363058 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:23:03.376476 363058 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:23:03.376681 363058 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:23:03.376763 363058 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:23:03.376964 363058 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:23:03.377042 363058 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:23:03.377261 363058 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:23:03.377269 363058 kubeadm.go:322]
I0229 02:23:03.377314 363058 kubeadm.go:322] Unfortunately, an error has occurred:
I0229 02:23:03.377354 363058 kubeadm.go:322] timed out waiting for the condition
I0229 02:23:03.377360 363058 kubeadm.go:322]
I0229 02:23:03.377399 363058 kubeadm.go:322] This error is likely caused by:
I0229 02:23:03.377435 363058 kubeadm.go:322] - The kubelet is not running
I0229 02:23:03.377553 363058 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0229 02:23:03.377561 363058 kubeadm.go:322]
I0229 02:23:03.377682 363058 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0229 02:23:03.377723 363058 kubeadm.go:322] - 'systemctl status kubelet'
I0229 02:23:03.377836 363058 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0229 02:23:03.377858 363058 kubeadm.go:322]
I0229 02:23:03.378000 363058 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0229 02:23:03.378116 363058 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0229 02:23:03.378212 363058 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0229 02:23:03.378551 363058 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0229 02:23:03.378669 363058 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0229 02:23:03.378733 363058 kubeadm.go:322] - 'docker logs CONTAINERID'
W0229 02:23:03.378882 363058 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-275488 localhost] and IPs [192.168.39.160 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-275488 localhost] and IPs [192.168.39.160 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-275488 localhost] and IPs [192.168.39.160 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-275488 localhost] and IPs [192.168.39.160 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0229 02:23:03.378944 363058 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0229 02:23:03.897763 363058 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0229 02:23:03.915368 363058 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0229 02:23:03.927732 363058 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0229 02:23:03.927787 363058 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0229 02:23:03.997384 363058 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0229 02:23:03.997475 363058 kubeadm.go:322] [preflight] Running pre-flight checks
I0229 02:23:04.129962 363058 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0229 02:23:04.130102 363058 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0229 02:23:04.130203 363058 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0229 02:23:04.352134 363058 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0229 02:23:04.352293 363058 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0229 02:23:04.360556 363058 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0229 02:23:04.520146 363058 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0229 02:23:04.522694 363058 out.go:204] - Generating certificates and keys ...
I0229 02:23:04.522802 363058 kubeadm.go:322] [certs] Using existing ca certificate authority
I0229 02:23:04.522877 363058 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0229 02:23:04.522977 363058 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0229 02:23:04.523069 363058 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority
I0229 02:23:04.523164 363058 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk
I0229 02:23:04.523259 363058 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority
I0229 02:23:04.523361 363058 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk
I0229 02:23:04.523457 363058 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk
I0229 02:23:04.523560 363058 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0229 02:23:04.523661 363058 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0229 02:23:04.523721 363058 kubeadm.go:322] [certs] Using the existing "sa" key
I0229 02:23:04.523816 363058 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0229 02:23:04.623824 363058 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0229 02:23:04.886857 363058 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0229 02:23:05.064692 363058 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0229 02:23:05.176661 363058 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0229 02:23:05.177622 363058 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0229 02:23:05.179306 363058 out.go:204] - Booting up control plane ...
I0229 02:23:05.179468 363058 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0229 02:23:05.187620 363058 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0229 02:23:05.188716 363058 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0229 02:23:05.189514 363058 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0229 02:23:05.192796 363058 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0229 02:23:45.194329 363058 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0229 02:23:45.195017 363058 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:23:45.195214 363058 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:23:50.195795 363058 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:23:50.196054 363058 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:24:00.196805 363058 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:24:00.197056 363058 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:24:20.197949 363058 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:24:20.198134 363058 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:25:00.198097 363058 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 02:25:00.198382 363058 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 02:25:00.198408 363058 kubeadm.go:322]
I0229 02:25:00.198465 363058 kubeadm.go:322] Unfortunately, an error has occurred:
I0229 02:25:00.198533 363058 kubeadm.go:322] timed out waiting for the condition
I0229 02:25:00.198547 363058 kubeadm.go:322]
I0229 02:25:00.198589 363058 kubeadm.go:322] This error is likely caused by:
I0229 02:25:00.198647 363058 kubeadm.go:322] - The kubelet is not running
I0229 02:25:00.198804 363058 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0229 02:25:00.198815 363058 kubeadm.go:322]
I0229 02:25:00.198947 363058 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0229 02:25:00.198997 363058 kubeadm.go:322] - 'systemctl status kubelet'
I0229 02:25:00.199036 363058 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0229 02:25:00.199046 363058 kubeadm.go:322]
I0229 02:25:00.199195 363058 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0229 02:25:00.199312 363058 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0229 02:25:00.199454 363058 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0229 02:25:00.199498 363058 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0229 02:25:00.199630 363058 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0229 02:25:00.199709 363058 kubeadm.go:322] - 'docker logs CONTAINERID'
I0229 02:25:00.199822 363058 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0229 02:25:00.199893 363058 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0229 02:25:00.200024 363058 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
I0229 02:25:00.200079 363058 kubeadm.go:406] StartCluster complete in 3m55.941279011s
I0229 02:25:00.200133 363058 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0229 02:25:00.200206 363058 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0229 02:25:00.246693 363058 cri.go:89] found id: ""
I0229 02:25:00.246725 363058 logs.go:276] 0 containers: []
W0229 02:25:00.246737 363058 logs.go:278] No container was found matching "kube-apiserver"
I0229 02:25:00.246745 363058 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0229 02:25:00.246798 363058 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0229 02:25:00.282671 363058 cri.go:89] found id: ""
I0229 02:25:00.282696 363058 logs.go:276] 0 containers: []
W0229 02:25:00.282705 363058 logs.go:278] No container was found matching "etcd"
I0229 02:25:00.282711 363058 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0229 02:25:00.282762 363058 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0229 02:25:00.318664 363058 cri.go:89] found id: ""
I0229 02:25:00.318690 363058 logs.go:276] 0 containers: []
W0229 02:25:00.318698 363058 logs.go:278] No container was found matching "coredns"
I0229 02:25:00.318705 363058 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0229 02:25:00.318758 363058 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0229 02:25:00.353816 363058 cri.go:89] found id: ""
I0229 02:25:00.353847 363058 logs.go:276] 0 containers: []
W0229 02:25:00.353861 363058 logs.go:278] No container was found matching "kube-scheduler"
I0229 02:25:00.353868 363058 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0229 02:25:00.353941 363058 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0229 02:25:00.388881 363058 cri.go:89] found id: ""
I0229 02:25:00.388906 363058 logs.go:276] 0 containers: []
W0229 02:25:00.388914 363058 logs.go:278] No container was found matching "kube-proxy"
I0229 02:25:00.388920 363058 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0229 02:25:00.388979 363058 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0229 02:25:00.441900 363058 cri.go:89] found id: ""
I0229 02:25:00.441933 363058 logs.go:276] 0 containers: []
W0229 02:25:00.441942 363058 logs.go:278] No container was found matching "kube-controller-manager"
I0229 02:25:00.441948 363058 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0229 02:25:00.442011 363058 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0229 02:25:00.477401 363058 cri.go:89] found id: ""
I0229 02:25:00.477427 363058 logs.go:276] 0 containers: []
W0229 02:25:00.477436 363058 logs.go:278] No container was found matching "kindnet"
I0229 02:25:00.477447 363058 logs.go:123] Gathering logs for kubelet ...
I0229 02:25:00.477460 363058 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0229 02:25:00.523332 363058 logs.go:123] Gathering logs for dmesg ...
I0229 02:25:00.523368 363058 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0229 02:25:00.540671 363058 logs.go:123] Gathering logs for describe nodes ...
I0229 02:25:00.540699 363058 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0229 02:25:00.671889 363058 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0229 02:25:00.671914 363058 logs.go:123] Gathering logs for CRI-O ...
I0229 02:25:00.671928 363058 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0229 02:25:00.763824 363058 logs.go:123] Gathering logs for container status ...
I0229 02:25:00.763864 363058 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0229 02:25:00.805712 363058 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 02:25:00.805771 363058 out.go:239] *
*
W0229 02:25:00.805838 363058 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 02:25:00.805868 363058 out.go:239] *
*
W0229 02:25:00.806812 363058 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0229 02:25:00.809590 363058 out.go:177]
W0229 02:25:00.810582 363058 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 02:25:00.810633 363058 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0229 02:25:00.810658 363058 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0229 02:25:00.812128 363058 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-275488 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-275488 -n old-k8s-version-275488
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-275488 -n old-k8s-version-275488: exit status 6 (235.399287ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0229 02:25:01.084045 369110 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-275488" does not appear in /home/jenkins/minikube-integration/18063-316644/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-275488" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (293.25s)