=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-631080 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.16.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-631080 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.16.0: exit status 109 (4m30.536456275s)
-- stdout --
* [old-k8s-version-631080] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18259
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18259-6428/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18259-6428/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting control plane node old-k8s-version-631080 in cluster old-k8s-version-631080
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.16.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0229 18:46:54.369989 44399 out.go:291] Setting OutFile to fd 1 ...
I0229 18:46:54.370098 44399 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0229 18:46:54.370109 44399 out.go:304] Setting ErrFile to fd 2...
I0229 18:46:54.370115 44399 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0229 18:46:54.370313 44399 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18259-6428/.minikube/bin
I0229 18:46:54.370918 44399 out.go:298] Setting JSON to false
I0229 18:46:54.371942 44399 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":5359,"bootTime":1709227056,"procs":217,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0229 18:46:54.372009 44399 start.go:139] virtualization: kvm guest
I0229 18:46:54.374309 44399 out.go:177] * [old-k8s-version-631080] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0229 18:46:54.375787 44399 out.go:177] - MINIKUBE_LOCATION=18259
I0229 18:46:54.375785 44399 notify.go:220] Checking for updates...
I0229 18:46:54.378769 44399 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0229 18:46:54.380080 44399 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18259-6428/kubeconfig
I0229 18:46:54.381355 44399 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18259-6428/.minikube
I0229 18:46:54.382856 44399 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0229 18:46:54.384302 44399 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0229 18:46:54.385962 44399 config.go:182] Loaded profile config "cert-expiration-393248": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0229 18:46:54.386065 44399 config.go:182] Loaded profile config "kubernetes-upgrade-541086": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.29.0-rc.2
I0229 18:46:54.386175 44399 config.go:182] Loaded profile config "pause-848791": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0229 18:46:54.386270 44399 driver.go:392] Setting default libvirt URI to qemu:///system
I0229 18:46:54.431097 44399 out.go:177] * Using the kvm2 driver based on user configuration
I0229 18:46:54.432452 44399 start.go:299] selected driver: kvm2
I0229 18:46:54.432470 44399 start.go:903] validating driver "kvm2" against <nil>
I0229 18:46:54.432481 44399 start.go:914] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0229 18:46:54.433194 44399 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0229 18:46:54.433285 44399 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18259-6428/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0229 18:46:54.449032 44399 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0229 18:46:54.449077 44399 start_flags.go:309] no existing cluster config was found, will generate one from the flags
I0229 18:46:54.449279 44399 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0229 18:46:54.449345 44399 cni.go:84] Creating CNI manager for ""
I0229 18:46:54.449357 44399 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0229 18:46:54.449369 44399 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0229 18:46:54.449377 44399 start_flags.go:323] config:
{Name:old-k8s-version-631080 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-631080 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR
untime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0229 18:46:54.449502 44399 iso.go:125] acquiring lock: {Name:mk4b55cee5696fff78a1389276e4e011ad655e56 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0229 18:46:54.451402 44399 out.go:177] * Starting control plane node old-k8s-version-631080 in cluster old-k8s-version-631080
I0229 18:46:54.452953 44399 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
I0229 18:46:54.452989 44399 preload.go:148] Found local preload: /home/jenkins/minikube-integration/18259-6428/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4
I0229 18:46:54.452997 44399 cache.go:56] Caching tarball of preloaded images
I0229 18:46:54.453097 44399 preload.go:174] Found /home/jenkins/minikube-integration/18259-6428/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0229 18:46:54.453109 44399 cache.go:59] Finished verifying existence of preloaded tar for v1.16.0 on crio
I0229 18:46:54.453247 44399 profile.go:148] Saving config to /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/config.json ...
I0229 18:46:54.453275 44399 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/config.json: {Name:mk693df3a443eed5d36e58a0dbdf9df907f81cb6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:46:54.453440 44399 start.go:365] acquiring machines lock for old-k8s-version-631080: {Name:mk08b242c6b6b7cd4a6843a7d3821a8b435540dd Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0229 18:46:54.453494 44399 start.go:369] acquired machines lock for "old-k8s-version-631080" in 31.039µs
I0229 18:46:54.453520 44399 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-631080 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-631080 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0229 18:46:54.453594 44399 start.go:125] createHost starting for "" (driver="kvm2")
I0229 18:46:54.455127 44399 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0229 18:46:54.455269 44399 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0229 18:46:54.455312 44399 main.go:141] libmachine: Launching plugin server for driver kvm2
I0229 18:46:54.469961 44399 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46413
I0229 18:46:54.470376 44399 main.go:141] libmachine: () Calling .GetVersion
I0229 18:46:54.470941 44399 main.go:141] libmachine: Using API Version 1
I0229 18:46:54.470967 44399 main.go:141] libmachine: () Calling .SetConfigRaw
I0229 18:46:54.471369 44399 main.go:141] libmachine: () Calling .GetMachineName
I0229 18:46:54.471599 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetMachineName
I0229 18:46:54.471784 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .DriverName
I0229 18:46:54.471957 44399 start.go:159] libmachine.API.Create for "old-k8s-version-631080" (driver="kvm2")
I0229 18:46:54.471986 44399 client.go:168] LocalClient.Create starting
I0229 18:46:54.472020 44399 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18259-6428/.minikube/certs/ca.pem
I0229 18:46:54.472059 44399 main.go:141] libmachine: Decoding PEM data...
I0229 18:46:54.472084 44399 main.go:141] libmachine: Parsing certificate...
I0229 18:46:54.472154 44399 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18259-6428/.minikube/certs/cert.pem
I0229 18:46:54.472181 44399 main.go:141] libmachine: Decoding PEM data...
I0229 18:46:54.472199 44399 main.go:141] libmachine: Parsing certificate...
I0229 18:46:54.472221 44399 main.go:141] libmachine: Running pre-create checks...
I0229 18:46:54.472241 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .PreCreateCheck
I0229 18:46:54.472643 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetConfigRaw
I0229 18:46:54.473044 44399 main.go:141] libmachine: Creating machine...
I0229 18:46:54.473061 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .Create
I0229 18:46:54.473199 44399 main.go:141] libmachine: (old-k8s-version-631080) Creating KVM machine...
I0229 18:46:54.474775 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found existing default KVM network
I0229 18:46:54.476306 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:46:54.476129 44421 network.go:212] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:26:45:ad} reservation:<nil>}
I0229 18:46:54.477088 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:46:54.476986 44421 network.go:212] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:52:29:68} reservation:<nil>}
I0229 18:46:54.479353 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:46:54.479218 44421 network.go:210] skipping subnet 192.168.61.0/24 that is reserved: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0229 18:46:54.480176 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:46:54.480076 44421 network.go:212] skipping subnet 192.168.72.0/24 that is taken: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.72.1 IfaceMTU:1500 IfaceMAC:52:54:00:84:23:4a} reservation:<nil>}
I0229 18:46:54.481459 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:46:54.481348 44421 network.go:207] using free private subnet 192.168.83.0/24: &{IP:192.168.83.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.83.0/24 Gateway:192.168.83.1 ClientMin:192.168.83.2 ClientMax:192.168.83.254 Broadcast:192.168.83.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015540}
I0229 18:46:54.486695 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | trying to create private KVM network mk-old-k8s-version-631080 192.168.83.0/24...
I0229 18:46:54.563569 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | private KVM network mk-old-k8s-version-631080 192.168.83.0/24 created
I0229 18:46:54.563614 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:46:54.563536 44421 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18259-6428/.minikube
I0229 18:46:54.563632 44399 main.go:141] libmachine: (old-k8s-version-631080) Setting up store path in /home/jenkins/minikube-integration/18259-6428/.minikube/machines/old-k8s-version-631080 ...
I0229 18:46:54.563661 44399 main.go:141] libmachine: (old-k8s-version-631080) Building disk image from file:///home/jenkins/minikube-integration/18259-6428/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso
I0229 18:46:54.563773 44399 main.go:141] libmachine: (old-k8s-version-631080) Downloading /home/jenkins/minikube-integration/18259-6428/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18259-6428/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
I0229 18:46:54.796669 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:46:54.796532 44421 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18259-6428/.minikube/machines/old-k8s-version-631080/id_rsa...
I0229 18:46:54.901732 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:46:54.901616 44421 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18259-6428/.minikube/machines/old-k8s-version-631080/old-k8s-version-631080.rawdisk...
I0229 18:46:54.901761 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | Writing magic tar header
I0229 18:46:54.901797 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | Writing SSH key tar header
I0229 18:46:54.901813 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:46:54.901737 44421 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18259-6428/.minikube/machines/old-k8s-version-631080 ...
I0229 18:46:54.901836 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18259-6428/.minikube/machines/old-k8s-version-631080
I0229 18:46:54.901864 44399 main.go:141] libmachine: (old-k8s-version-631080) Setting executable bit set on /home/jenkins/minikube-integration/18259-6428/.minikube/machines/old-k8s-version-631080 (perms=drwx------)
I0229 18:46:54.901884 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18259-6428/.minikube/machines
I0229 18:46:54.901899 44399 main.go:141] libmachine: (old-k8s-version-631080) Setting executable bit set on /home/jenkins/minikube-integration/18259-6428/.minikube/machines (perms=drwxr-xr-x)
I0229 18:46:54.901918 44399 main.go:141] libmachine: (old-k8s-version-631080) Setting executable bit set on /home/jenkins/minikube-integration/18259-6428/.minikube (perms=drwxr-xr-x)
I0229 18:46:54.901930 44399 main.go:141] libmachine: (old-k8s-version-631080) Setting executable bit set on /home/jenkins/minikube-integration/18259-6428 (perms=drwxrwxr-x)
I0229 18:46:54.901944 44399 main.go:141] libmachine: (old-k8s-version-631080) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0229 18:46:54.901962 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18259-6428/.minikube
I0229 18:46:54.901975 44399 main.go:141] libmachine: (old-k8s-version-631080) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0229 18:46:54.901991 44399 main.go:141] libmachine: (old-k8s-version-631080) Creating domain...
I0229 18:46:54.902009 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18259-6428
I0229 18:46:54.902023 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0229 18:46:54.902035 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | Checking permissions on dir: /home/jenkins
I0229 18:46:54.902047 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | Checking permissions on dir: /home
I0229 18:46:54.902059 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | Skipping /home - not owner
I0229 18:46:54.903138 44399 main.go:141] libmachine: (old-k8s-version-631080) define libvirt domain using xml:
I0229 18:46:54.903167 44399 main.go:141] libmachine: (old-k8s-version-631080) <domain type='kvm'>
I0229 18:46:54.903179 44399 main.go:141] libmachine: (old-k8s-version-631080) <name>old-k8s-version-631080</name>
I0229 18:46:54.903192 44399 main.go:141] libmachine: (old-k8s-version-631080) <memory unit='MiB'>2200</memory>
I0229 18:46:54.903201 44399 main.go:141] libmachine: (old-k8s-version-631080) <vcpu>2</vcpu>
I0229 18:46:54.903209 44399 main.go:141] libmachine: (old-k8s-version-631080) <features>
I0229 18:46:54.903217 44399 main.go:141] libmachine: (old-k8s-version-631080) <acpi/>
I0229 18:46:54.903224 44399 main.go:141] libmachine: (old-k8s-version-631080) <apic/>
I0229 18:46:54.903230 44399 main.go:141] libmachine: (old-k8s-version-631080) <pae/>
I0229 18:46:54.903237 44399 main.go:141] libmachine: (old-k8s-version-631080)
I0229 18:46:54.903242 44399 main.go:141] libmachine: (old-k8s-version-631080) </features>
I0229 18:46:54.903247 44399 main.go:141] libmachine: (old-k8s-version-631080) <cpu mode='host-passthrough'>
I0229 18:46:54.903252 44399 main.go:141] libmachine: (old-k8s-version-631080)
I0229 18:46:54.903259 44399 main.go:141] libmachine: (old-k8s-version-631080) </cpu>
I0229 18:46:54.903290 44399 main.go:141] libmachine: (old-k8s-version-631080) <os>
I0229 18:46:54.903315 44399 main.go:141] libmachine: (old-k8s-version-631080) <type>hvm</type>
I0229 18:46:54.903324 44399 main.go:141] libmachine: (old-k8s-version-631080) <boot dev='cdrom'/>
I0229 18:46:54.903332 44399 main.go:141] libmachine: (old-k8s-version-631080) <boot dev='hd'/>
I0229 18:46:54.903348 44399 main.go:141] libmachine: (old-k8s-version-631080) <bootmenu enable='no'/>
I0229 18:46:54.903375 44399 main.go:141] libmachine: (old-k8s-version-631080) </os>
I0229 18:46:54.903393 44399 main.go:141] libmachine: (old-k8s-version-631080) <devices>
I0229 18:46:54.903409 44399 main.go:141] libmachine: (old-k8s-version-631080) <disk type='file' device='cdrom'>
I0229 18:46:54.903427 44399 main.go:141] libmachine: (old-k8s-version-631080) <source file='/home/jenkins/minikube-integration/18259-6428/.minikube/machines/old-k8s-version-631080/boot2docker.iso'/>
I0229 18:46:54.903440 44399 main.go:141] libmachine: (old-k8s-version-631080) <target dev='hdc' bus='scsi'/>
I0229 18:46:54.903453 44399 main.go:141] libmachine: (old-k8s-version-631080) <readonly/>
I0229 18:46:54.903464 44399 main.go:141] libmachine: (old-k8s-version-631080) </disk>
I0229 18:46:54.903511 44399 main.go:141] libmachine: (old-k8s-version-631080) <disk type='file' device='disk'>
I0229 18:46:54.903540 44399 main.go:141] libmachine: (old-k8s-version-631080) <driver name='qemu' type='raw' cache='default' io='threads' />
I0229 18:46:54.903578 44399 main.go:141] libmachine: (old-k8s-version-631080) <source file='/home/jenkins/minikube-integration/18259-6428/.minikube/machines/old-k8s-version-631080/old-k8s-version-631080.rawdisk'/>
I0229 18:46:54.903590 44399 main.go:141] libmachine: (old-k8s-version-631080) <target dev='hda' bus='virtio'/>
I0229 18:46:54.903601 44399 main.go:141] libmachine: (old-k8s-version-631080) </disk>
I0229 18:46:54.903615 44399 main.go:141] libmachine: (old-k8s-version-631080) <interface type='network'>
I0229 18:46:54.903630 44399 main.go:141] libmachine: (old-k8s-version-631080) <source network='mk-old-k8s-version-631080'/>
I0229 18:46:54.903640 44399 main.go:141] libmachine: (old-k8s-version-631080) <model type='virtio'/>
I0229 18:46:54.903649 44399 main.go:141] libmachine: (old-k8s-version-631080) </interface>
I0229 18:46:54.903671 44399 main.go:141] libmachine: (old-k8s-version-631080) <interface type='network'>
I0229 18:46:54.903683 44399 main.go:141] libmachine: (old-k8s-version-631080) <source network='default'/>
I0229 18:46:54.903691 44399 main.go:141] libmachine: (old-k8s-version-631080) <model type='virtio'/>
I0229 18:46:54.903703 44399 main.go:141] libmachine: (old-k8s-version-631080) </interface>
I0229 18:46:54.903713 44399 main.go:141] libmachine: (old-k8s-version-631080) <serial type='pty'>
I0229 18:46:54.903723 44399 main.go:141] libmachine: (old-k8s-version-631080) <target port='0'/>
I0229 18:46:54.903734 44399 main.go:141] libmachine: (old-k8s-version-631080) </serial>
I0229 18:46:54.903768 44399 main.go:141] libmachine: (old-k8s-version-631080) <console type='pty'>
I0229 18:46:54.903790 44399 main.go:141] libmachine: (old-k8s-version-631080) <target type='serial' port='0'/>
I0229 18:46:54.903802 44399 main.go:141] libmachine: (old-k8s-version-631080) </console>
I0229 18:46:54.903823 44399 main.go:141] libmachine: (old-k8s-version-631080) <rng model='virtio'>
I0229 18:46:54.903837 44399 main.go:141] libmachine: (old-k8s-version-631080) <backend model='random'>/dev/random</backend>
I0229 18:46:54.903844 44399 main.go:141] libmachine: (old-k8s-version-631080) </rng>
I0229 18:46:54.903874 44399 main.go:141] libmachine: (old-k8s-version-631080)
I0229 18:46:54.903896 44399 main.go:141] libmachine: (old-k8s-version-631080)
I0229 18:46:54.903909 44399 main.go:141] libmachine: (old-k8s-version-631080) </devices>
I0229 18:46:54.903919 44399 main.go:141] libmachine: (old-k8s-version-631080) </domain>
I0229 18:46:54.903934 44399 main.go:141] libmachine: (old-k8s-version-631080)
I0229 18:46:54.908089 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:45:2c:7a in network default
I0229 18:46:54.908835 44399 main.go:141] libmachine: (old-k8s-version-631080) Ensuring networks are active...
I0229 18:46:54.908863 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:46:54.909555 44399 main.go:141] libmachine: (old-k8s-version-631080) Ensuring network default is active
I0229 18:46:54.909933 44399 main.go:141] libmachine: (old-k8s-version-631080) Ensuring network mk-old-k8s-version-631080 is active
I0229 18:46:54.910529 44399 main.go:141] libmachine: (old-k8s-version-631080) Getting domain xml...
I0229 18:46:54.911447 44399 main.go:141] libmachine: (old-k8s-version-631080) Creating domain...
I0229 18:46:56.226634 44399 main.go:141] libmachine: (old-k8s-version-631080) Waiting to get IP...
I0229 18:46:56.227623 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:46:56.228185 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | unable to find current IP address of domain old-k8s-version-631080 in network mk-old-k8s-version-631080
I0229 18:46:56.228226 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:46:56.228176 44421 retry.go:31] will retry after 276.827254ms: waiting for machine to come up
I0229 18:46:56.506898 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:46:56.507677 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | unable to find current IP address of domain old-k8s-version-631080 in network mk-old-k8s-version-631080
I0229 18:46:56.507720 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:46:56.507666 44421 retry.go:31] will retry after 320.605046ms: waiting for machine to come up
I0229 18:46:56.830182 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:46:56.830698 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | unable to find current IP address of domain old-k8s-version-631080 in network mk-old-k8s-version-631080
I0229 18:46:56.830737 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:46:56.830662 44421 retry.go:31] will retry after 403.574322ms: waiting for machine to come up
I0229 18:46:57.236342 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:46:57.236789 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | unable to find current IP address of domain old-k8s-version-631080 in network mk-old-k8s-version-631080
I0229 18:46:57.236814 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:46:57.236746 44421 retry.go:31] will retry after 382.417907ms: waiting for machine to come up
I0229 18:46:57.621375 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:46:57.621893 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | unable to find current IP address of domain old-k8s-version-631080 in network mk-old-k8s-version-631080
I0229 18:46:57.621926 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:46:57.621845 44421 retry.go:31] will retry after 591.038111ms: waiting for machine to come up
I0229 18:46:58.214069 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:46:58.214557 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | unable to find current IP address of domain old-k8s-version-631080 in network mk-old-k8s-version-631080
I0229 18:46:58.214589 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:46:58.214520 44421 retry.go:31] will retry after 636.138059ms: waiting for machine to come up
I0229 18:46:58.851985 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:46:58.852441 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | unable to find current IP address of domain old-k8s-version-631080 in network mk-old-k8s-version-631080
I0229 18:46:58.852466 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:46:58.852388 44421 retry.go:31] will retry after 1.145847764s: waiting for machine to come up
I0229 18:47:00.000454 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:00.000992 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | unable to find current IP address of domain old-k8s-version-631080 in network mk-old-k8s-version-631080
I0229 18:47:00.001059 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:47:00.000970 44421 retry.go:31] will retry after 1.140987822s: waiting for machine to come up
I0229 18:47:01.143497 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:01.144021 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | unable to find current IP address of domain old-k8s-version-631080 in network mk-old-k8s-version-631080
I0229 18:47:01.144055 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:47:01.143974 44421 retry.go:31] will retry after 1.763492491s: waiting for machine to come up
I0229 18:47:02.908596 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:02.909195 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | unable to find current IP address of domain old-k8s-version-631080 in network mk-old-k8s-version-631080
I0229 18:47:02.909224 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:47:02.909149 44421 retry.go:31] will retry after 2.156812225s: waiting for machine to come up
I0229 18:47:05.068142 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:05.068756 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | unable to find current IP address of domain old-k8s-version-631080 in network mk-old-k8s-version-631080
I0229 18:47:05.068790 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:47:05.068705 44421 retry.go:31] will retry after 2.541472609s: waiting for machine to come up
I0229 18:47:07.612579 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:07.613127 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | unable to find current IP address of domain old-k8s-version-631080 in network mk-old-k8s-version-631080
I0229 18:47:07.613150 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:47:07.613071 44421 retry.go:31] will retry after 2.349373813s: waiting for machine to come up
I0229 18:47:09.963760 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:09.964188 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | unable to find current IP address of domain old-k8s-version-631080 in network mk-old-k8s-version-631080
I0229 18:47:09.964220 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:47:09.964150 44421 retry.go:31] will retry after 3.751562898s: waiting for machine to come up
I0229 18:47:13.716793 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:13.717271 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | unable to find current IP address of domain old-k8s-version-631080 in network mk-old-k8s-version-631080
I0229 18:47:13.717296 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | I0229 18:47:13.717225 44421 retry.go:31] will retry after 4.503795972s: waiting for machine to come up
I0229 18:47:18.224043 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:18.224566 44399 main.go:141] libmachine: (old-k8s-version-631080) Found IP for machine: 192.168.83.214
I0229 18:47:18.224591 44399 main.go:141] libmachine: (old-k8s-version-631080) Reserving static IP address...
I0229 18:47:18.224626 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has current primary IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:18.224908 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-631080", mac: "52:54:00:1b:b2:7e", ip: "192.168.83.214"} in network mk-old-k8s-version-631080
I0229 18:47:18.299959 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | Getting to WaitForSSH function...
I0229 18:47:18.299985 44399 main.go:141] libmachine: (old-k8s-version-631080) Reserved static IP address: 192.168.83.214
I0229 18:47:18.299997 44399 main.go:141] libmachine: (old-k8s-version-631080) Waiting for SSH to be available...
I0229 18:47:18.302466 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:18.302909 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:minikube Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:18.302938 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:18.303174 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | Using SSH client type: external
I0229 18:47:18.303195 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | Using SSH private key: /home/jenkins/minikube-integration/18259-6428/.minikube/machines/old-k8s-version-631080/id_rsa (-rw-------)
I0229 18:47:18.303223 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.83.214 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18259-6428/.minikube/machines/old-k8s-version-631080/id_rsa -p 22] /usr/bin/ssh <nil>}
I0229 18:47:18.303239 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | About to run SSH command:
I0229 18:47:18.303252 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | exit 0
I0229 18:47:18.435600 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | SSH cmd err, output: <nil>:
I0229 18:47:18.435889 44399 main.go:141] libmachine: (old-k8s-version-631080) KVM machine creation complete!
I0229 18:47:18.436301 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetConfigRaw
I0229 18:47:18.436823 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .DriverName
I0229 18:47:18.437032 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .DriverName
I0229 18:47:18.437207 44399 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0229 18:47:18.437223 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetState
I0229 18:47:18.438569 44399 main.go:141] libmachine: Detecting operating system of created instance...
I0229 18:47:18.438585 44399 main.go:141] libmachine: Waiting for SSH to be available...
I0229 18:47:18.438592 44399 main.go:141] libmachine: Getting to WaitForSSH function...
I0229 18:47:18.438600 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHHostname
I0229 18:47:18.441240 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:18.441690 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:old-k8s-version-631080 Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:18.441713 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:18.441907 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHPort
I0229 18:47:18.442110 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHKeyPath
I0229 18:47:18.442258 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHKeyPath
I0229 18:47:18.442413 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHUsername
I0229 18:47:18.442570 44399 main.go:141] libmachine: Using SSH client type: native
I0229 18:47:18.442821 44399 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.83.214 22 <nil> <nil>}
I0229 18:47:18.442838 44399 main.go:141] libmachine: About to run SSH command:
exit 0
I0229 18:47:18.559059 44399 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0229 18:47:18.559084 44399 main.go:141] libmachine: Detecting the provisioner...
I0229 18:47:18.559092 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHHostname
I0229 18:47:18.562247 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:18.562660 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:old-k8s-version-631080 Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:18.562681 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:18.562845 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHPort
I0229 18:47:18.563079 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHKeyPath
I0229 18:47:18.563293 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHKeyPath
I0229 18:47:18.563479 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHUsername
I0229 18:47:18.563662 44399 main.go:141] libmachine: Using SSH client type: native
I0229 18:47:18.563827 44399 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.83.214 22 <nil> <nil>}
I0229 18:47:18.563839 44399 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0229 18:47:18.684893 44399 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0229 18:47:18.685033 44399 main.go:141] libmachine: found compatible host: buildroot
I0229 18:47:18.685088 44399 main.go:141] libmachine: Provisioning with buildroot...
I0229 18:47:18.685106 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetMachineName
I0229 18:47:18.685329 44399 buildroot.go:166] provisioning hostname "old-k8s-version-631080"
I0229 18:47:18.685364 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetMachineName
I0229 18:47:18.685505 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHHostname
I0229 18:47:18.688396 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:18.688727 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:old-k8s-version-631080 Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:18.688757 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:18.688831 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHPort
I0229 18:47:18.689033 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHKeyPath
I0229 18:47:18.689194 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHKeyPath
I0229 18:47:18.689320 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHUsername
I0229 18:47:18.689520 44399 main.go:141] libmachine: Using SSH client type: native
I0229 18:47:18.689679 44399 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.83.214 22 <nil> <nil>}
I0229 18:47:18.689690 44399 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-631080 && echo "old-k8s-version-631080" | sudo tee /etc/hostname
I0229 18:47:18.826596 44399 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-631080
I0229 18:47:18.826630 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHHostname
I0229 18:47:18.829407 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:18.829838 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:old-k8s-version-631080 Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:18.829880 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:18.830077 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHPort
I0229 18:47:18.830293 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHKeyPath
I0229 18:47:18.830513 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHKeyPath
I0229 18:47:18.830680 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHUsername
I0229 18:47:18.830942 44399 main.go:141] libmachine: Using SSH client type: native
I0229 18:47:18.831174 44399 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.83.214 22 <nil> <nil>}
I0229 18:47:18.831198 44399 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-631080' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-631080/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-631080' | sudo tee -a /etc/hosts;
fi
fi
I0229 18:47:18.953906 44399 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0229 18:47:18.953936 44399 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18259-6428/.minikube CaCertPath:/home/jenkins/minikube-integration/18259-6428/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18259-6428/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18259-6428/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18259-6428/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18259-6428/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18259-6428/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18259-6428/.minikube}
I0229 18:47:18.953994 44399 buildroot.go:174] setting up certificates
I0229 18:47:18.954012 44399 provision.go:83] configureAuth start
I0229 18:47:18.954031 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetMachineName
I0229 18:47:18.954333 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetIP
I0229 18:47:18.957242 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:18.957560 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:old-k8s-version-631080 Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:18.957588 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:18.957716 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHHostname
I0229 18:47:18.960304 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:18.960631 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:old-k8s-version-631080 Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:18.960659 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:18.960797 44399 provision.go:138] copyHostCerts
I0229 18:47:18.960845 44399 exec_runner.go:144] found /home/jenkins/minikube-integration/18259-6428/.minikube/ca.pem, removing ...
I0229 18:47:18.960861 44399 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18259-6428/.minikube/ca.pem
I0229 18:47:18.960903 44399 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18259-6428/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18259-6428/.minikube/ca.pem (1082 bytes)
I0229 18:47:18.960994 44399 exec_runner.go:144] found /home/jenkins/minikube-integration/18259-6428/.minikube/cert.pem, removing ...
I0229 18:47:18.961001 44399 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18259-6428/.minikube/cert.pem
I0229 18:47:18.961021 44399 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18259-6428/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18259-6428/.minikube/cert.pem (1123 bytes)
I0229 18:47:18.961081 44399 exec_runner.go:144] found /home/jenkins/minikube-integration/18259-6428/.minikube/key.pem, removing ...
I0229 18:47:18.961088 44399 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18259-6428/.minikube/key.pem
I0229 18:47:18.961112 44399 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18259-6428/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18259-6428/.minikube/key.pem (1675 bytes)
I0229 18:47:18.961194 44399 provision.go:112] generating server cert: /home/jenkins/minikube-integration/18259-6428/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18259-6428/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18259-6428/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-631080 san=[192.168.83.214 192.168.83.214 localhost 127.0.0.1 minikube old-k8s-version-631080]
I0229 18:47:19.135550 44399 provision.go:172] copyRemoteCerts
I0229 18:47:19.135634 44399 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0229 18:47:19.135662 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHHostname
I0229 18:47:19.138560 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.138941 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:old-k8s-version-631080 Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:19.138972 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.139225 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHPort
I0229 18:47:19.139414 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHKeyPath
I0229 18:47:19.139616 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHUsername
I0229 18:47:19.139792 44399 sshutil.go:53] new ssh client: &{IP:192.168.83.214 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18259-6428/.minikube/machines/old-k8s-version-631080/id_rsa Username:docker}
I0229 18:47:19.231908 44399 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6428/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0229 18:47:19.264773 44399 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6428/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I0229 18:47:19.298215 44399 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6428/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0229 18:47:19.331349 44399 provision.go:86] duration metric: configureAuth took 377.321285ms
I0229 18:47:19.331380 44399 buildroot.go:189] setting minikube options for container-runtime
I0229 18:47:19.331565 44399 config.go:182] Loaded profile config "old-k8s-version-631080": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0229 18:47:19.331649 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHHostname
I0229 18:47:19.334726 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.335015 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:old-k8s-version-631080 Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:19.335082 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.335285 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHPort
I0229 18:47:19.335487 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHKeyPath
I0229 18:47:19.335675 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHKeyPath
I0229 18:47:19.335852 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHUsername
I0229 18:47:19.336026 44399 main.go:141] libmachine: Using SSH client type: native
I0229 18:47:19.336181 44399 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.83.214 22 <nil> <nil>}
I0229 18:47:19.336198 44399 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0229 18:47:19.672748 44399 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0229 18:47:19.672796 44399 main.go:141] libmachine: Checking connection to Docker...
I0229 18:47:19.672807 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetURL
I0229 18:47:19.674145 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | Using libvirt version 6000000
I0229 18:47:19.676856 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.677213 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:old-k8s-version-631080 Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:19.677245 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.677465 44399 main.go:141] libmachine: Docker is up and running!
I0229 18:47:19.677482 44399 main.go:141] libmachine: Reticulating splines...
I0229 18:47:19.677490 44399 client.go:171] LocalClient.Create took 25.205493908s
I0229 18:47:19.677520 44399 start.go:167] duration metric: libmachine.API.Create for "old-k8s-version-631080" took 25.205561905s
I0229 18:47:19.677553 44399 start.go:300] post-start starting for "old-k8s-version-631080" (driver="kvm2")
I0229 18:47:19.677571 44399 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0229 18:47:19.677606 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .DriverName
I0229 18:47:19.677840 44399 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0229 18:47:19.677880 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHHostname
I0229 18:47:19.680494 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.680953 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:old-k8s-version-631080 Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:19.680982 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.681169 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHPort
I0229 18:47:19.681386 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHKeyPath
I0229 18:47:19.681577 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHUsername
I0229 18:47:19.681774 44399 sshutil.go:53] new ssh client: &{IP:192.168.83.214 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18259-6428/.minikube/machines/old-k8s-version-631080/id_rsa Username:docker}
I0229 18:47:19.774677 44399 ssh_runner.go:195] Run: cat /etc/os-release
I0229 18:47:19.780268 44399 info.go:137] Remote host: Buildroot 2023.02.9
I0229 18:47:19.780305 44399 filesync.go:126] Scanning /home/jenkins/minikube-integration/18259-6428/.minikube/addons for local assets ...
I0229 18:47:19.780372 44399 filesync.go:126] Scanning /home/jenkins/minikube-integration/18259-6428/.minikube/files for local assets ...
I0229 18:47:19.780464 44399 filesync.go:149] local asset: /home/jenkins/minikube-integration/18259-6428/.minikube/files/etc/ssl/certs/136512.pem -> 136512.pem in /etc/ssl/certs
I0229 18:47:19.780560 44399 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0229 18:47:19.793462 44399 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6428/.minikube/files/etc/ssl/certs/136512.pem --> /etc/ssl/certs/136512.pem (1708 bytes)
I0229 18:47:19.827834 44399 start.go:303] post-start completed in 150.26432ms
I0229 18:47:19.827888 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetConfigRaw
I0229 18:47:19.828617 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetIP
I0229 18:47:19.831703 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.832101 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:old-k8s-version-631080 Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:19.832156 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.832447 44399 profile.go:148] Saving config to /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/config.json ...
I0229 18:47:19.832629 44399 start.go:128] duration metric: createHost completed in 25.379025184s
I0229 18:47:19.832655 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHHostname
I0229 18:47:19.835297 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.835694 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:old-k8s-version-631080 Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:19.835724 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.835936 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHPort
I0229 18:47:19.836166 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHKeyPath
I0229 18:47:19.836336 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHKeyPath
I0229 18:47:19.836502 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHUsername
I0229 18:47:19.836727 44399 main.go:141] libmachine: Using SSH client type: native
I0229 18:47:19.836929 44399 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.83.214 22 <nil> <nil>}
I0229 18:47:19.836950 44399 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0229 18:47:19.960285 44399 main.go:141] libmachine: SSH cmd err, output: <nil>: 1709232439.945419352
I0229 18:47:19.960317 44399 fix.go:206] guest clock: 1709232439.945419352
I0229 18:47:19.960326 44399 fix.go:219] Guest: 2024-02-29 18:47:19.945419352 +0000 UTC Remote: 2024-02-29 18:47:19.832640557 +0000 UTC m=+25.510768927 (delta=112.778795ms)
I0229 18:47:19.960359 44399 fix.go:190] guest clock delta is within tolerance: 112.778795ms
I0229 18:47:19.960373 44399 start.go:83] releasing machines lock for "old-k8s-version-631080", held for 25.506866987s
I0229 18:47:19.960402 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .DriverName
I0229 18:47:19.960711 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetIP
I0229 18:47:19.963691 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.964054 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:old-k8s-version-631080 Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:19.964091 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.964269 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .DriverName
I0229 18:47:19.964882 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .DriverName
I0229 18:47:19.965100 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .DriverName
I0229 18:47:19.965195 44399 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0229 18:47:19.965240 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHHostname
I0229 18:47:19.965332 44399 ssh_runner.go:195] Run: cat /version.json
I0229 18:47:19.965358 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHHostname
I0229 18:47:19.967874 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.968255 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.968285 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:old-k8s-version-631080 Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:19.968305 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.968559 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHPort
I0229 18:47:19.968602 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:old-k8s-version-631080 Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:19.968668 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:19.968768 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHKeyPath
I0229 18:47:19.968968 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHPort
I0229 18:47:19.968970 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHUsername
I0229 18:47:19.969139 44399 sshutil.go:53] new ssh client: &{IP:192.168.83.214 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18259-6428/.minikube/machines/old-k8s-version-631080/id_rsa Username:docker}
I0229 18:47:19.969180 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHKeyPath
I0229 18:47:19.969318 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetSSHUsername
I0229 18:47:19.969424 44399 sshutil.go:53] new ssh client: &{IP:192.168.83.214 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18259-6428/.minikube/machines/old-k8s-version-631080/id_rsa Username:docker}
I0229 18:47:20.053589 44399 ssh_runner.go:195] Run: systemctl --version
I0229 18:47:20.077103 44399 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0229 18:47:20.252649 44399 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0229 18:47:20.261187 44399 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0229 18:47:20.261247 44399 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0229 18:47:20.283948 44399 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0229 18:47:20.283971 44399 start.go:475] detecting cgroup driver to use...
I0229 18:47:20.284054 44399 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0229 18:47:20.307439 44399 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0229 18:47:20.323544 44399 docker.go:217] disabling cri-docker service (if available) ...
I0229 18:47:20.323623 44399 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0229 18:47:20.340633 44399 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0229 18:47:20.357816 44399 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0229 18:47:20.500836 44399 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0229 18:47:20.670745 44399 docker.go:233] disabling docker service ...
I0229 18:47:20.670818 44399 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0229 18:47:20.693963 44399 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0229 18:47:20.709322 44399 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0229 18:47:20.857494 44399 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0229 18:47:20.974334 44399 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0229 18:47:20.989627 44399 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0229 18:47:21.011314 44399 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.1" pause image...
I0229 18:47:21.011383 44399 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I0229 18:47:21.023324 44399 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0229 18:47:21.023376 44399 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0229 18:47:21.034944 44399 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0229 18:47:21.047132 44399 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0229 18:47:21.058481 44399 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0229 18:47:21.069981 44399 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0229 18:47:21.080871 44399 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0229 18:47:21.080937 44399 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0229 18:47:21.094616 44399 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0229 18:47:21.104898 44399 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0229 18:47:21.218429 44399 ssh_runner.go:195] Run: sudo systemctl restart crio
I0229 18:47:21.365983 44399 start.go:522] Will wait 60s for socket path /var/run/crio/crio.sock
I0229 18:47:21.366055 44399 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0229 18:47:21.371683 44399 start.go:543] Will wait 60s for crictl version
I0229 18:47:21.371735 44399 ssh_runner.go:195] Run: which crictl
I0229 18:47:21.376150 44399 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0229 18:47:21.411742 44399 start.go:559] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0229 18:47:21.411815 44399 ssh_runner.go:195] Run: crio --version
I0229 18:47:21.445410 44399 ssh_runner.go:195] Run: crio --version
I0229 18:47:21.479306 44399 out.go:177] * Preparing Kubernetes v1.16.0 on CRI-O 1.29.1 ...
I0229 18:47:21.480717 44399 main.go:141] libmachine: (old-k8s-version-631080) Calling .GetIP
I0229 18:47:21.483538 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:21.484275 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1b:b2:7e", ip: ""} in network mk-old-k8s-version-631080: {Iface:virbr4 ExpiryTime:2024-02-29 19:47:10 +0000 UTC Type:0 Mac:52:54:00:1b:b2:7e Iaid: IPaddr:192.168.83.214 Prefix:24 Hostname:old-k8s-version-631080 Clientid:01:52:54:00:1b:b2:7e}
I0229 18:47:21.484313 44399 main.go:141] libmachine: (old-k8s-version-631080) DBG | domain old-k8s-version-631080 has defined IP address 192.168.83.214 and MAC address 52:54:00:1b:b2:7e in network mk-old-k8s-version-631080
I0229 18:47:21.484389 44399 ssh_runner.go:195] Run: grep 192.168.83.1 host.minikube.internal$ /etc/hosts
I0229 18:47:21.489479 44399 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.83.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0229 18:47:21.504264 44399 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
I0229 18:47:21.504323 44399 ssh_runner.go:195] Run: sudo crictl images --output json
I0229 18:47:21.544230 44399 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0229 18:47:21.544292 44399 ssh_runner.go:195] Run: which lz4
I0229 18:47:21.549054 44399 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0229 18:47:21.553913 44399 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0229 18:47:21.553942 44399 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6428/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (441050307 bytes)
I0229 18:47:23.377275 44399 crio.go:444] Took 1.828245 seconds to copy over tarball
I0229 18:47:23.377346 44399 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0229 18:47:26.113551 44399 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.736173489s)
I0229 18:47:26.113586 44399 crio.go:451] Took 2.736285 seconds to extract the tarball
I0229 18:47:26.113598 44399 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0229 18:47:26.159257 44399 ssh_runner.go:195] Run: sudo crictl images --output json
I0229 18:47:26.230903 44399 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0229 18:47:26.230931 44399 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.16.0 registry.k8s.io/kube-controller-manager:v1.16.0 registry.k8s.io/kube-scheduler:v1.16.0 registry.k8s.io/kube-proxy:v1.16.0 registry.k8s.io/pause:3.1 registry.k8s.io/etcd:3.3.15-0 registry.k8s.io/coredns:1.6.2 gcr.io/k8s-minikube/storage-provisioner:v5]
I0229 18:47:26.231011 44399 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0229 18:47:26.231322 44399 image.go:134] retrieving image: registry.k8s.io/etcd:3.3.15-0
I0229 18:47:26.231335 44399 image.go:134] retrieving image: registry.k8s.io/pause:3.1
I0229 18:47:26.231463 44399 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.2
I0229 18:47:26.231522 44399 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 18:47:26.231651 44399 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 18:47:26.231721 44399 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 18:47:26.231836 44399 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.16.0
I0229 18:47:26.233270 44399 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 18:47:26.233322 44399 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.16.0
I0229 18:47:26.233338 44399 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 18:47:26.233270 44399 image.go:177] daemon lookup for registry.k8s.io/etcd:3.3.15-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.3.15-0
I0229 18:47:26.233269 44399 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 18:47:26.233537 44399 image.go:177] daemon lookup for registry.k8s.io/pause:3.1: Error response from daemon: No such image: registry.k8s.io/pause:3.1
I0229 18:47:26.233581 44399 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0229 18:47:26.233604 44399 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.2: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.2
I0229 18:47:26.425313 44399 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.2
I0229 18:47:26.472944 44399 cache_images.go:116] "registry.k8s.io/coredns:1.6.2" needs transfer: "registry.k8s.io/coredns:1.6.2" does not exist at hash "bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b" in container runtime
I0229 18:47:26.472976 44399 cri.go:218] Removing image: registry.k8s.io/coredns:1.6.2
I0229 18:47:26.473012 44399 ssh_runner.go:195] Run: which crictl
I0229 18:47:26.478466 44399 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.6.2
I0229 18:47:26.510985 44399 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.16.0
I0229 18:47:26.512523 44399 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.16.0
I0229 18:47:26.512615 44399 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.16.0
I0229 18:47:26.514955 44399 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.16.0
I0229 18:47:26.517056 44399 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.3.15-0
I0229 18:47:26.518110 44399 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.1
I0229 18:47:26.521570 44399 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6428/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2
I0229 18:47:26.676126 44399 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.16.0" needs transfer: "registry.k8s.io/kube-proxy:v1.16.0" does not exist at hash "c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384" in container runtime
I0229 18:47:26.676160 44399 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.16.0
I0229 18:47:26.676202 44399 ssh_runner.go:195] Run: which crictl
I0229 18:47:26.700309 44399 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.16.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.16.0" does not exist at hash "b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e" in container runtime
I0229 18:47:26.700353 44399 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.16.0
I0229 18:47:26.700407 44399 ssh_runner.go:195] Run: which crictl
I0229 18:47:26.711695 44399 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.16.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.16.0" does not exist at hash "301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a" in container runtime
I0229 18:47:26.711734 44399 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.16.0
I0229 18:47:26.711768 44399 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.16.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.16.0" does not exist at hash "06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d" in container runtime
I0229 18:47:26.711779 44399 ssh_runner.go:195] Run: which crictl
I0229 18:47:26.711810 44399 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.16.0
I0229 18:47:26.711862 44399 ssh_runner.go:195] Run: which crictl
I0229 18:47:26.712901 44399 cache_images.go:116] "registry.k8s.io/etcd:3.3.15-0" needs transfer: "registry.k8s.io/etcd:3.3.15-0" does not exist at hash "b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed" in container runtime
I0229 18:47:26.712937 44399 cri.go:218] Removing image: registry.k8s.io/etcd:3.3.15-0
I0229 18:47:26.712970 44399 ssh_runner.go:195] Run: which crictl
I0229 18:47:26.719226 44399 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.16.0
I0229 18:47:26.719242 44399 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.16.0
I0229 18:47:26.719576 44399 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.16.0
I0229 18:47:26.720853 44399 cache_images.go:116] "registry.k8s.io/pause:3.1" needs transfer: "registry.k8s.io/pause:3.1" does not exist at hash "da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e" in container runtime
I0229 18:47:26.720876 44399 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.16.0
I0229 18:47:26.720880 44399 cri.go:218] Removing image: registry.k8s.io/pause:3.1
I0229 18:47:26.720910 44399 ssh_runner.go:195] Run: which crictl
I0229 18:47:26.726539 44399 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.3.15-0
I0229 18:47:26.861202 44399 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6428/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0
I0229 18:47:26.861239 44399 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6428/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0
I0229 18:47:26.861320 44399 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6428/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0
I0229 18:47:26.861384 44399 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6428/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.16.0
I0229 18:47:26.861423 44399 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.1
I0229 18:47:26.861442 44399 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6428/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.3.15-0
I0229 18:47:26.899807 44399 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18259-6428/.minikube/cache/images/amd64/registry.k8s.io/pause_3.1
I0229 18:47:27.192295 44399 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0229 18:47:27.346152 44399 cache_images.go:92] LoadImages completed in 1.115199635s
W0229 18:47:27.346250 44399 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18259-6428/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18259-6428/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2: no such file or directory
I0229 18:47:27.346330 44399 ssh_runner.go:195] Run: crio config
I0229 18:47:27.415867 44399 cni.go:84] Creating CNI manager for ""
I0229 18:47:27.415890 44399 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0229 18:47:27.415909 44399 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0229 18:47:27.415932 44399 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.83.214 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-631080 NodeName:old-k8s-version-631080 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.83.214"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.83.214 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0229 18:47:27.416083 44399 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.83.214
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-631080"
kubeletExtraArgs:
node-ip: 192.168.83.214
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.83.214"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-631080
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.83.214:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0229 18:47:27.416173 44399 kubeadm.go:976] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-631080 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.83.214
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-631080 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0229 18:47:27.416233 44399 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0229 18:47:27.428417 44399 binaries.go:44] Found k8s binaries, skipping transfer
I0229 18:47:27.428489 44399 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0229 18:47:27.440371 44399 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0229 18:47:27.461663 44399 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0229 18:47:27.481045 44399 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2181 bytes)
I0229 18:47:27.500501 44399 ssh_runner.go:195] Run: grep 192.168.83.214 control-plane.minikube.internal$ /etc/hosts
I0229 18:47:27.505078 44399 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.83.214 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0229 18:47:27.520460 44399 certs.go:56] Setting up /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080 for IP: 192.168.83.214
I0229 18:47:27.520497 44399 certs.go:190] acquiring lock for shared ca certs: {Name:mk3505d2468da66ac20dc3ebf913782cecf1ba0c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:47:27.520650 44399 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/18259-6428/.minikube/ca.key
I0229 18:47:27.520707 44399 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/18259-6428/.minikube/proxy-client-ca.key
I0229 18:47:27.520766 44399 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/client.key
I0229 18:47:27.520784 44399 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/client.crt with IP's: []
I0229 18:47:27.864189 44399 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/client.crt ...
I0229 18:47:27.864218 44399 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/client.crt: {Name:mk8fd53eb0b8d5b17fbea8f891f6884eeff3e169 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:47:27.864375 44399 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/client.key ...
I0229 18:47:27.864388 44399 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/client.key: {Name:mkae5ee58641b4deefdd16ee54eec9cef558c1be Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:47:27.864459 44399 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/apiserver.key.89a58109
I0229 18:47:27.864474 44399 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/apiserver.crt.89a58109 with IP's: [192.168.83.214 10.96.0.1 127.0.0.1 10.0.0.1]
I0229 18:47:27.938293 44399 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/apiserver.crt.89a58109 ...
I0229 18:47:27.938324 44399 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/apiserver.crt.89a58109: {Name:mk03c2e3b7b0f5688b90b82a5d3b6a3e198d646f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:47:27.938503 44399 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/apiserver.key.89a58109 ...
I0229 18:47:27.938539 44399 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/apiserver.key.89a58109: {Name:mkf8eea34d8de97d5d0f70aeb5b2b830c1240c1c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:47:27.938662 44399 certs.go:337] copying /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/apiserver.crt.89a58109 -> /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/apiserver.crt
I0229 18:47:27.938755 44399 certs.go:341] copying /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/apiserver.key.89a58109 -> /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/apiserver.key
I0229 18:47:27.938834 44399 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/proxy-client.key
I0229 18:47:27.938856 44399 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/proxy-client.crt with IP's: []
I0229 18:47:28.153554 44399 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/proxy-client.crt ...
I0229 18:47:28.153585 44399 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/proxy-client.crt: {Name:mkef1cb59c0851a60f74685c02d6c4b49a29cffd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:47:28.153758 44399 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/proxy-client.key ...
I0229 18:47:28.153775 44399 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/proxy-client.key: {Name:mk4c5236bac24ddb7c6a48fbc9c96d9664cc4ed7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0229 18:47:28.153996 44399 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6428/.minikube/certs/home/jenkins/minikube-integration/18259-6428/.minikube/certs/13651.pem (1338 bytes)
W0229 18:47:28.154048 44399 certs.go:433] ignoring /home/jenkins/minikube-integration/18259-6428/.minikube/certs/home/jenkins/minikube-integration/18259-6428/.minikube/certs/13651_empty.pem, impossibly tiny 0 bytes
I0229 18:47:28.154064 44399 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6428/.minikube/certs/home/jenkins/minikube-integration/18259-6428/.minikube/certs/ca-key.pem (1675 bytes)
I0229 18:47:28.154094 44399 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6428/.minikube/certs/home/jenkins/minikube-integration/18259-6428/.minikube/certs/ca.pem (1082 bytes)
I0229 18:47:28.154134 44399 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6428/.minikube/certs/home/jenkins/minikube-integration/18259-6428/.minikube/certs/cert.pem (1123 bytes)
I0229 18:47:28.154168 44399 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6428/.minikube/certs/home/jenkins/minikube-integration/18259-6428/.minikube/certs/key.pem (1675 bytes)
I0229 18:47:28.154226 44399 certs.go:437] found cert: /home/jenkins/minikube-integration/18259-6428/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/18259-6428/.minikube/files/etc/ssl/certs/136512.pem (1708 bytes)
I0229 18:47:28.154826 44399 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0229 18:47:28.186389 44399 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0229 18:47:28.215574 44399 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0229 18:47:28.245800 44399 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6428/.minikube/profiles/old-k8s-version-631080/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0229 18:47:28.303841 44399 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6428/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0229 18:47:28.335355 44399 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6428/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0229 18:47:28.363388 44399 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6428/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0229 18:47:28.393630 44399 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6428/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0229 18:47:28.423875 44399 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6428/.minikube/certs/13651.pem --> /usr/share/ca-certificates/13651.pem (1338 bytes)
I0229 18:47:28.454377 44399 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6428/.minikube/files/etc/ssl/certs/136512.pem --> /usr/share/ca-certificates/136512.pem (1708 bytes)
I0229 18:47:28.483445 44399 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18259-6428/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0229 18:47:28.511360 44399 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0229 18:47:28.530599 44399 ssh_runner.go:195] Run: openssl version
I0229 18:47:28.537246 44399 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0229 18:47:28.549806 44399 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0229 18:47:28.555377 44399 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Feb 29 17:40 /usr/share/ca-certificates/minikubeCA.pem
I0229 18:47:28.555437 44399 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0229 18:47:28.563093 44399 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0229 18:47:28.578569 44399 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/13651.pem && ln -fs /usr/share/ca-certificates/13651.pem /etc/ssl/certs/13651.pem"
I0229 18:47:28.593874 44399 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/13651.pem
I0229 18:47:28.600519 44399 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Feb 29 17:49 /usr/share/ca-certificates/13651.pem
I0229 18:47:28.600560 44399 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/13651.pem
I0229 18:47:28.607700 44399 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/13651.pem /etc/ssl/certs/51391683.0"
I0229 18:47:28.623722 44399 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/136512.pem && ln -fs /usr/share/ca-certificates/136512.pem /etc/ssl/certs/136512.pem"
I0229 18:47:28.636281 44399 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/136512.pem
I0229 18:47:28.641592 44399 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Feb 29 17:49 /usr/share/ca-certificates/136512.pem
I0229 18:47:28.641642 44399 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/136512.pem
I0229 18:47:28.649008 44399 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/136512.pem /etc/ssl/certs/3ec20f2e.0"
I0229 18:47:28.661558 44399 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I0229 18:47:28.666198 44399 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
I0229 18:47:28.666249 44399 kubeadm.go:404] StartCluster: {Name:old-k8s-version-631080 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVe
rsion:v1.16.0 ClusterName:old-k8s-version-631080 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.83.214 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0229 18:47:28.666317 44399 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0229 18:47:28.666358 44399 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0229 18:47:28.716681 44399 cri.go:89] found id: ""
I0229 18:47:28.716742 44399 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0229 18:47:28.728300 44399 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0229 18:47:28.739080 44399 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0229 18:47:28.749442 44399 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0229 18:47:28.749488 44399 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0229 18:47:28.881883 44399 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0229 18:47:28.881987 44399 kubeadm.go:322] [preflight] Running pre-flight checks
I0229 18:47:29.160390 44399 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0229 18:47:29.160580 44399 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0229 18:47:29.160724 44399 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0229 18:47:29.448897 44399 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0229 18:47:29.451654 44399 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0229 18:47:29.462589 44399 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0229 18:47:29.601848 44399 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0229 18:47:29.603554 44399 out.go:204] - Generating certificates and keys ...
I0229 18:47:29.603696 44399 kubeadm.go:322] [certs] Using existing ca certificate authority
I0229 18:47:29.603821 44399 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0229 18:47:29.908358 44399 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I0229 18:47:30.012736 44399 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I0229 18:47:30.271926 44399 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I0229 18:47:30.387535 44399 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I0229 18:47:30.445345 44399 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I0229 18:47:30.445529 44399 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [old-k8s-version-631080 localhost] and IPs [192.168.83.214 127.0.0.1 ::1]
I0229 18:47:30.689130 44399 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I0229 18:47:30.689407 44399 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-631080 localhost] and IPs [192.168.83.214 127.0.0.1 ::1]
I0229 18:47:30.818464 44399 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I0229 18:47:31.124163 44399 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I0229 18:47:31.324195 44399 kubeadm.go:322] [certs] Generating "sa" key and public key
I0229 18:47:31.324565 44399 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0229 18:47:31.499366 44399 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0229 18:47:31.728125 44399 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0229 18:47:31.948091 44399 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0229 18:47:32.121471 44399 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0229 18:47:32.122506 44399 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0229 18:47:32.124299 44399 out.go:204] - Booting up control plane ...
I0229 18:47:32.124427 44399 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0229 18:47:32.131277 44399 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0229 18:47:32.132287 44399 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0229 18:47:32.135893 44399 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0229 18:47:32.141145 44399 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0229 18:48:12.139145 44399 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0229 18:48:12.140170 44399 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:48:12.140356 44399 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:48:17.141006 44399 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:48:17.141314 44399 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:48:27.141887 44399 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:48:27.142197 44399 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:48:47.143034 44399 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:48:47.143289 44399 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:49:27.143225 44399 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:49:27.143506 44399 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:49:27.143530 44399 kubeadm.go:322]
I0229 18:49:27.143566 44399 kubeadm.go:322] Unfortunately, an error has occurred:
I0229 18:49:27.143598 44399 kubeadm.go:322] timed out waiting for the condition
I0229 18:49:27.143607 44399 kubeadm.go:322]
I0229 18:49:27.143651 44399 kubeadm.go:322] This error is likely caused by:
I0229 18:49:27.143699 44399 kubeadm.go:322] - The kubelet is not running
I0229 18:49:27.143829 44399 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0229 18:49:27.143838 44399 kubeadm.go:322]
I0229 18:49:27.143945 44399 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0229 18:49:27.144032 44399 kubeadm.go:322] - 'systemctl status kubelet'
I0229 18:49:27.144090 44399 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0229 18:49:27.144101 44399 kubeadm.go:322]
I0229 18:49:27.144259 44399 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0229 18:49:27.144397 44399 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0229 18:49:27.144519 44399 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0229 18:49:27.144591 44399 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0229 18:49:27.144703 44399 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0229 18:49:27.144754 44399 kubeadm.go:322] - 'docker logs CONTAINERID'
I0229 18:49:27.145247 44399 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0229 18:49:27.145372 44399 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0229 18:49:27.145459 44399 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
W0229 18:49:27.145630 44399 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-631080 localhost] and IPs [192.168.83.214 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-631080 localhost] and IPs [192.168.83.214 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [old-k8s-version-631080 localhost] and IPs [192.168.83.214 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-631080 localhost] and IPs [192.168.83.214 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0229 18:49:27.145697 44399 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0229 18:49:27.618942 44399 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0229 18:49:27.637677 44399 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0229 18:49:27.648309 44399 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0229 18:49:27.648370 44399 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0229 18:49:27.846736 44399 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0229 18:51:24.204624 44399 kubeadm.go:322] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0229 18:51:24.204745 44399 kubeadm.go:322] To see the stack trace of this error execute with --v=5 or higher
I0229 18:51:24.206345 44399 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0229 18:51:24.206421 44399 kubeadm.go:322] [preflight] Running pre-flight checks
I0229 18:51:24.206524 44399 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0229 18:51:24.206665 44399 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0229 18:51:24.206791 44399 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0229 18:51:24.206878 44399 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0229 18:51:24.207005 44399 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0229 18:51:24.207093 44399 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0229 18:51:24.207196 44399 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0229 18:51:24.209099 44399 out.go:204] - Generating certificates and keys ...
I0229 18:51:24.209178 44399 kubeadm.go:322] [certs] Using existing ca certificate authority
I0229 18:51:24.209233 44399 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0229 18:51:24.209315 44399 kubeadm.go:322] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0229 18:51:24.209384 44399 kubeadm.go:322] [certs] Using existing front-proxy-ca certificate authority
I0229 18:51:24.209489 44399 kubeadm.go:322] [certs] Using existing front-proxy-client certificate and key on disk
I0229 18:51:24.209584 44399 kubeadm.go:322] [certs] Using existing etcd/ca certificate authority
I0229 18:51:24.209684 44399 kubeadm.go:322] [certs] Using existing etcd/server certificate and key on disk
I0229 18:51:24.209756 44399 kubeadm.go:322] [certs] Using existing etcd/peer certificate and key on disk
I0229 18:51:24.209840 44399 kubeadm.go:322] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0229 18:51:24.209931 44399 kubeadm.go:322] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0229 18:51:24.209991 44399 kubeadm.go:322] [certs] Using the existing "sa" key
I0229 18:51:24.210080 44399 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0229 18:51:24.210152 44399 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0229 18:51:24.210197 44399 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0229 18:51:24.210255 44399 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0229 18:51:24.210305 44399 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0229 18:51:24.210364 44399 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0229 18:51:24.212074 44399 out.go:204] - Booting up control plane ...
I0229 18:51:24.212147 44399 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0229 18:51:24.212236 44399 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0229 18:51:24.212308 44399 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0229 18:51:24.212383 44399 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0229 18:51:24.212584 44399 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0229 18:51:24.212652 44399 kubeadm.go:322] [kubelet-check] Initial timeout of 40s passed.
I0229 18:51:24.212714 44399 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:51:24.212863 44399 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:51:24.212940 44399 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:51:24.213160 44399 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:51:24.213220 44399 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:51:24.213414 44399 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:51:24.213497 44399 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:51:24.213695 44399 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:51:24.213762 44399 kubeadm.go:322] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0229 18:51:24.213977 44399 kubeadm.go:322] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
I0229 18:51:24.213988 44399 kubeadm.go:322]
I0229 18:51:24.214046 44399 kubeadm.go:322] Unfortunately, an error has occurred:
I0229 18:51:24.214097 44399 kubeadm.go:322] timed out waiting for the condition
I0229 18:51:24.214107 44399 kubeadm.go:322]
I0229 18:51:24.214152 44399 kubeadm.go:322] This error is likely caused by:
I0229 18:51:24.214180 44399 kubeadm.go:322] - The kubelet is not running
I0229 18:51:24.214262 44399 kubeadm.go:322] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0229 18:51:24.214272 44399 kubeadm.go:322]
I0229 18:51:24.214352 44399 kubeadm.go:322] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0229 18:51:24.214379 44399 kubeadm.go:322] - 'systemctl status kubelet'
I0229 18:51:24.214407 44399 kubeadm.go:322] - 'journalctl -xeu kubelet'
I0229 18:51:24.214424 44399 kubeadm.go:322]
I0229 18:51:24.214506 44399 kubeadm.go:322] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0229 18:51:24.214585 44399 kubeadm.go:322] To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
I0229 18:51:24.214665 44399 kubeadm.go:322] Here is one example how you may list all Kubernetes containers running in docker:
I0229 18:51:24.214707 44399 kubeadm.go:322] - 'docker ps -a | grep kube | grep -v pause'
I0229 18:51:24.214766 44399 kubeadm.go:322] Once you have found the failing container, you can inspect its logs with:
I0229 18:51:24.214875 44399 kubeadm.go:322] - 'docker logs CONTAINERID'
I0229 18:51:24.214873 44399 kubeadm.go:406] StartCluster complete in 3m55.548634983s
I0229 18:51:24.214926 44399 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0229 18:51:24.214976 44399 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0229 18:51:24.258872 44399 cri.go:89] found id: ""
I0229 18:51:24.258900 44399 logs.go:276] 0 containers: []
W0229 18:51:24.258911 44399 logs.go:278] No container was found matching "kube-apiserver"
I0229 18:51:24.258919 44399 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0229 18:51:24.258983 44399 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0229 18:51:24.295492 44399 cri.go:89] found id: ""
I0229 18:51:24.295521 44399 logs.go:276] 0 containers: []
W0229 18:51:24.295532 44399 logs.go:278] No container was found matching "etcd"
I0229 18:51:24.295539 44399 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0229 18:51:24.295601 44399 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0229 18:51:24.334265 44399 cri.go:89] found id: ""
I0229 18:51:24.334290 44399 logs.go:276] 0 containers: []
W0229 18:51:24.334298 44399 logs.go:278] No container was found matching "coredns"
I0229 18:51:24.334303 44399 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0229 18:51:24.334346 44399 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0229 18:51:24.378919 44399 cri.go:89] found id: ""
I0229 18:51:24.378972 44399 logs.go:276] 0 containers: []
W0229 18:51:24.378992 44399 logs.go:278] No container was found matching "kube-scheduler"
I0229 18:51:24.379005 44399 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0229 18:51:24.379116 44399 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0229 18:51:24.443896 44399 cri.go:89] found id: ""
I0229 18:51:24.443929 44399 logs.go:276] 0 containers: []
W0229 18:51:24.443938 44399 logs.go:278] No container was found matching "kube-proxy"
I0229 18:51:24.443945 44399 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0229 18:51:24.443996 44399 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0229 18:51:24.478625 44399 cri.go:89] found id: ""
I0229 18:51:24.478658 44399 logs.go:276] 0 containers: []
W0229 18:51:24.478666 44399 logs.go:278] No container was found matching "kube-controller-manager"
I0229 18:51:24.478672 44399 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0229 18:51:24.478721 44399 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0229 18:51:24.514693 44399 cri.go:89] found id: ""
I0229 18:51:24.514723 44399 logs.go:276] 0 containers: []
W0229 18:51:24.514742 44399 logs.go:278] No container was found matching "kindnet"
I0229 18:51:24.514754 44399 logs.go:123] Gathering logs for kubelet ...
I0229 18:51:24.514774 44399 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0229 18:51:24.561120 44399 logs.go:123] Gathering logs for dmesg ...
I0229 18:51:24.561153 44399 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0229 18:51:24.576352 44399 logs.go:123] Gathering logs for describe nodes ...
I0229 18:51:24.576376 44399 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0229 18:51:24.701431 44399 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0229 18:51:24.701459 44399 logs.go:123] Gathering logs for CRI-O ...
I0229 18:51:24.701478 44399 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0229 18:51:24.792147 44399 logs.go:123] Gathering logs for container status ...
I0229 18:51:24.792181 44399 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0229 18:51:24.841631 44399 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 18:51:24.841681 44399 out.go:239] *
*
W0229 18:51:24.841744 44399 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 18:51:24.841777 44399 out.go:239] *
*
W0229 18:51:24.842682 44399 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0229 18:51:24.845886 44399 out.go:177]
W0229 18:51:24.847610 44399 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.16.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Activating the kubelet service
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI, e.g. docker.
Here is one example how you may list all Kubernetes containers running in docker:
- 'docker ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'docker logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0229 18:51:24.847659 44399 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0229 18:51:24.847681 44399 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0229 18:51:24.849300 44399 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-631080 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.16.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-631080 -n old-k8s-version-631080
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-631080 -n old-k8s-version-631080: exit status 6 (254.384339ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0229 18:51:25.138058 47039 status.go:415] kubeconfig endpoint: extract IP: "old-k8s-version-631080" does not appear in /home/jenkins/minikube-integration/18259-6428/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-631080" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (270.84s)