=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-386663 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
E0729 18:16:52.902490 18393 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/functional-419822/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-386663 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m42.961375615s)
-- stdout --
* [old-k8s-version-386663] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19345
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19345-11206/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19345-11206/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-386663" primary control-plane node in "old-k8s-version-386663" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0729 18:16:25.824709 70090 out.go:291] Setting OutFile to fd 1 ...
I0729 18:16:25.824955 70090 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 18:16:25.824968 70090 out.go:304] Setting ErrFile to fd 2...
I0729 18:16:25.824976 70090 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 18:16:25.825481 70090 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19345-11206/.minikube/bin
I0729 18:16:25.826479 70090 out.go:298] Setting JSON to false
I0729 18:16:25.827701 70090 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":7138,"bootTime":1722269848,"procs":309,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0729 18:16:25.827762 70090 start.go:139] virtualization: kvm guest
I0729 18:16:25.829510 70090 out.go:177] * [old-k8s-version-386663] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0729 18:16:25.831099 70090 notify.go:220] Checking for updates...
I0729 18:16:25.831111 70090 out.go:177] - MINIKUBE_LOCATION=19345
I0729 18:16:25.832384 70090 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0729 18:16:25.833845 70090 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19345-11206/kubeconfig
I0729 18:16:25.835211 70090 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19345-11206/.minikube
I0729 18:16:25.836387 70090 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0729 18:16:25.837531 70090 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0729 18:16:25.839232 70090 config.go:182] Loaded profile config "bridge-729010": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0729 18:16:25.839380 70090 config.go:182] Loaded profile config "enable-default-cni-729010": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0729 18:16:25.839497 70090 config.go:182] Loaded profile config "flannel-729010": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0729 18:16:25.839656 70090 driver.go:392] Setting default libvirt URI to qemu:///system
I0729 18:16:25.877300 70090 out.go:177] * Using the kvm2 driver based on user configuration
I0729 18:16:25.878422 70090 start.go:297] selected driver: kvm2
I0729 18:16:25.878439 70090 start.go:901] validating driver "kvm2" against <nil>
I0729 18:16:25.878452 70090 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0729 18:16:25.879155 70090 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0729 18:16:25.879235 70090 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19345-11206/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0729 18:16:25.894561 70090 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0729 18:16:25.894614 70090 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0729 18:16:25.894833 70090 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0729 18:16:25.894894 70090 cni.go:84] Creating CNI manager for ""
I0729 18:16:25.894912 70090 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0729 18:16:25.894925 70090 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0729 18:16:25.894987 70090 start.go:340] cluster config:
{Name:old-k8s-version-386663 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-386663 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0729 18:16:25.895097 70090 iso.go:125] acquiring lock: {Name:mke302f851ce8256f9b44dd080ed38df68285cd5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0729 18:16:25.896665 70090 out.go:177] * Starting "old-k8s-version-386663" primary control-plane node in "old-k8s-version-386663" cluster
I0729 18:16:25.898185 70090 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0729 18:16:25.898217 70090 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19345-11206/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0729 18:16:25.898228 70090 cache.go:56] Caching tarball of preloaded images
I0729 18:16:25.898321 70090 preload.go:172] Found /home/jenkins/minikube-integration/19345-11206/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0729 18:16:25.898333 70090 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0729 18:16:25.898445 70090 profile.go:143] Saving config to /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/config.json ...
I0729 18:16:25.898469 70090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/config.json: {Name:mk92e91f8399ba5b0a8bf97660beb037c51b9dc2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 18:16:25.898607 70090 start.go:360] acquireMachinesLock for old-k8s-version-386663: {Name:mke21c1c79cc7915e3f7595726f3952a8aaf5204 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0729 18:16:37.051365 70090 start.go:364] duration metric: took 11.152734377s to acquireMachinesLock for "old-k8s-version-386663"
I0729 18:16:37.051452 70090 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-386663 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19319/minikube-v1.33.1-1721690939-19319-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-386663 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0729 18:16:37.051580 70090 start.go:125] createHost starting for "" (driver="kvm2")
I0729 18:16:37.053764 70090 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0729 18:16:37.053985 70090 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0729 18:16:37.054034 70090 main.go:141] libmachine: Launching plugin server for driver kvm2
I0729 18:16:37.070432 70090 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42255
I0729 18:16:37.070901 70090 main.go:141] libmachine: () Calling .GetVersion
I0729 18:16:37.071462 70090 main.go:141] libmachine: Using API Version 1
I0729 18:16:37.071484 70090 main.go:141] libmachine: () Calling .SetConfigRaw
I0729 18:16:37.071851 70090 main.go:141] libmachine: () Calling .GetMachineName
I0729 18:16:37.072056 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetMachineName
I0729 18:16:37.072220 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .DriverName
I0729 18:16:37.072389 70090 start.go:159] libmachine.API.Create for "old-k8s-version-386663" (driver="kvm2")
I0729 18:16:37.072418 70090 client.go:168] LocalClient.Create starting
I0729 18:16:37.072459 70090 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19345-11206/.minikube/certs/ca.pem
I0729 18:16:37.072500 70090 main.go:141] libmachine: Decoding PEM data...
I0729 18:16:37.072524 70090 main.go:141] libmachine: Parsing certificate...
I0729 18:16:37.072608 70090 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19345-11206/.minikube/certs/cert.pem
I0729 18:16:37.072635 70090 main.go:141] libmachine: Decoding PEM data...
I0729 18:16:37.072649 70090 main.go:141] libmachine: Parsing certificate...
I0729 18:16:37.072664 70090 main.go:141] libmachine: Running pre-create checks...
I0729 18:16:37.072674 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .PreCreateCheck
I0729 18:16:37.073059 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetConfigRaw
I0729 18:16:37.073479 70090 main.go:141] libmachine: Creating machine...
I0729 18:16:37.073492 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .Create
I0729 18:16:37.073612 70090 main.go:141] libmachine: (old-k8s-version-386663) Creating KVM machine...
I0729 18:16:37.074658 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found existing default KVM network
I0729 18:16:37.075971 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:37.075798 70173 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:ca:a4:44} reservation:<nil>}
I0729 18:16:37.076987 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:37.076906 70173 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0003500b0}
I0729 18:16:37.077011 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | created network xml:
I0729 18:16:37.077022 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | <network>
I0729 18:16:37.077032 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | <name>mk-old-k8s-version-386663</name>
I0729 18:16:37.077041 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | <dns enable='no'/>
I0729 18:16:37.077047 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG |
I0729 18:16:37.077058 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0729 18:16:37.077067 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | <dhcp>
I0729 18:16:37.077082 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0729 18:16:37.077098 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | </dhcp>
I0729 18:16:37.077109 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | </ip>
I0729 18:16:37.077120 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG |
I0729 18:16:37.077127 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | </network>
I0729 18:16:37.077141 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG |
I0729 18:16:37.082437 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | trying to create private KVM network mk-old-k8s-version-386663 192.168.50.0/24...
I0729 18:16:37.155168 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | private KVM network mk-old-k8s-version-386663 192.168.50.0/24 created
I0729 18:16:37.155210 70090 main.go:141] libmachine: (old-k8s-version-386663) Setting up store path in /home/jenkins/minikube-integration/19345-11206/.minikube/machines/old-k8s-version-386663 ...
I0729 18:16:37.155226 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:37.155173 70173 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19345-11206/.minikube
I0729 18:16:37.155249 70090 main.go:141] libmachine: (old-k8s-version-386663) Building disk image from file:///home/jenkins/minikube-integration/19345-11206/.minikube/cache/iso/amd64/minikube-v1.33.1-1721690939-19319-amd64.iso
I0729 18:16:37.155315 70090 main.go:141] libmachine: (old-k8s-version-386663) Downloading /home/jenkins/minikube-integration/19345-11206/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19345-11206/.minikube/cache/iso/amd64/minikube-v1.33.1-1721690939-19319-amd64.iso...
I0729 18:16:37.416038 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:37.415927 70173 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19345-11206/.minikube/machines/old-k8s-version-386663/id_rsa...
I0729 18:16:37.516087 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:37.515980 70173 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19345-11206/.minikube/machines/old-k8s-version-386663/old-k8s-version-386663.rawdisk...
I0729 18:16:37.516125 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | Writing magic tar header
I0729 18:16:37.516144 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | Writing SSH key tar header
I0729 18:16:37.516158 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:37.516109 70173 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19345-11206/.minikube/machines/old-k8s-version-386663 ...
I0729 18:16:37.516266 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19345-11206/.minikube/machines/old-k8s-version-386663
I0729 18:16:37.516289 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19345-11206/.minikube/machines
I0729 18:16:37.516304 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19345-11206/.minikube
I0729 18:16:37.516315 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19345-11206
I0729 18:16:37.516331 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0729 18:16:37.516342 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | Checking permissions on dir: /home/jenkins
I0729 18:16:37.516356 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | Checking permissions on dir: /home
I0729 18:16:37.516367 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | Skipping /home - not owner
I0729 18:16:37.516419 70090 main.go:141] libmachine: (old-k8s-version-386663) Setting executable bit set on /home/jenkins/minikube-integration/19345-11206/.minikube/machines/old-k8s-version-386663 (perms=drwx------)
I0729 18:16:37.516443 70090 main.go:141] libmachine: (old-k8s-version-386663) Setting executable bit set on /home/jenkins/minikube-integration/19345-11206/.minikube/machines (perms=drwxr-xr-x)
I0729 18:16:37.516459 70090 main.go:141] libmachine: (old-k8s-version-386663) Setting executable bit set on /home/jenkins/minikube-integration/19345-11206/.minikube (perms=drwxr-xr-x)
I0729 18:16:37.516474 70090 main.go:141] libmachine: (old-k8s-version-386663) Setting executable bit set on /home/jenkins/minikube-integration/19345-11206 (perms=drwxrwxr-x)
I0729 18:16:37.516486 70090 main.go:141] libmachine: (old-k8s-version-386663) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0729 18:16:37.516497 70090 main.go:141] libmachine: (old-k8s-version-386663) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0729 18:16:37.516507 70090 main.go:141] libmachine: (old-k8s-version-386663) Creating domain...
I0729 18:16:37.518455 70090 main.go:141] libmachine: (old-k8s-version-386663) define libvirt domain using xml:
I0729 18:16:37.518480 70090 main.go:141] libmachine: (old-k8s-version-386663) <domain type='kvm'>
I0729 18:16:37.518493 70090 main.go:141] libmachine: (old-k8s-version-386663) <name>old-k8s-version-386663</name>
I0729 18:16:37.518506 70090 main.go:141] libmachine: (old-k8s-version-386663) <memory unit='MiB'>2200</memory>
I0729 18:16:37.518516 70090 main.go:141] libmachine: (old-k8s-version-386663) <vcpu>2</vcpu>
I0729 18:16:37.518524 70090 main.go:141] libmachine: (old-k8s-version-386663) <features>
I0729 18:16:37.518537 70090 main.go:141] libmachine: (old-k8s-version-386663) <acpi/>
I0729 18:16:37.518544 70090 main.go:141] libmachine: (old-k8s-version-386663) <apic/>
I0729 18:16:37.518557 70090 main.go:141] libmachine: (old-k8s-version-386663) <pae/>
I0729 18:16:37.518567 70090 main.go:141] libmachine: (old-k8s-version-386663)
I0729 18:16:37.518576 70090 main.go:141] libmachine: (old-k8s-version-386663) </features>
I0729 18:16:37.518587 70090 main.go:141] libmachine: (old-k8s-version-386663) <cpu mode='host-passthrough'>
I0729 18:16:37.518619 70090 main.go:141] libmachine: (old-k8s-version-386663)
I0729 18:16:37.518644 70090 main.go:141] libmachine: (old-k8s-version-386663) </cpu>
I0729 18:16:37.518656 70090 main.go:141] libmachine: (old-k8s-version-386663) <os>
I0729 18:16:37.518667 70090 main.go:141] libmachine: (old-k8s-version-386663) <type>hvm</type>
I0729 18:16:37.518684 70090 main.go:141] libmachine: (old-k8s-version-386663) <boot dev='cdrom'/>
I0729 18:16:37.518694 70090 main.go:141] libmachine: (old-k8s-version-386663) <boot dev='hd'/>
I0729 18:16:37.518714 70090 main.go:141] libmachine: (old-k8s-version-386663) <bootmenu enable='no'/>
I0729 18:16:37.518724 70090 main.go:141] libmachine: (old-k8s-version-386663) </os>
I0729 18:16:37.518742 70090 main.go:141] libmachine: (old-k8s-version-386663) <devices>
I0729 18:16:37.518760 70090 main.go:141] libmachine: (old-k8s-version-386663) <disk type='file' device='cdrom'>
I0729 18:16:37.518777 70090 main.go:141] libmachine: (old-k8s-version-386663) <source file='/home/jenkins/minikube-integration/19345-11206/.minikube/machines/old-k8s-version-386663/boot2docker.iso'/>
I0729 18:16:37.518788 70090 main.go:141] libmachine: (old-k8s-version-386663) <target dev='hdc' bus='scsi'/>
I0729 18:16:37.518801 70090 main.go:141] libmachine: (old-k8s-version-386663) <readonly/>
I0729 18:16:37.518814 70090 main.go:141] libmachine: (old-k8s-version-386663) </disk>
I0729 18:16:37.518828 70090 main.go:141] libmachine: (old-k8s-version-386663) <disk type='file' device='disk'>
I0729 18:16:37.518840 70090 main.go:141] libmachine: (old-k8s-version-386663) <driver name='qemu' type='raw' cache='default' io='threads' />
I0729 18:16:37.518891 70090 main.go:141] libmachine: (old-k8s-version-386663) <source file='/home/jenkins/minikube-integration/19345-11206/.minikube/machines/old-k8s-version-386663/old-k8s-version-386663.rawdisk'/>
I0729 18:16:37.518910 70090 main.go:141] libmachine: (old-k8s-version-386663) <target dev='hda' bus='virtio'/>
I0729 18:16:37.518924 70090 main.go:141] libmachine: (old-k8s-version-386663) </disk>
I0729 18:16:37.518935 70090 main.go:141] libmachine: (old-k8s-version-386663) <interface type='network'>
I0729 18:16:37.518947 70090 main.go:141] libmachine: (old-k8s-version-386663) <source network='mk-old-k8s-version-386663'/>
I0729 18:16:37.518957 70090 main.go:141] libmachine: (old-k8s-version-386663) <model type='virtio'/>
I0729 18:16:37.518967 70090 main.go:141] libmachine: (old-k8s-version-386663) </interface>
I0729 18:16:37.518979 70090 main.go:141] libmachine: (old-k8s-version-386663) <interface type='network'>
I0729 18:16:37.519002 70090 main.go:141] libmachine: (old-k8s-version-386663) <source network='default'/>
I0729 18:16:37.519017 70090 main.go:141] libmachine: (old-k8s-version-386663) <model type='virtio'/>
I0729 18:16:37.519029 70090 main.go:141] libmachine: (old-k8s-version-386663) </interface>
I0729 18:16:37.519040 70090 main.go:141] libmachine: (old-k8s-version-386663) <serial type='pty'>
I0729 18:16:37.519053 70090 main.go:141] libmachine: (old-k8s-version-386663) <target port='0'/>
I0729 18:16:37.519064 70090 main.go:141] libmachine: (old-k8s-version-386663) </serial>
I0729 18:16:37.519075 70090 main.go:141] libmachine: (old-k8s-version-386663) <console type='pty'>
I0729 18:16:37.519083 70090 main.go:141] libmachine: (old-k8s-version-386663) <target type='serial' port='0'/>
I0729 18:16:37.519093 70090 main.go:141] libmachine: (old-k8s-version-386663) </console>
I0729 18:16:37.519106 70090 main.go:141] libmachine: (old-k8s-version-386663) <rng model='virtio'>
I0729 18:16:37.519119 70090 main.go:141] libmachine: (old-k8s-version-386663) <backend model='random'>/dev/random</backend>
I0729 18:16:37.519127 70090 main.go:141] libmachine: (old-k8s-version-386663) </rng>
I0729 18:16:37.519139 70090 main.go:141] libmachine: (old-k8s-version-386663)
I0729 18:16:37.519149 70090 main.go:141] libmachine: (old-k8s-version-386663)
I0729 18:16:37.519161 70090 main.go:141] libmachine: (old-k8s-version-386663) </devices>
I0729 18:16:37.519177 70090 main.go:141] libmachine: (old-k8s-version-386663) </domain>
I0729 18:16:37.519203 70090 main.go:141] libmachine: (old-k8s-version-386663)
I0729 18:16:37.523395 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:47:22:1b in network default
I0729 18:16:37.524164 70090 main.go:141] libmachine: (old-k8s-version-386663) Ensuring networks are active...
I0729 18:16:37.524182 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:16:37.524938 70090 main.go:141] libmachine: (old-k8s-version-386663) Ensuring network default is active
I0729 18:16:37.525257 70090 main.go:141] libmachine: (old-k8s-version-386663) Ensuring network mk-old-k8s-version-386663 is active
I0729 18:16:37.525959 70090 main.go:141] libmachine: (old-k8s-version-386663) Getting domain xml...
I0729 18:16:37.526846 70090 main.go:141] libmachine: (old-k8s-version-386663) Creating domain...
I0729 18:16:38.899194 70090 main.go:141] libmachine: (old-k8s-version-386663) Waiting to get IP...
I0729 18:16:38.900476 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:16:38.901359 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | unable to find current IP address of domain old-k8s-version-386663 in network mk-old-k8s-version-386663
I0729 18:16:38.901517 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:38.901433 70173 retry.go:31] will retry after 249.446166ms: waiting for machine to come up
I0729 18:16:39.152925 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:16:39.153540 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | unable to find current IP address of domain old-k8s-version-386663 in network mk-old-k8s-version-386663
I0729 18:16:39.153568 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:39.153463 70173 retry.go:31] will retry after 334.775688ms: waiting for machine to come up
I0729 18:16:39.489823 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:16:39.490437 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | unable to find current IP address of domain old-k8s-version-386663 in network mk-old-k8s-version-386663
I0729 18:16:39.490461 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:39.490373 70173 retry.go:31] will retry after 457.892328ms: waiting for machine to come up
I0729 18:16:39.949848 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:16:39.950425 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | unable to find current IP address of domain old-k8s-version-386663 in network mk-old-k8s-version-386663
I0729 18:16:39.950453 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:39.950397 70173 retry.go:31] will retry after 492.438924ms: waiting for machine to come up
I0729 18:16:40.444775 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:16:40.445146 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | unable to find current IP address of domain old-k8s-version-386663 in network mk-old-k8s-version-386663
I0729 18:16:40.445174 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:40.445100 70173 retry.go:31] will retry after 531.282132ms: waiting for machine to come up
I0729 18:16:40.977796 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:16:40.978267 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | unable to find current IP address of domain old-k8s-version-386663 in network mk-old-k8s-version-386663
I0729 18:16:40.978288 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:40.978237 70173 retry.go:31] will retry after 827.282459ms: waiting for machine to come up
I0729 18:16:41.807224 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:16:41.807801 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | unable to find current IP address of domain old-k8s-version-386663 in network mk-old-k8s-version-386663
I0729 18:16:41.807828 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:41.807755 70173 retry.go:31] will retry after 784.977149ms: waiting for machine to come up
I0729 18:16:42.594250 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:16:42.594818 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | unable to find current IP address of domain old-k8s-version-386663 in network mk-old-k8s-version-386663
I0729 18:16:42.594843 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:42.594787 70173 retry.go:31] will retry after 1.413519074s: waiting for machine to come up
I0729 18:16:44.010342 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:16:44.010954 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | unable to find current IP address of domain old-k8s-version-386663 in network mk-old-k8s-version-386663
I0729 18:16:44.010983 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:44.010918 70173 retry.go:31] will retry after 1.311254911s: waiting for machine to come up
I0729 18:16:45.323511 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:16:45.324016 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | unable to find current IP address of domain old-k8s-version-386663 in network mk-old-k8s-version-386663
I0729 18:16:45.324042 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:45.323984 70173 retry.go:31] will retry after 2.048450391s: waiting for machine to come up
I0729 18:16:47.373954 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:16:47.374745 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | unable to find current IP address of domain old-k8s-version-386663 in network mk-old-k8s-version-386663
I0729 18:16:47.374772 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:47.374702 70173 retry.go:31] will retry after 2.804780404s: waiting for machine to come up
I0729 18:16:50.182600 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:16:50.183216 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | unable to find current IP address of domain old-k8s-version-386663 in network mk-old-k8s-version-386663
I0729 18:16:50.183286 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:50.183177 70173 retry.go:31] will retry after 2.589806593s: waiting for machine to come up
I0729 18:16:52.774313 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:16:52.774907 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | unable to find current IP address of domain old-k8s-version-386663 in network mk-old-k8s-version-386663
I0729 18:16:52.774929 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:52.774861 70173 retry.go:31] will retry after 3.036529063s: waiting for machine to come up
I0729 18:16:55.813046 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:16:55.813555 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | unable to find current IP address of domain old-k8s-version-386663 in network mk-old-k8s-version-386663
I0729 18:16:55.813597 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | I0729 18:16:55.813532 70173 retry.go:31] will retry after 5.582948285s: waiting for machine to come up
I0729 18:17:01.399785 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:01.400415 70090 main.go:141] libmachine: (old-k8s-version-386663) Found IP for machine: 192.168.50.70
I0729 18:17:01.400439 70090 main.go:141] libmachine: (old-k8s-version-386663) Reserving static IP address...
I0729 18:17:01.400452 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has current primary IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:01.400773 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-386663", mac: "52:54:00:78:b6:ac", ip: "192.168.50.70"} in network mk-old-k8s-version-386663
I0729 18:17:01.480873 70090 main.go:141] libmachine: (old-k8s-version-386663) Reserved static IP address: 192.168.50.70
I0729 18:17:01.480921 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | Getting to WaitForSSH function...
I0729 18:17:01.480933 70090 main.go:141] libmachine: (old-k8s-version-386663) Waiting for SSH to be available...
I0729 18:17:01.483666 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:01.484136 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:minikube Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:01.484160 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:01.484346 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | Using SSH client type: external
I0729 18:17:01.484374 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | Using SSH private key: /home/jenkins/minikube-integration/19345-11206/.minikube/machines/old-k8s-version-386663/id_rsa (-rw-------)
I0729 18:17:01.484402 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.70 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19345-11206/.minikube/machines/old-k8s-version-386663/id_rsa -p 22] /usr/bin/ssh <nil>}
I0729 18:17:01.484423 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | About to run SSH command:
I0729 18:17:01.484436 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | exit 0
I0729 18:17:01.623099 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | SSH cmd err, output: <nil>:
I0729 18:17:01.623386 70090 main.go:141] libmachine: (old-k8s-version-386663) KVM machine creation complete!
I0729 18:17:01.623778 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetConfigRaw
I0729 18:17:01.624397 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .DriverName
I0729 18:17:01.624608 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .DriverName
I0729 18:17:01.624751 70090 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0729 18:17:01.624767 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetState
I0729 18:17:01.626150 70090 main.go:141] libmachine: Detecting operating system of created instance...
I0729 18:17:01.626167 70090 main.go:141] libmachine: Waiting for SSH to be available...
I0729 18:17:01.626175 70090 main.go:141] libmachine: Getting to WaitForSSH function...
I0729 18:17:01.626184 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHHostname
I0729 18:17:01.628745 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:01.629213 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:old-k8s-version-386663 Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:01.629248 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:01.629372 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHPort
I0729 18:17:01.629541 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHKeyPath
I0729 18:17:01.629714 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHKeyPath
I0729 18:17:01.629845 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHUsername
I0729 18:17:01.629988 70090 main.go:141] libmachine: Using SSH client type: native
I0729 18:17:01.630233 70090 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.70 22 <nil> <nil>}
I0729 18:17:01.630252 70090 main.go:141] libmachine: About to run SSH command:
exit 0
I0729 18:17:01.742835 70090 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0729 18:17:01.742862 70090 main.go:141] libmachine: Detecting the provisioner...
I0729 18:17:01.742874 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHHostname
I0729 18:17:01.746475 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:01.746881 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:old-k8s-version-386663 Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:01.746931 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:01.747136 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHPort
I0729 18:17:01.747354 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHKeyPath
I0729 18:17:01.747553 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHKeyPath
I0729 18:17:01.747707 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHUsername
I0729 18:17:01.747872 70090 main.go:141] libmachine: Using SSH client type: native
I0729 18:17:01.748119 70090 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.70 22 <nil> <nil>}
I0729 18:17:01.748138 70090 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0729 18:17:01.863876 70090 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0729 18:17:01.863970 70090 main.go:141] libmachine: found compatible host: buildroot
I0729 18:17:01.863987 70090 main.go:141] libmachine: Provisioning with buildroot...
I0729 18:17:01.864001 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetMachineName
I0729 18:17:01.864265 70090 buildroot.go:166] provisioning hostname "old-k8s-version-386663"
I0729 18:17:01.864292 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetMachineName
I0729 18:17:01.864462 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHHostname
I0729 18:17:01.868141 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:01.868705 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:old-k8s-version-386663 Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:01.868734 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:01.868875 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHPort
I0729 18:17:01.869070 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHKeyPath
I0729 18:17:01.869266 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHKeyPath
I0729 18:17:01.869443 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHUsername
I0729 18:17:01.869639 70090 main.go:141] libmachine: Using SSH client type: native
I0729 18:17:01.869840 70090 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.70 22 <nil> <nil>}
I0729 18:17:01.869865 70090 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-386663 && echo "old-k8s-version-386663" | sudo tee /etc/hostname
I0729 18:17:02.005159 70090 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-386663
I0729 18:17:02.005189 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHHostname
I0729 18:17:02.008350 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:02.008800 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:old-k8s-version-386663 Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:02.008824 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:02.008984 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHPort
I0729 18:17:02.009169 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHKeyPath
I0729 18:17:02.009332 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHKeyPath
I0729 18:17:02.009475 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHUsername
I0729 18:17:02.009651 70090 main.go:141] libmachine: Using SSH client type: native
I0729 18:17:02.009861 70090 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.70 22 <nil> <nil>}
I0729 18:17:02.009883 70090 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-386663' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-386663/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-386663' | sudo tee -a /etc/hosts;
fi
fi
I0729 18:17:02.133378 70090 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0729 18:17:02.133402 70090 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19345-11206/.minikube CaCertPath:/home/jenkins/minikube-integration/19345-11206/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19345-11206/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19345-11206/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19345-11206/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19345-11206/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19345-11206/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19345-11206/.minikube}
I0729 18:17:02.133437 70090 buildroot.go:174] setting up certificates
I0729 18:17:02.133451 70090 provision.go:84] configureAuth start
I0729 18:17:02.133467 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetMachineName
I0729 18:17:02.133753 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetIP
I0729 18:17:02.137039 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:02.137482 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:old-k8s-version-386663 Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:02.137507 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:02.137690 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHHostname
I0729 18:17:02.140078 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:02.140443 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:old-k8s-version-386663 Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:02.140468 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:02.140618 70090 provision.go:143] copyHostCerts
I0729 18:17:02.140666 70090 exec_runner.go:144] found /home/jenkins/minikube-integration/19345-11206/.minikube/ca.pem, removing ...
I0729 18:17:02.140678 70090 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19345-11206/.minikube/ca.pem
I0729 18:17:02.140736 70090 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19345-11206/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19345-11206/.minikube/ca.pem (1078 bytes)
I0729 18:17:02.140872 70090 exec_runner.go:144] found /home/jenkins/minikube-integration/19345-11206/.minikube/cert.pem, removing ...
I0729 18:17:02.140883 70090 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19345-11206/.minikube/cert.pem
I0729 18:17:02.140921 70090 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19345-11206/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19345-11206/.minikube/cert.pem (1123 bytes)
I0729 18:17:02.141466 70090 exec_runner.go:144] found /home/jenkins/minikube-integration/19345-11206/.minikube/key.pem, removing ...
I0729 18:17:02.141477 70090 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19345-11206/.minikube/key.pem
I0729 18:17:02.141504 70090 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19345-11206/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19345-11206/.minikube/key.pem (1675 bytes)
I0729 18:17:02.141579 70090 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19345-11206/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19345-11206/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19345-11206/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-386663 san=[127.0.0.1 192.168.50.70 localhost minikube old-k8s-version-386663]
I0729 18:17:02.426003 70090 provision.go:177] copyRemoteCerts
I0729 18:17:02.426103 70090 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0729 18:17:02.426140 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHHostname
I0729 18:17:02.429541 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:02.429981 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:old-k8s-version-386663 Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:02.430048 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:02.430338 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHPort
I0729 18:17:02.430588 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHKeyPath
I0729 18:17:02.430778 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHUsername
I0729 18:17:02.430981 70090 sshutil.go:53] new ssh client: &{IP:192.168.50.70 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19345-11206/.minikube/machines/old-k8s-version-386663/id_rsa Username:docker}
I0729 18:17:02.521741 70090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-11206/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0729 18:17:02.552947 70090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-11206/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0729 18:17:02.579299 70090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-11206/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0729 18:17:02.607898 70090 provision.go:87] duration metric: took 474.430689ms to configureAuth
I0729 18:17:02.607939 70090 buildroot.go:189] setting minikube options for container-runtime
I0729 18:17:02.608149 70090 config.go:182] Loaded profile config "old-k8s-version-386663": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0729 18:17:02.608223 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHHostname
I0729 18:17:02.611334 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:02.611789 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:old-k8s-version-386663 Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:02.611826 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:02.611991 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHPort
I0729 18:17:02.612167 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHKeyPath
I0729 18:17:02.612331 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHKeyPath
I0729 18:17:02.612503 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHUsername
I0729 18:17:02.612701 70090 main.go:141] libmachine: Using SSH client type: native
I0729 18:17:02.612916 70090 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.70 22 <nil> <nil>}
I0729 18:17:02.612933 70090 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0729 18:17:02.929860 70090 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0729 18:17:02.929889 70090 main.go:141] libmachine: Checking connection to Docker...
I0729 18:17:02.929899 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetURL
I0729 18:17:02.931586 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | Using libvirt version 6000000
I0729 18:17:02.934398 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:02.934822 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:old-k8s-version-386663 Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:02.934856 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:02.934993 70090 main.go:141] libmachine: Docker is up and running!
I0729 18:17:02.935005 70090 main.go:141] libmachine: Reticulating splines...
I0729 18:17:02.935012 70090 client.go:171] duration metric: took 25.862584131s to LocalClient.Create
I0729 18:17:02.935035 70090 start.go:167] duration metric: took 25.862648575s to libmachine.API.Create "old-k8s-version-386663"
I0729 18:17:02.935048 70090 start.go:293] postStartSetup for "old-k8s-version-386663" (driver="kvm2")
I0729 18:17:02.935062 70090 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0729 18:17:02.935083 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .DriverName
I0729 18:17:02.935348 70090 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0729 18:17:02.935377 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHHostname
I0729 18:17:02.937737 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:02.938055 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:old-k8s-version-386663 Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:02.938092 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:02.938228 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHPort
I0729 18:17:02.938430 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHKeyPath
I0729 18:17:02.938644 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHUsername
I0729 18:17:02.938806 70090 sshutil.go:53] new ssh client: &{IP:192.168.50.70 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19345-11206/.minikube/machines/old-k8s-version-386663/id_rsa Username:docker}
I0729 18:17:03.026042 70090 ssh_runner.go:195] Run: cat /etc/os-release
I0729 18:17:03.031089 70090 info.go:137] Remote host: Buildroot 2023.02.9
I0729 18:17:03.031129 70090 filesync.go:126] Scanning /home/jenkins/minikube-integration/19345-11206/.minikube/addons for local assets ...
I0729 18:17:03.031211 70090 filesync.go:126] Scanning /home/jenkins/minikube-integration/19345-11206/.minikube/files for local assets ...
I0729 18:17:03.031292 70090 filesync.go:149] local asset: /home/jenkins/minikube-integration/19345-11206/.minikube/files/etc/ssl/certs/183932.pem -> 183932.pem in /etc/ssl/certs
I0729 18:17:03.031573 70090 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0729 18:17:03.044092 70090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-11206/.minikube/files/etc/ssl/certs/183932.pem --> /etc/ssl/certs/183932.pem (1708 bytes)
I0729 18:17:03.071920 70090 start.go:296] duration metric: took 136.841535ms for postStartSetup
I0729 18:17:03.071972 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetConfigRaw
I0729 18:17:03.073033 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetIP
I0729 18:17:03.076110 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:03.076525 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:old-k8s-version-386663 Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:03.076552 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:03.076787 70090 profile.go:143] Saving config to /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/config.json ...
I0729 18:17:03.077032 70090 start.go:128] duration metric: took 26.025437663s to createHost
I0729 18:17:03.077056 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHHostname
I0729 18:17:03.079523 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:03.079928 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:old-k8s-version-386663 Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:03.079994 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:03.080120 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHPort
I0729 18:17:03.080309 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHKeyPath
I0729 18:17:03.080487 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHKeyPath
I0729 18:17:03.080631 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHUsername
I0729 18:17:03.080788 70090 main.go:141] libmachine: Using SSH client type: native
I0729 18:17:03.080988 70090 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.50.70 22 <nil> <nil>}
I0729 18:17:03.081002 70090 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0729 18:17:03.196020 70090 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722277023.129580157
I0729 18:17:03.196043 70090 fix.go:216] guest clock: 1722277023.129580157
I0729 18:17:03.196053 70090 fix.go:229] Guest: 2024-07-29 18:17:03.129580157 +0000 UTC Remote: 2024-07-29 18:17:03.077045823 +0000 UTC m=+37.284879984 (delta=52.534334ms)
I0729 18:17:03.196099 70090 fix.go:200] guest clock delta is within tolerance: 52.534334ms
I0729 18:17:03.196106 70090 start.go:83] releasing machines lock for "old-k8s-version-386663", held for 26.144700639s
I0729 18:17:03.196134 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .DriverName
I0729 18:17:03.196438 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetIP
I0729 18:17:03.199453 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:03.199857 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:old-k8s-version-386663 Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:03.199886 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:03.200049 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .DriverName
I0729 18:17:03.200690 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .DriverName
I0729 18:17:03.200899 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .DriverName
I0729 18:17:03.201039 70090 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0729 18:17:03.201085 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHHostname
I0729 18:17:03.201133 70090 ssh_runner.go:195] Run: cat /version.json
I0729 18:17:03.201159 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHHostname
I0729 18:17:03.203933 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:03.204040 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:03.204329 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:old-k8s-version-386663 Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:03.204356 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:03.204484 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:old-k8s-version-386663 Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:03.204512 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:03.204585 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHPort
I0729 18:17:03.204690 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHPort
I0729 18:17:03.204785 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHKeyPath
I0729 18:17:03.204899 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHKeyPath
I0729 18:17:03.204967 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHUsername
I0729 18:17:03.205051 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetSSHUsername
I0729 18:17:03.205148 70090 sshutil.go:53] new ssh client: &{IP:192.168.50.70 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19345-11206/.minikube/machines/old-k8s-version-386663/id_rsa Username:docker}
I0729 18:17:03.205188 70090 sshutil.go:53] new ssh client: &{IP:192.168.50.70 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19345-11206/.minikube/machines/old-k8s-version-386663/id_rsa Username:docker}
I0729 18:17:03.296013 70090 ssh_runner.go:195] Run: systemctl --version
I0729 18:17:03.317166 70090 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0729 18:17:03.485695 70090 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0729 18:17:03.492533 70090 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0729 18:17:03.492628 70090 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0729 18:17:03.509929 70090 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0729 18:17:03.509956 70090 start.go:495] detecting cgroup driver to use...
I0729 18:17:03.510018 70090 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0729 18:17:03.528207 70090 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0729 18:17:03.544684 70090 docker.go:217] disabling cri-docker service (if available) ...
I0729 18:17:03.544750 70090 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0729 18:17:03.560422 70090 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0729 18:17:03.576122 70090 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0729 18:17:03.699654 70090 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0729 18:17:03.868694 70090 docker.go:233] disabling docker service ...
I0729 18:17:03.868767 70090 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0729 18:17:03.886129 70090 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0729 18:17:03.904213 70090 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0729 18:17:04.066776 70090 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0729 18:17:04.205898 70090 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0729 18:17:04.221607 70090 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0729 18:17:04.243390 70090 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0729 18:17:04.243460 70090 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0729 18:17:04.255565 70090 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0729 18:17:04.255642 70090 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0729 18:17:04.267403 70090 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0729 18:17:04.279446 70090 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0729 18:17:04.294170 70090 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0729 18:17:04.307947 70090 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0729 18:17:04.319640 70090 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0729 18:17:04.319706 70090 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0729 18:17:04.335317 70090 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0729 18:17:04.350977 70090 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0729 18:17:04.511213 70090 ssh_runner.go:195] Run: sudo systemctl restart crio
I0729 18:17:04.701771 70090 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0729 18:17:04.701872 70090 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0729 18:17:04.711331 70090 start.go:563] Will wait 60s for crictl version
I0729 18:17:04.711400 70090 ssh_runner.go:195] Run: which crictl
I0729 18:17:04.718606 70090 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0729 18:17:04.766290 70090 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0729 18:17:04.766389 70090 ssh_runner.go:195] Run: crio --version
I0729 18:17:04.802781 70090 ssh_runner.go:195] Run: crio --version
I0729 18:17:04.841529 70090 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0729 18:17:04.842873 70090 main.go:141] libmachine: (old-k8s-version-386663) Calling .GetIP
I0729 18:17:04.846048 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:04.846461 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:78:b6:ac", ip: ""} in network mk-old-k8s-version-386663: {Iface:virbr3 ExpiryTime:2024-07-29 19:16:53 +0000 UTC Type:0 Mac:52:54:00:78:b6:ac Iaid: IPaddr:192.168.50.70 Prefix:24 Hostname:old-k8s-version-386663 Clientid:01:52:54:00:78:b6:ac}
I0729 18:17:04.846489 70090 main.go:141] libmachine: (old-k8s-version-386663) DBG | domain old-k8s-version-386663 has defined IP address 192.168.50.70 and MAC address 52:54:00:78:b6:ac in network mk-old-k8s-version-386663
I0729 18:17:04.846675 70090 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0729 18:17:04.852403 70090 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0729 18:17:04.871101 70090 kubeadm.go:883] updating cluster {Name:old-k8s-version-386663 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19319/minikube-v1.33.1-1721690939-19319-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-386663 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.70 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0729 18:17:04.871220 70090 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0729 18:17:04.871275 70090 ssh_runner.go:195] Run: sudo crictl images --output json
I0729 18:17:04.917063 70090 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0729 18:17:04.917146 70090 ssh_runner.go:195] Run: which lz4
I0729 18:17:04.922540 70090 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0729 18:17:04.928756 70090 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0729 18:17:04.928805 70090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-11206/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0729 18:17:06.646799 70090 crio.go:462] duration metric: took 1.724281177s to copy over tarball
I0729 18:17:06.646888 70090 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0729 18:17:09.465079 70090 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.818161943s)
I0729 18:17:09.465101 70090 crio.go:469] duration metric: took 2.818271689s to extract the tarball
I0729 18:17:09.465109 70090 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0729 18:17:09.509612 70090 ssh_runner.go:195] Run: sudo crictl images --output json
I0729 18:17:09.564813 70090 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0729 18:17:09.564837 70090 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0729 18:17:09.564932 70090 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0729 18:17:09.564989 70090 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0729 18:17:09.565002 70090 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0729 18:17:09.565068 70090 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0729 18:17:09.564934 70090 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0729 18:17:09.565211 70090 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0729 18:17:09.565267 70090 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0729 18:17:09.565352 70090 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0729 18:17:09.566762 70090 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0729 18:17:09.566866 70090 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0729 18:17:09.567029 70090 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0729 18:17:09.567389 70090 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0729 18:17:09.567628 70090 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0729 18:17:09.567856 70090 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0729 18:17:09.567912 70090 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0729 18:17:09.567979 70090 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0729 18:17:09.719916 70090 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0729 18:17:09.746795 70090 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0729 18:17:09.747437 70090 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0729 18:17:09.749388 70090 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0729 18:17:09.752852 70090 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0729 18:17:09.755571 70090 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0729 18:17:09.778830 70090 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0729 18:17:09.818662 70090 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0729 18:17:09.818707 70090 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0729 18:17:09.818758 70090 ssh_runner.go:195] Run: which crictl
I0729 18:17:09.881421 70090 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0729 18:17:09.908844 70090 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0729 18:17:09.908894 70090 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0729 18:17:09.908945 70090 ssh_runner.go:195] Run: which crictl
I0729 18:17:09.915793 70090 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0729 18:17:09.915839 70090 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0729 18:17:09.915886 70090 ssh_runner.go:195] Run: which crictl
I0729 18:17:09.916016 70090 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0729 18:17:09.916045 70090 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0729 18:17:09.916075 70090 ssh_runner.go:195] Run: which crictl
I0729 18:17:09.939379 70090 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0729 18:17:09.939439 70090 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0729 18:17:09.939461 70090 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0729 18:17:09.939486 70090 ssh_runner.go:195] Run: which crictl
I0729 18:17:09.939493 70090 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0729 18:17:09.939533 70090 ssh_runner.go:195] Run: which crictl
I0729 18:17:09.954076 70090 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0729 18:17:09.954130 70090 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0729 18:17:09.954172 70090 ssh_runner.go:195] Run: which crictl
I0729 18:17:09.954182 70090 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0729 18:17:10.096842 70090 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0729 18:17:10.096865 70090 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0729 18:17:10.096896 70090 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0729 18:17:10.096948 70090 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0729 18:17:10.096959 70090 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0729 18:17:10.096979 70090 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0729 18:17:10.097044 70090 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19345-11206/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0729 18:17:10.230267 70090 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19345-11206/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0729 18:17:10.236952 70090 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19345-11206/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0729 18:17:10.237082 70090 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19345-11206/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0729 18:17:10.238562 70090 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19345-11206/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0729 18:17:10.247731 70090 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19345-11206/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0729 18:17:10.247818 70090 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19345-11206/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0729 18:17:10.247868 70090 cache_images.go:92] duration metric: took 683.015794ms to LoadCachedImages
W0729 18:17:10.247954 70090 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19345-11206/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19345-11206/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
I0729 18:17:10.247968 70090 kubeadm.go:934] updating node { 192.168.50.70 8443 v1.20.0 crio true true} ...
I0729 18:17:10.248105 70090 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-386663 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.70
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-386663 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0729 18:17:10.248179 70090 ssh_runner.go:195] Run: crio config
I0729 18:17:10.297115 70090 cni.go:84] Creating CNI manager for ""
I0729 18:17:10.297134 70090 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0729 18:17:10.297142 70090 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0729 18:17:10.297158 70090 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.70 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-386663 NodeName:old-k8s-version-386663 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.70"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.70 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0729 18:17:10.297287 70090 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.70
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-386663"
kubeletExtraArgs:
node-ip: 192.168.50.70
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.70"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0729 18:17:10.297354 70090 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0729 18:17:10.308486 70090 binaries.go:44] Found k8s binaries, skipping transfer
I0729 18:17:10.308558 70090 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0729 18:17:10.319064 70090 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0729 18:17:10.340184 70090 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0729 18:17:10.360680 70090 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0729 18:17:10.378766 70090 ssh_runner.go:195] Run: grep 192.168.50.70 control-plane.minikube.internal$ /etc/hosts
I0729 18:17:10.382931 70090 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.70 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0729 18:17:10.396340 70090 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0729 18:17:10.536870 70090 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0729 18:17:10.560001 70090 certs.go:68] Setting up /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663 for IP: 192.168.50.70
I0729 18:17:10.560019 70090 certs.go:194] generating shared ca certs ...
I0729 18:17:10.560034 70090 certs.go:226] acquiring lock for ca certs: {Name:mk128e8b8d2ff348f67bc6978aaf4e66f8542ab9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 18:17:10.560195 70090 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19345-11206/.minikube/ca.key
I0729 18:17:10.560254 70090 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19345-11206/.minikube/proxy-client-ca.key
I0729 18:17:10.560267 70090 certs.go:256] generating profile certs ...
I0729 18:17:10.560329 70090 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/client.key
I0729 18:17:10.560347 70090 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/client.crt with IP's: []
I0729 18:17:10.658058 70090 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/client.crt ...
I0729 18:17:10.658084 70090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/client.crt: {Name:mk50d7ea2e6c077f2531d5371b8a2f688ccf6055 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 18:17:10.658266 70090 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/client.key ...
I0729 18:17:10.658285 70090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/client.key: {Name:mka841b8b8919dcf3a43f1bfc014d3eec4b47777 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 18:17:10.658418 70090 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/apiserver.key.71ea3f9f
I0729 18:17:10.658441 70090 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/apiserver.crt.71ea3f9f with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.70]
I0729 18:17:10.798142 70090 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/apiserver.crt.71ea3f9f ...
I0729 18:17:10.798178 70090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/apiserver.crt.71ea3f9f: {Name:mkb771223c28136ae82beca29b7ff3d272bbf83a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 18:17:10.798415 70090 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/apiserver.key.71ea3f9f ...
I0729 18:17:10.798439 70090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/apiserver.key.71ea3f9f: {Name:mkb07660883ea46d15af001fe4f8f71676b47cd2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 18:17:10.798566 70090 certs.go:381] copying /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/apiserver.crt.71ea3f9f -> /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/apiserver.crt
I0729 18:17:10.798673 70090 certs.go:385] copying /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/apiserver.key.71ea3f9f -> /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/apiserver.key
I0729 18:17:10.798752 70090 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/proxy-client.key
I0729 18:17:10.798776 70090 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/proxy-client.crt with IP's: []
I0729 18:17:10.851215 70090 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/proxy-client.crt ...
I0729 18:17:10.851241 70090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/proxy-client.crt: {Name:mk235cc47c07b207e7abcc6135d36cd1a7fbc8d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 18:17:10.851397 70090 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/proxy-client.key ...
I0729 18:17:10.851410 70090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/proxy-client.key: {Name:mkb3a5f5804ca5b45b3607518901335e632f3039 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 18:17:10.851597 70090 certs.go:484] found cert: /home/jenkins/minikube-integration/19345-11206/.minikube/certs/18393.pem (1338 bytes)
W0729 18:17:10.851634 70090 certs.go:480] ignoring /home/jenkins/minikube-integration/19345-11206/.minikube/certs/18393_empty.pem, impossibly tiny 0 bytes
I0729 18:17:10.851644 70090 certs.go:484] found cert: /home/jenkins/minikube-integration/19345-11206/.minikube/certs/ca-key.pem (1679 bytes)
I0729 18:17:10.851668 70090 certs.go:484] found cert: /home/jenkins/minikube-integration/19345-11206/.minikube/certs/ca.pem (1078 bytes)
I0729 18:17:10.851693 70090 certs.go:484] found cert: /home/jenkins/minikube-integration/19345-11206/.minikube/certs/cert.pem (1123 bytes)
I0729 18:17:10.851714 70090 certs.go:484] found cert: /home/jenkins/minikube-integration/19345-11206/.minikube/certs/key.pem (1675 bytes)
I0729 18:17:10.851751 70090 certs.go:484] found cert: /home/jenkins/minikube-integration/19345-11206/.minikube/files/etc/ssl/certs/183932.pem (1708 bytes)
I0729 18:17:10.852450 70090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-11206/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0729 18:17:10.895047 70090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-11206/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0729 18:17:10.932036 70090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-11206/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0729 18:17:10.973835 70090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-11206/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0729 18:17:11.005246 70090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0729 18:17:11.038976 70090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0729 18:17:11.070482 70090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0729 18:17:11.100268 70090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-11206/.minikube/profiles/old-k8s-version-386663/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0729 18:17:11.128012 70090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-11206/.minikube/files/etc/ssl/certs/183932.pem --> /usr/share/ca-certificates/183932.pem (1708 bytes)
I0729 18:17:11.153950 70090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-11206/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0729 18:17:11.182089 70090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19345-11206/.minikube/certs/18393.pem --> /usr/share/ca-certificates/18393.pem (1338 bytes)
I0729 18:17:11.219600 70090 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0729 18:17:11.246792 70090 ssh_runner.go:195] Run: openssl version
I0729 18:17:11.254740 70090 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/183932.pem && ln -fs /usr/share/ca-certificates/183932.pem /etc/ssl/certs/183932.pem"
I0729 18:17:11.268678 70090 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/183932.pem
I0729 18:17:11.273927 70090 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 29 17:08 /usr/share/ca-certificates/183932.pem
I0729 18:17:11.273991 70090 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/183932.pem
I0729 18:17:11.280945 70090 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/183932.pem /etc/ssl/certs/3ec20f2e.0"
I0729 18:17:11.294620 70090 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0729 18:17:11.308170 70090 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0729 18:17:11.313706 70090 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 29 16:56 /usr/share/ca-certificates/minikubeCA.pem
I0729 18:17:11.313784 70090 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0729 18:17:11.320576 70090 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0729 18:17:11.341049 70090 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/18393.pem && ln -fs /usr/share/ca-certificates/18393.pem /etc/ssl/certs/18393.pem"
I0729 18:17:11.356220 70090 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/18393.pem
I0729 18:17:11.361187 70090 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 29 17:08 /usr/share/ca-certificates/18393.pem
I0729 18:17:11.361247 70090 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/18393.pem
I0729 18:17:11.368331 70090 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/18393.pem /etc/ssl/certs/51391683.0"
I0729 18:17:11.381720 70090 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0729 18:17:11.386695 70090 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0729 18:17:11.386741 70090 kubeadm.go:392] StartCluster: {Name:old-k8s-version-386663 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19319/minikube-v1.33.1-1721690939-19319-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-386663 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.70 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0729 18:17:11.386838 70090 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0729 18:17:11.386879 70090 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0729 18:17:11.435451 70090 cri.go:89] found id: ""
I0729 18:17:11.435523 70090 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0729 18:17:11.448451 70090 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0729 18:17:11.460098 70090 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0729 18:17:11.473644 70090 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0729 18:17:11.473667 70090 kubeadm.go:157] found existing configuration files:
I0729 18:17:11.473721 70090 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0729 18:17:11.483674 70090 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0729 18:17:11.483724 70090 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0729 18:17:11.494342 70090 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0729 18:17:11.506067 70090 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0729 18:17:11.506123 70090 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0729 18:17:11.522529 70090 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0729 18:17:11.538090 70090 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0729 18:17:11.538142 70090 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0729 18:17:11.552211 70090 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0729 18:17:11.570558 70090 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0729 18:17:11.570602 70090 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0729 18:17:11.592548 70090 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0729 18:17:11.812343 70090 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0729 18:17:11.812447 70090 kubeadm.go:310] [preflight] Running pre-flight checks
I0729 18:17:11.969323 70090 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0729 18:17:11.969487 70090 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0729 18:17:11.969625 70090 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0729 18:17:12.190931 70090 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0729 18:17:12.259147 70090 out.go:204] - Generating certificates and keys ...
I0729 18:17:12.259291 70090 kubeadm.go:310] [certs] Using existing ca certificate authority
I0729 18:17:12.259400 70090 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0729 18:17:12.320109 70090 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0729 18:17:12.507671 70090 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0729 18:17:12.786755 70090 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0729 18:17:13.145031 70090 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0729 18:17:13.231958 70090 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0729 18:17:13.232199 70090 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-386663] and IPs [192.168.50.70 127.0.0.1 ::1]
I0729 18:17:13.572017 70090 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0729 18:17:13.572230 70090 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-386663] and IPs [192.168.50.70 127.0.0.1 ::1]
I0729 18:17:13.699756 70090 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0729 18:17:13.796681 70090 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0729 18:17:13.932306 70090 kubeadm.go:310] [certs] Generating "sa" key and public key
I0729 18:17:13.932548 70090 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0729 18:17:14.065275 70090 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0729 18:17:14.224429 70090 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0729 18:17:14.439392 70090 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0729 18:17:14.617250 70090 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0729 18:17:14.633875 70090 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0729 18:17:14.636048 70090 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0729 18:17:14.636103 70090 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0729 18:17:14.779897 70090 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0729 18:17:14.781626 70090 out.go:204] - Booting up control plane ...
I0729 18:17:14.781743 70090 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0729 18:17:14.787730 70090 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0729 18:17:14.789593 70090 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0729 18:17:14.790850 70090 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0729 18:17:14.794828 70090 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0729 18:17:54.733798 70090 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0729 18:17:54.734446 70090 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:17:54.734959 70090 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:17:59.734965 70090 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:17:59.735262 70090 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:18:09.734658 70090 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:18:09.734950 70090 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:18:29.734609 70090 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:18:29.734900 70090 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:19:09.736631 70090 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:19:09.736807 70090 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:19:09.736830 70090 kubeadm.go:310]
I0729 18:19:09.736912 70090 kubeadm.go:310] Unfortunately, an error has occurred:
I0729 18:19:09.736974 70090 kubeadm.go:310] timed out waiting for the condition
I0729 18:19:09.736981 70090 kubeadm.go:310]
I0729 18:19:09.737010 70090 kubeadm.go:310] This error is likely caused by:
I0729 18:19:09.737066 70090 kubeadm.go:310] - The kubelet is not running
I0729 18:19:09.737212 70090 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0729 18:19:09.737226 70090 kubeadm.go:310]
I0729 18:19:09.737357 70090 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0729 18:19:09.737428 70090 kubeadm.go:310] - 'systemctl status kubelet'
I0729 18:19:09.737462 70090 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0729 18:19:09.737469 70090 kubeadm.go:310]
I0729 18:19:09.737635 70090 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0729 18:19:09.737772 70090 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0729 18:19:09.737790 70090 kubeadm.go:310]
I0729 18:19:09.737954 70090 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0729 18:19:09.738085 70090 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0729 18:19:09.738192 70090 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0729 18:19:09.738292 70090 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0729 18:19:09.738301 70090 kubeadm.go:310]
I0729 18:19:09.738933 70090 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0729 18:19:09.739051 70090 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0729 18:19:09.739141 70090 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0729 18:19:09.739279 70090 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-386663] and IPs [192.168.50.70 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-386663] and IPs [192.168.50.70 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-386663] and IPs [192.168.50.70 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-386663] and IPs [192.168.50.70 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0729 18:19:09.739339 70090 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0729 18:19:11.850453 70090 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.111086063s)
I0729 18:19:11.850532 70090 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0729 18:19:11.865044 70090 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0729 18:19:11.874647 70090 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0729 18:19:11.874662 70090 kubeadm.go:157] found existing configuration files:
I0729 18:19:11.874708 70090 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0729 18:19:11.883910 70090 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0729 18:19:11.883953 70090 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0729 18:19:11.893028 70090 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0729 18:19:11.901787 70090 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0729 18:19:11.901826 70090 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0729 18:19:11.910921 70090 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0729 18:19:11.919820 70090 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0729 18:19:11.919873 70090 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0729 18:19:11.928911 70090 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0729 18:19:11.937731 70090 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0729 18:19:11.937771 70090 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0729 18:19:11.947315 70090 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0729 18:19:12.185578 70090 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0729 18:21:08.109122 70090 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0729 18:21:08.109216 70090 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0729 18:21:08.111061 70090 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0729 18:21:08.111124 70090 kubeadm.go:310] [preflight] Running pre-flight checks
I0729 18:21:08.111208 70090 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0729 18:21:08.111289 70090 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0729 18:21:08.111424 70090 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0729 18:21:08.111511 70090 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0729 18:21:08.113218 70090 out.go:204] - Generating certificates and keys ...
I0729 18:21:08.113284 70090 kubeadm.go:310] [certs] Using existing ca certificate authority
I0729 18:21:08.113342 70090 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0729 18:21:08.113424 70090 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0729 18:21:08.113509 70090 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0729 18:21:08.113589 70090 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0729 18:21:08.113665 70090 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0729 18:21:08.113754 70090 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0729 18:21:08.113822 70090 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0729 18:21:08.113914 70090 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0729 18:21:08.114001 70090 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0729 18:21:08.114051 70090 kubeadm.go:310] [certs] Using the existing "sa" key
I0729 18:21:08.114131 70090 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0729 18:21:08.114208 70090 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0729 18:21:08.114257 70090 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0729 18:21:08.114325 70090 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0729 18:21:08.114425 70090 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0729 18:21:08.114577 70090 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0729 18:21:08.114704 70090 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0729 18:21:08.114756 70090 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0729 18:21:08.114811 70090 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0729 18:21:08.116257 70090 out.go:204] - Booting up control plane ...
I0729 18:21:08.116333 70090 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0729 18:21:08.116422 70090 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0729 18:21:08.116510 70090 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0729 18:21:08.116577 70090 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0729 18:21:08.116782 70090 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0729 18:21:08.116838 70090 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0729 18:21:08.116918 70090 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:21:08.117126 70090 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:21:08.117229 70090 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:21:08.117435 70090 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:21:08.117535 70090 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:21:08.117717 70090 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:21:08.117797 70090 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:21:08.117967 70090 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:21:08.118062 70090 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 18:21:08.118254 70090 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 18:21:08.118264 70090 kubeadm.go:310]
I0729 18:21:08.118297 70090 kubeadm.go:310] Unfortunately, an error has occurred:
I0729 18:21:08.118335 70090 kubeadm.go:310] timed out waiting for the condition
I0729 18:21:08.118341 70090 kubeadm.go:310]
I0729 18:21:08.118384 70090 kubeadm.go:310] This error is likely caused by:
I0729 18:21:08.118412 70090 kubeadm.go:310] - The kubelet is not running
I0729 18:21:08.118523 70090 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0729 18:21:08.118534 70090 kubeadm.go:310]
I0729 18:21:08.118677 70090 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0729 18:21:08.118728 70090 kubeadm.go:310] - 'systemctl status kubelet'
I0729 18:21:08.118770 70090 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0729 18:21:08.118778 70090 kubeadm.go:310]
I0729 18:21:08.118926 70090 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0729 18:21:08.119042 70090 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0729 18:21:08.119056 70090 kubeadm.go:310]
I0729 18:21:08.119212 70090 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0729 18:21:08.119336 70090 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0729 18:21:08.119441 70090 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0729 18:21:08.119539 70090 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0729 18:21:08.119565 70090 kubeadm.go:310]
I0729 18:21:08.119601 70090 kubeadm.go:394] duration metric: took 3m56.732861151s to StartCluster
I0729 18:21:08.119647 70090 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0729 18:21:08.119695 70090 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0729 18:21:08.169606 70090 cri.go:89] found id: ""
I0729 18:21:08.169634 70090 logs.go:276] 0 containers: []
W0729 18:21:08.169643 70090 logs.go:278] No container was found matching "kube-apiserver"
I0729 18:21:08.169648 70090 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0729 18:21:08.169711 70090 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0729 18:21:08.203778 70090 cri.go:89] found id: ""
I0729 18:21:08.203805 70090 logs.go:276] 0 containers: []
W0729 18:21:08.203812 70090 logs.go:278] No container was found matching "etcd"
I0729 18:21:08.203818 70090 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0729 18:21:08.203890 70090 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0729 18:21:08.237266 70090 cri.go:89] found id: ""
I0729 18:21:08.237289 70090 logs.go:276] 0 containers: []
W0729 18:21:08.237297 70090 logs.go:278] No container was found matching "coredns"
I0729 18:21:08.237303 70090 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0729 18:21:08.237348 70090 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0729 18:21:08.273136 70090 cri.go:89] found id: ""
I0729 18:21:08.273167 70090 logs.go:276] 0 containers: []
W0729 18:21:08.273177 70090 logs.go:278] No container was found matching "kube-scheduler"
I0729 18:21:08.273184 70090 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0729 18:21:08.273245 70090 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0729 18:21:08.307381 70090 cri.go:89] found id: ""
I0729 18:21:08.307404 70090 logs.go:276] 0 containers: []
W0729 18:21:08.307410 70090 logs.go:278] No container was found matching "kube-proxy"
I0729 18:21:08.307416 70090 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0729 18:21:08.307473 70090 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0729 18:21:08.340477 70090 cri.go:89] found id: ""
I0729 18:21:08.340503 70090 logs.go:276] 0 containers: []
W0729 18:21:08.340510 70090 logs.go:278] No container was found matching "kube-controller-manager"
I0729 18:21:08.340522 70090 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0729 18:21:08.340567 70090 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0729 18:21:08.373142 70090 cri.go:89] found id: ""
I0729 18:21:08.373169 70090 logs.go:276] 0 containers: []
W0729 18:21:08.373180 70090 logs.go:278] No container was found matching "kindnet"
I0729 18:21:08.373191 70090 logs.go:123] Gathering logs for kubelet ...
I0729 18:21:08.373206 70090 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0729 18:21:08.423725 70090 logs.go:123] Gathering logs for dmesg ...
I0729 18:21:08.423758 70090 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0729 18:21:08.440827 70090 logs.go:123] Gathering logs for describe nodes ...
I0729 18:21:08.440854 70090 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0729 18:21:08.590065 70090 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0729 18:21:08.590085 70090 logs.go:123] Gathering logs for CRI-O ...
I0729 18:21:08.590096 70090 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0729 18:21:08.699690 70090 logs.go:123] Gathering logs for container status ...
I0729 18:21:08.699727 70090 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0729 18:21:08.738163 70090 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0729 18:21:08.738213 70090 out.go:239] *
*
W0729 18:21:08.738291 70090 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0729 18:21:08.738314 70090 out.go:239] *
*
W0729 18:21:08.739230 70090 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0729 18:21:08.742708 70090 out.go:177]
W0729 18:21:08.743878 70090 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0729 18:21:08.743936 70090 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0729 18:21:08.743960 70090 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0729 18:21:08.745357 70090 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-386663 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-386663 -n old-k8s-version-386663
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-386663 -n old-k8s-version-386663: exit status 6 (232.08703ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0729 18:21:09.012716 77011 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-386663" does not appear in /home/jenkins/minikube-integration/19345-11206/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-386663" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (283.24s)