=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-021528 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-021528 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m54.31462983s)
-- stdout --
* [old-k8s-version-021528] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19312
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19312-1055011/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19312-1055011/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-021528" primary control-plane node in "old-k8s-version-021528" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0729 19:34:13.736434 1113418 out.go:291] Setting OutFile to fd 1 ...
I0729 19:34:13.736689 1113418 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 19:34:13.736698 1113418 out.go:304] Setting ErrFile to fd 2...
I0729 19:34:13.736702 1113418 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 19:34:13.736910 1113418 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19312-1055011/.minikube/bin
I0729 19:34:13.737542 1113418 out.go:298] Setting JSON to false
I0729 19:34:13.738720 1113418 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-14","uptime":11806,"bootTime":1722269848,"procs":297,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1065-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0729 19:34:13.738778 1113418 start.go:139] virtualization: kvm guest
I0729 19:34:13.741165 1113418 out.go:177] * [old-k8s-version-021528] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0729 19:34:13.742422 1113418 out.go:177] - MINIKUBE_LOCATION=19312
I0729 19:34:13.742461 1113418 notify.go:220] Checking for updates...
I0729 19:34:13.744563 1113418 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0729 19:34:13.745725 1113418 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19312-1055011/kubeconfig
I0729 19:34:13.746753 1113418 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19312-1055011/.minikube
I0729 19:34:13.747760 1113418 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0729 19:34:13.748750 1113418 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0729 19:34:13.750396 1113418 config.go:182] Loaded profile config "bridge-184620": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0729 19:34:13.750552 1113418 config.go:182] Loaded profile config "enable-default-cni-184620": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0729 19:34:13.750685 1113418 config.go:182] Loaded profile config "flannel-184620": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0729 19:34:13.750801 1113418 driver.go:392] Setting default libvirt URI to qemu:///system
I0729 19:34:13.789223 1113418 out.go:177] * Using the kvm2 driver based on user configuration
I0729 19:34:13.790390 1113418 start.go:297] selected driver: kvm2
I0729 19:34:13.790438 1113418 start.go:901] validating driver "kvm2" against <nil>
I0729 19:34:13.790453 1113418 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0729 19:34:13.791607 1113418 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0729 19:34:13.791687 1113418 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19312-1055011/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0729 19:34:13.815033 1113418 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0729 19:34:13.815099 1113418 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0729 19:34:13.815336 1113418 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0729 19:34:13.815402 1113418 cni.go:84] Creating CNI manager for ""
I0729 19:34:13.815418 1113418 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0729 19:34:13.815428 1113418 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0729 19:34:13.815520 1113418 start.go:340] cluster config:
{Name:old-k8s-version-021528 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-021528 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0729 19:34:13.815661 1113418 iso.go:125] acquiring lock: {Name:mk0af61c0fec1fd47930e548d03010a532c687b7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0729 19:34:13.817424 1113418 out.go:177] * Starting "old-k8s-version-021528" primary control-plane node in "old-k8s-version-021528" cluster
I0729 19:34:13.818697 1113418 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0729 19:34:13.818748 1113418 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19312-1055011/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0729 19:34:13.818760 1113418 cache.go:56] Caching tarball of preloaded images
I0729 19:34:13.818867 1113418 preload.go:172] Found /home/jenkins/minikube-integration/19312-1055011/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0729 19:34:13.818880 1113418 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0729 19:34:13.819001 1113418 profile.go:143] Saving config to /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/config.json ...
I0729 19:34:13.819026 1113418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/config.json: {Name:mk956e741caefd34d37605eb1d444ddbc287a03b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 19:34:13.819187 1113418 start.go:360] acquireMachinesLock for old-k8s-version-021528: {Name:mk0d8d947666df844b5fc2c0e0eebbfed69b4140 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0729 19:34:30.247721 1113418 start.go:364] duration metric: took 16.428501352s to acquireMachinesLock for "old-k8s-version-021528"
I0729 19:34:30.247809 1113418 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-021528 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19319/minikube-v1.33.1-1721690939-19319-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-021528 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0729 19:34:30.247934 1113418 start.go:125] createHost starting for "" (driver="kvm2")
I0729 19:34:30.249919 1113418 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0729 19:34:30.250165 1113418 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0729 19:34:30.250220 1113418 main.go:141] libmachine: Launching plugin server for driver kvm2
I0729 19:34:30.270615 1113418 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45379
I0729 19:34:30.271102 1113418 main.go:141] libmachine: () Calling .GetVersion
I0729 19:34:30.271720 1113418 main.go:141] libmachine: Using API Version 1
I0729 19:34:30.271754 1113418 main.go:141] libmachine: () Calling .SetConfigRaw
I0729 19:34:30.272126 1113418 main.go:141] libmachine: () Calling .GetMachineName
I0729 19:34:30.272346 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetMachineName
I0729 19:34:30.272502 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .DriverName
I0729 19:34:30.272668 1113418 start.go:159] libmachine.API.Create for "old-k8s-version-021528" (driver="kvm2")
I0729 19:34:30.272695 1113418 client.go:168] LocalClient.Create starting
I0729 19:34:30.272728 1113418 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19312-1055011/.minikube/certs/ca.pem
I0729 19:34:30.272770 1113418 main.go:141] libmachine: Decoding PEM data...
I0729 19:34:30.272792 1113418 main.go:141] libmachine: Parsing certificate...
I0729 19:34:30.272879 1113418 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19312-1055011/.minikube/certs/cert.pem
I0729 19:34:30.272913 1113418 main.go:141] libmachine: Decoding PEM data...
I0729 19:34:30.272933 1113418 main.go:141] libmachine: Parsing certificate...
I0729 19:34:30.272958 1113418 main.go:141] libmachine: Running pre-create checks...
I0729 19:34:30.272976 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .PreCreateCheck
I0729 19:34:30.273363 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetConfigRaw
I0729 19:34:30.273849 1113418 main.go:141] libmachine: Creating machine...
I0729 19:34:30.273869 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .Create
I0729 19:34:30.274008 1113418 main.go:141] libmachine: (old-k8s-version-021528) Creating KVM machine...
I0729 19:34:30.275299 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found existing default KVM network
I0729 19:34:30.277492 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:30.277300 1113637 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015930}
I0729 19:34:30.277524 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | created network xml:
I0729 19:34:30.277541 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | <network>
I0729 19:34:30.277550 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | <name>mk-old-k8s-version-021528</name>
I0729 19:34:30.277562 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | <dns enable='no'/>
I0729 19:34:30.277572 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG |
I0729 19:34:30.277585 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0729 19:34:30.277601 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | <dhcp>
I0729 19:34:30.277631 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0729 19:34:30.277654 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | </dhcp>
I0729 19:34:30.277678 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | </ip>
I0729 19:34:30.277684 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG |
I0729 19:34:30.277695 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | </network>
I0729 19:34:30.277706 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG |
I0729 19:34:30.282635 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | trying to create private KVM network mk-old-k8s-version-021528 192.168.39.0/24...
I0729 19:34:30.359701 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | private KVM network mk-old-k8s-version-021528 192.168.39.0/24 created
I0729 19:34:30.359736 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:30.359666 1113637 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19312-1055011/.minikube
I0729 19:34:30.359767 1113418 main.go:141] libmachine: (old-k8s-version-021528) Setting up store path in /home/jenkins/minikube-integration/19312-1055011/.minikube/machines/old-k8s-version-021528 ...
I0729 19:34:30.359799 1113418 main.go:141] libmachine: (old-k8s-version-021528) Building disk image from file:///home/jenkins/minikube-integration/19312-1055011/.minikube/cache/iso/amd64/minikube-v1.33.1-1721690939-19319-amd64.iso
I0729 19:34:30.359816 1113418 main.go:141] libmachine: (old-k8s-version-021528) Downloading /home/jenkins/minikube-integration/19312-1055011/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19312-1055011/.minikube/cache/iso/amd64/minikube-v1.33.1-1721690939-19319-amd64.iso...
I0729 19:34:30.634541 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:30.634410 1113637 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19312-1055011/.minikube/machines/old-k8s-version-021528/id_rsa...
I0729 19:34:30.814817 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:30.814655 1113637 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19312-1055011/.minikube/machines/old-k8s-version-021528/old-k8s-version-021528.rawdisk...
I0729 19:34:30.814871 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Writing magic tar header
I0729 19:34:30.814902 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Writing SSH key tar header
I0729 19:34:30.814922 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:30.814815 1113637 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19312-1055011/.minikube/machines/old-k8s-version-021528 ...
I0729 19:34:30.815051 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19312-1055011/.minikube/machines/old-k8s-version-021528
I0729 19:34:30.815086 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19312-1055011/.minikube/machines
I0729 19:34:30.815101 1113418 main.go:141] libmachine: (old-k8s-version-021528) Setting executable bit set on /home/jenkins/minikube-integration/19312-1055011/.minikube/machines/old-k8s-version-021528 (perms=drwx------)
I0729 19:34:30.815114 1113418 main.go:141] libmachine: (old-k8s-version-021528) Setting executable bit set on /home/jenkins/minikube-integration/19312-1055011/.minikube/machines (perms=drwxr-xr-x)
I0729 19:34:30.815120 1113418 main.go:141] libmachine: (old-k8s-version-021528) Setting executable bit set on /home/jenkins/minikube-integration/19312-1055011/.minikube (perms=drwxr-xr-x)
I0729 19:34:30.815128 1113418 main.go:141] libmachine: (old-k8s-version-021528) Setting executable bit set on /home/jenkins/minikube-integration/19312-1055011 (perms=drwxrwxr-x)
I0729 19:34:30.815141 1113418 main.go:141] libmachine: (old-k8s-version-021528) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0729 19:34:30.815153 1113418 main.go:141] libmachine: (old-k8s-version-021528) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0729 19:34:30.815165 1113418 main.go:141] libmachine: (old-k8s-version-021528) Creating domain...
I0729 19:34:30.815178 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19312-1055011/.minikube
I0729 19:34:30.815232 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19312-1055011
I0729 19:34:30.815267 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0729 19:34:30.815281 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Checking permissions on dir: /home/jenkins
I0729 19:34:30.815293 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Checking permissions on dir: /home
I0729 19:34:30.815312 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Skipping /home - not owner
I0729 19:34:30.816256 1113418 main.go:141] libmachine: (old-k8s-version-021528) define libvirt domain using xml:
I0729 19:34:30.816295 1113418 main.go:141] libmachine: (old-k8s-version-021528) <domain type='kvm'>
I0729 19:34:30.816309 1113418 main.go:141] libmachine: (old-k8s-version-021528) <name>old-k8s-version-021528</name>
I0729 19:34:30.816321 1113418 main.go:141] libmachine: (old-k8s-version-021528) <memory unit='MiB'>2200</memory>
I0729 19:34:30.816328 1113418 main.go:141] libmachine: (old-k8s-version-021528) <vcpu>2</vcpu>
I0729 19:34:30.816333 1113418 main.go:141] libmachine: (old-k8s-version-021528) <features>
I0729 19:34:30.816338 1113418 main.go:141] libmachine: (old-k8s-version-021528) <acpi/>
I0729 19:34:30.816342 1113418 main.go:141] libmachine: (old-k8s-version-021528) <apic/>
I0729 19:34:30.816347 1113418 main.go:141] libmachine: (old-k8s-version-021528) <pae/>
I0729 19:34:30.816362 1113418 main.go:141] libmachine: (old-k8s-version-021528)
I0729 19:34:30.816367 1113418 main.go:141] libmachine: (old-k8s-version-021528) </features>
I0729 19:34:30.816372 1113418 main.go:141] libmachine: (old-k8s-version-021528) <cpu mode='host-passthrough'>
I0729 19:34:30.816390 1113418 main.go:141] libmachine: (old-k8s-version-021528)
I0729 19:34:30.816399 1113418 main.go:141] libmachine: (old-k8s-version-021528) </cpu>
I0729 19:34:30.816407 1113418 main.go:141] libmachine: (old-k8s-version-021528) <os>
I0729 19:34:30.816414 1113418 main.go:141] libmachine: (old-k8s-version-021528) <type>hvm</type>
I0729 19:34:30.816421 1113418 main.go:141] libmachine: (old-k8s-version-021528) <boot dev='cdrom'/>
I0729 19:34:30.816426 1113418 main.go:141] libmachine: (old-k8s-version-021528) <boot dev='hd'/>
I0729 19:34:30.816432 1113418 main.go:141] libmachine: (old-k8s-version-021528) <bootmenu enable='no'/>
I0729 19:34:30.816438 1113418 main.go:141] libmachine: (old-k8s-version-021528) </os>
I0729 19:34:30.816446 1113418 main.go:141] libmachine: (old-k8s-version-021528) <devices>
I0729 19:34:30.816453 1113418 main.go:141] libmachine: (old-k8s-version-021528) <disk type='file' device='cdrom'>
I0729 19:34:30.816465 1113418 main.go:141] libmachine: (old-k8s-version-021528) <source file='/home/jenkins/minikube-integration/19312-1055011/.minikube/machines/old-k8s-version-021528/boot2docker.iso'/>
I0729 19:34:30.816472 1113418 main.go:141] libmachine: (old-k8s-version-021528) <target dev='hdc' bus='scsi'/>
I0729 19:34:30.816480 1113418 main.go:141] libmachine: (old-k8s-version-021528) <readonly/>
I0729 19:34:30.816487 1113418 main.go:141] libmachine: (old-k8s-version-021528) </disk>
I0729 19:34:30.816495 1113418 main.go:141] libmachine: (old-k8s-version-021528) <disk type='file' device='disk'>
I0729 19:34:30.816503 1113418 main.go:141] libmachine: (old-k8s-version-021528) <driver name='qemu' type='raw' cache='default' io='threads' />
I0729 19:34:30.816516 1113418 main.go:141] libmachine: (old-k8s-version-021528) <source file='/home/jenkins/minikube-integration/19312-1055011/.minikube/machines/old-k8s-version-021528/old-k8s-version-021528.rawdisk'/>
I0729 19:34:30.816523 1113418 main.go:141] libmachine: (old-k8s-version-021528) <target dev='hda' bus='virtio'/>
I0729 19:34:30.816531 1113418 main.go:141] libmachine: (old-k8s-version-021528) </disk>
I0729 19:34:30.816544 1113418 main.go:141] libmachine: (old-k8s-version-021528) <interface type='network'>
I0729 19:34:30.816554 1113418 main.go:141] libmachine: (old-k8s-version-021528) <source network='mk-old-k8s-version-021528'/>
I0729 19:34:30.816562 1113418 main.go:141] libmachine: (old-k8s-version-021528) <model type='virtio'/>
I0729 19:34:30.816579 1113418 main.go:141] libmachine: (old-k8s-version-021528) </interface>
I0729 19:34:30.816587 1113418 main.go:141] libmachine: (old-k8s-version-021528) <interface type='network'>
I0729 19:34:30.816596 1113418 main.go:141] libmachine: (old-k8s-version-021528) <source network='default'/>
I0729 19:34:30.816603 1113418 main.go:141] libmachine: (old-k8s-version-021528) <model type='virtio'/>
I0729 19:34:30.816609 1113418 main.go:141] libmachine: (old-k8s-version-021528) </interface>
I0729 19:34:30.816618 1113418 main.go:141] libmachine: (old-k8s-version-021528) <serial type='pty'>
I0729 19:34:30.816649 1113418 main.go:141] libmachine: (old-k8s-version-021528) <target port='0'/>
I0729 19:34:30.816668 1113418 main.go:141] libmachine: (old-k8s-version-021528) </serial>
I0729 19:34:30.816679 1113418 main.go:141] libmachine: (old-k8s-version-021528) <console type='pty'>
I0729 19:34:30.816687 1113418 main.go:141] libmachine: (old-k8s-version-021528) <target type='serial' port='0'/>
I0729 19:34:30.816697 1113418 main.go:141] libmachine: (old-k8s-version-021528) </console>
I0729 19:34:30.816705 1113418 main.go:141] libmachine: (old-k8s-version-021528) <rng model='virtio'>
I0729 19:34:30.816716 1113418 main.go:141] libmachine: (old-k8s-version-021528) <backend model='random'>/dev/random</backend>
I0729 19:34:30.816722 1113418 main.go:141] libmachine: (old-k8s-version-021528) </rng>
I0729 19:34:30.816730 1113418 main.go:141] libmachine: (old-k8s-version-021528)
I0729 19:34:30.816736 1113418 main.go:141] libmachine: (old-k8s-version-021528)
I0729 19:34:30.816756 1113418 main.go:141] libmachine: (old-k8s-version-021528) </devices>
I0729 19:34:30.816773 1113418 main.go:141] libmachine: (old-k8s-version-021528) </domain>
I0729 19:34:30.816784 1113418 main.go:141] libmachine: (old-k8s-version-021528)
I0729 19:34:30.821067 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:7e:b4:fa in network default
I0729 19:34:30.821679 1113418 main.go:141] libmachine: (old-k8s-version-021528) Ensuring networks are active...
I0729 19:34:30.821703 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:30.822524 1113418 main.go:141] libmachine: (old-k8s-version-021528) Ensuring network default is active
I0729 19:34:30.822827 1113418 main.go:141] libmachine: (old-k8s-version-021528) Ensuring network mk-old-k8s-version-021528 is active
I0729 19:34:30.823413 1113418 main.go:141] libmachine: (old-k8s-version-021528) Getting domain xml...
I0729 19:34:30.824203 1113418 main.go:141] libmachine: (old-k8s-version-021528) Creating domain...
I0729 19:34:32.292906 1113418 main.go:141] libmachine: (old-k8s-version-021528) Waiting to get IP...
I0729 19:34:32.293821 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:32.294348 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find current IP address of domain old-k8s-version-021528 in network mk-old-k8s-version-021528
I0729 19:34:32.294375 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:32.294330 1113637 retry.go:31] will retry after 210.617574ms: waiting for machine to come up
I0729 19:34:32.510302 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:32.511984 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find current IP address of domain old-k8s-version-021528 in network mk-old-k8s-version-021528
I0729 19:34:32.512016 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:32.511953 1113637 retry.go:31] will retry after 370.681205ms: waiting for machine to come up
I0729 19:34:32.885636 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:32.886736 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find current IP address of domain old-k8s-version-021528 in network mk-old-k8s-version-021528
I0729 19:34:32.886760 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:32.886649 1113637 retry.go:31] will retry after 390.095435ms: waiting for machine to come up
I0729 19:34:33.279909 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:33.280354 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find current IP address of domain old-k8s-version-021528 in network mk-old-k8s-version-021528
I0729 19:34:33.280382 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:33.280322 1113637 retry.go:31] will retry after 387.880335ms: waiting for machine to come up
I0729 19:34:33.672960 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:33.675113 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find current IP address of domain old-k8s-version-021528 in network mk-old-k8s-version-021528
I0729 19:34:33.675140 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:33.675013 1113637 retry.go:31] will retry after 688.254582ms: waiting for machine to come up
I0729 19:34:34.364518 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:34.365099 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find current IP address of domain old-k8s-version-021528 in network mk-old-k8s-version-021528
I0729 19:34:34.365125 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:34.365019 1113637 retry.go:31] will retry after 758.544526ms: waiting for machine to come up
I0729 19:34:35.125169 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:35.125646 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find current IP address of domain old-k8s-version-021528 in network mk-old-k8s-version-021528
I0729 19:34:35.125683 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:35.125608 1113637 retry.go:31] will retry after 737.485255ms: waiting for machine to come up
I0729 19:34:35.865107 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:35.865711 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find current IP address of domain old-k8s-version-021528 in network mk-old-k8s-version-021528
I0729 19:34:35.865754 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:35.865620 1113637 retry.go:31] will retry after 1.420035355s: waiting for machine to come up
I0729 19:34:37.287973 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:37.288668 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find current IP address of domain old-k8s-version-021528 in network mk-old-k8s-version-021528
I0729 19:34:37.288697 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:37.288564 1113637 retry.go:31] will retry after 1.648688258s: waiting for machine to come up
I0729 19:34:38.938573 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:38.939181 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find current IP address of domain old-k8s-version-021528 in network mk-old-k8s-version-021528
I0729 19:34:38.939210 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:38.939129 1113637 retry.go:31] will retry after 1.912797583s: waiting for machine to come up
I0729 19:34:40.853376 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:40.854035 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find current IP address of domain old-k8s-version-021528 in network mk-old-k8s-version-021528
I0729 19:34:40.854062 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:40.853931 1113637 retry.go:31] will retry after 2.744984198s: waiting for machine to come up
I0729 19:34:43.743520 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:43.744117 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find current IP address of domain old-k8s-version-021528 in network mk-old-k8s-version-021528
I0729 19:34:43.744146 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:43.744077 1113637 retry.go:31] will retry after 2.621851369s: waiting for machine to come up
I0729 19:34:46.367596 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:46.368158 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find current IP address of domain old-k8s-version-021528 in network mk-old-k8s-version-021528
I0729 19:34:46.368201 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:46.368104 1113637 retry.go:31] will retry after 4.090468469s: waiting for machine to come up
I0729 19:34:50.460420 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:50.461001 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find current IP address of domain old-k8s-version-021528 in network mk-old-k8s-version-021528
I0729 19:34:50.461027 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | I0729 19:34:50.460962 1113637 retry.go:31] will retry after 5.492855236s: waiting for machine to come up
I0729 19:34:55.955369 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:55.955907 1113418 main.go:141] libmachine: (old-k8s-version-021528) Found IP for machine: 192.168.39.65
I0729 19:34:55.955931 1113418 main.go:141] libmachine: (old-k8s-version-021528) Reserving static IP address...
I0729 19:34:55.955960 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has current primary IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:55.956338 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-021528", mac: "52:54:00:12:c7:d2", ip: "192.168.39.65"} in network mk-old-k8s-version-021528
I0729 19:34:56.031369 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Getting to WaitForSSH function...
I0729 19:34:56.031400 1113418 main.go:141] libmachine: (old-k8s-version-021528) Reserved static IP address: 192.168.39.65
I0729 19:34:56.031432 1113418 main.go:141] libmachine: (old-k8s-version-021528) Waiting for SSH to be available...
I0729 19:34:56.034216 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:56.034549 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528
I0729 19:34:56.034573 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | unable to find defined IP address of network mk-old-k8s-version-021528 interface with MAC address 52:54:00:12:c7:d2
I0729 19:34:56.034737 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Using SSH client type: external
I0729 19:34:56.034762 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Using SSH private key: /home/jenkins/minikube-integration/19312-1055011/.minikube/machines/old-k8s-version-021528/id_rsa (-rw-------)
I0729 19:34:56.034870 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19312-1055011/.minikube/machines/old-k8s-version-021528/id_rsa -p 22] /usr/bin/ssh <nil>}
I0729 19:34:56.034909 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | About to run SSH command:
I0729 19:34:56.034933 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | exit 0
I0729 19:34:56.038300 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | SSH cmd err, output: exit status 255:
I0729 19:34:56.038325 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0729 19:34:56.038335 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | command : exit 0
I0729 19:34:56.038350 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | err : exit status 255
I0729 19:34:56.038363 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | output :
I0729 19:34:59.039015 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Getting to WaitForSSH function...
I0729 19:34:59.041658 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.042117 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:34:59.042145 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.042275 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Using SSH client type: external
I0729 19:34:59.042313 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Using SSH private key: /home/jenkins/minikube-integration/19312-1055011/.minikube/machines/old-k8s-version-021528/id_rsa (-rw-------)
I0729 19:34:59.042378 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.65 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19312-1055011/.minikube/machines/old-k8s-version-021528/id_rsa -p 22] /usr/bin/ssh <nil>}
I0729 19:34:59.042408 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | About to run SSH command:
I0729 19:34:59.042423 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | exit 0
I0729 19:34:59.171182 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | SSH cmd err, output: <nil>:
I0729 19:34:59.171428 1113418 main.go:141] libmachine: (old-k8s-version-021528) KVM machine creation complete!
I0729 19:34:59.171803 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetConfigRaw
I0729 19:34:59.172407 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .DriverName
I0729 19:34:59.172644 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .DriverName
I0729 19:34:59.172810 1113418 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0729 19:34:59.172825 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetState
I0729 19:34:59.174198 1113418 main.go:141] libmachine: Detecting operating system of created instance...
I0729 19:34:59.174216 1113418 main.go:141] libmachine: Waiting for SSH to be available...
I0729 19:34:59.174223 1113418 main.go:141] libmachine: Getting to WaitForSSH function...
I0729 19:34:59.174231 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHHostname
I0729 19:34:59.176686 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.177035 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:34:59.177062 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.177222 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHPort
I0729 19:34:59.177415 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHKeyPath
I0729 19:34:59.177585 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHKeyPath
I0729 19:34:59.177730 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHUsername
I0729 19:34:59.177863 1113418 main.go:141] libmachine: Using SSH client type: native
I0729 19:34:59.178064 1113418 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.65 22 <nil> <nil>}
I0729 19:34:59.178078 1113418 main.go:141] libmachine: About to run SSH command:
exit 0
I0729 19:34:59.286271 1113418 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0729 19:34:59.286296 1113418 main.go:141] libmachine: Detecting the provisioner...
I0729 19:34:59.286304 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHHostname
I0729 19:34:59.288950 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.289326 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:34:59.289355 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.289551 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHPort
I0729 19:34:59.289747 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHKeyPath
I0729 19:34:59.289877 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHKeyPath
I0729 19:34:59.290000 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHUsername
I0729 19:34:59.290162 1113418 main.go:141] libmachine: Using SSH client type: native
I0729 19:34:59.290342 1113418 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.65 22 <nil> <nil>}
I0729 19:34:59.290360 1113418 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0729 19:34:59.399526 1113418 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0729 19:34:59.399643 1113418 main.go:141] libmachine: found compatible host: buildroot
I0729 19:34:59.399660 1113418 main.go:141] libmachine: Provisioning with buildroot...
I0729 19:34:59.399671 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetMachineName
I0729 19:34:59.399958 1113418 buildroot.go:166] provisioning hostname "old-k8s-version-021528"
I0729 19:34:59.399986 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetMachineName
I0729 19:34:59.400182 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHHostname
I0729 19:34:59.403243 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.403634 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:34:59.403661 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.403845 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHPort
I0729 19:34:59.404035 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHKeyPath
I0729 19:34:59.404222 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHKeyPath
I0729 19:34:59.404354 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHUsername
I0729 19:34:59.404511 1113418 main.go:141] libmachine: Using SSH client type: native
I0729 19:34:59.404753 1113418 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.65 22 <nil> <nil>}
I0729 19:34:59.404774 1113418 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-021528 && echo "old-k8s-version-021528" | sudo tee /etc/hostname
I0729 19:34:59.528939 1113418 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-021528
I0729 19:34:59.528968 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHHostname
I0729 19:34:59.531922 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.532292 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:34:59.532315 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.532504 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHPort
I0729 19:34:59.532728 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHKeyPath
I0729 19:34:59.532884 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHKeyPath
I0729 19:34:59.533033 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHUsername
I0729 19:34:59.533185 1113418 main.go:141] libmachine: Using SSH client type: native
I0729 19:34:59.533353 1113418 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.65 22 <nil> <nil>}
I0729 19:34:59.533369 1113418 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-021528' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-021528/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-021528' | sudo tee -a /etc/hosts;
fi
fi
I0729 19:34:59.651226 1113418 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0729 19:34:59.651271 1113418 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19312-1055011/.minikube CaCertPath:/home/jenkins/minikube-integration/19312-1055011/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19312-1055011/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19312-1055011/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19312-1055011/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19312-1055011/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19312-1055011/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19312-1055011/.minikube}
I0729 19:34:59.651289 1113418 buildroot.go:174] setting up certificates
I0729 19:34:59.651297 1113418 provision.go:84] configureAuth start
I0729 19:34:59.651306 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetMachineName
I0729 19:34:59.651561 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetIP
I0729 19:34:59.654388 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.654772 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:34:59.654800 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.654932 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHHostname
I0729 19:34:59.657129 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.657548 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:34:59.657570 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.657733 1113418 provision.go:143] copyHostCerts
I0729 19:34:59.657814 1113418 exec_runner.go:144] found /home/jenkins/minikube-integration/19312-1055011/.minikube/ca.pem, removing ...
I0729 19:34:59.657829 1113418 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19312-1055011/.minikube/ca.pem
I0729 19:34:59.657883 1113418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19312-1055011/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19312-1055011/.minikube/ca.pem (1082 bytes)
I0729 19:34:59.657974 1113418 exec_runner.go:144] found /home/jenkins/minikube-integration/19312-1055011/.minikube/cert.pem, removing ...
I0729 19:34:59.657981 1113418 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19312-1055011/.minikube/cert.pem
I0729 19:34:59.658002 1113418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19312-1055011/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19312-1055011/.minikube/cert.pem (1123 bytes)
I0729 19:34:59.658063 1113418 exec_runner.go:144] found /home/jenkins/minikube-integration/19312-1055011/.minikube/key.pem, removing ...
I0729 19:34:59.658070 1113418 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19312-1055011/.minikube/key.pem
I0729 19:34:59.658086 1113418 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19312-1055011/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19312-1055011/.minikube/key.pem (1679 bytes)
I0729 19:34:59.658142 1113418 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19312-1055011/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19312-1055011/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19312-1055011/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-021528 san=[127.0.0.1 192.168.39.65 localhost minikube old-k8s-version-021528]
I0729 19:34:59.796497 1113418 provision.go:177] copyRemoteCerts
I0729 19:34:59.796572 1113418 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0729 19:34:59.796605 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHHostname
I0729 19:34:59.799203 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.799574 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:34:59.799604 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.799805 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHPort
I0729 19:34:59.799996 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHKeyPath
I0729 19:34:59.800134 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHUsername
I0729 19:34:59.800247 1113418 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19312-1055011/.minikube/machines/old-k8s-version-021528/id_rsa Username:docker}
I0729 19:34:59.889485 1113418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-1055011/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0729 19:34:59.914421 1113418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-1055011/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0729 19:34:59.940494 1113418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-1055011/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0729 19:34:59.967198 1113418 provision.go:87] duration metric: took 315.887721ms to configureAuth
I0729 19:34:59.967224 1113418 buildroot.go:189] setting minikube options for container-runtime
I0729 19:34:59.967438 1113418 config.go:182] Loaded profile config "old-k8s-version-021528": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0729 19:34:59.967534 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHHostname
I0729 19:34:59.970409 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.970783 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:34:59.970819 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:34:59.971086 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHPort
I0729 19:34:59.971302 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHKeyPath
I0729 19:34:59.971451 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHKeyPath
I0729 19:34:59.971638 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHUsername
I0729 19:34:59.971850 1113418 main.go:141] libmachine: Using SSH client type: native
I0729 19:34:59.972026 1113418 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.65 22 <nil> <nil>}
I0729 19:34:59.972041 1113418 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0729 19:35:00.254296 1113418 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0729 19:35:00.254328 1113418 main.go:141] libmachine: Checking connection to Docker...
I0729 19:35:00.254340 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetURL
I0729 19:35:00.255707 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | Using libvirt version 6000000
I0729 19:35:00.257951 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:35:00.258354 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:35:00.258385 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:35:00.258572 1113418 main.go:141] libmachine: Docker is up and running!
I0729 19:35:00.258592 1113418 main.go:141] libmachine: Reticulating splines...
I0729 19:35:00.258601 1113418 client.go:171] duration metric: took 29.985895589s to LocalClient.Create
I0729 19:35:00.258630 1113418 start.go:167] duration metric: took 29.985964236s to libmachine.API.Create "old-k8s-version-021528"
I0729 19:35:00.258639 1113418 start.go:293] postStartSetup for "old-k8s-version-021528" (driver="kvm2")
I0729 19:35:00.258650 1113418 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0729 19:35:00.258667 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .DriverName
I0729 19:35:00.258931 1113418 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0729 19:35:00.258956 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHHostname
I0729 19:35:00.261399 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:35:00.261758 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:35:00.261783 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:35:00.261891 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHPort
I0729 19:35:00.262084 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHKeyPath
I0729 19:35:00.262233 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHUsername
I0729 19:35:00.262470 1113418 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19312-1055011/.minikube/machines/old-k8s-version-021528/id_rsa Username:docker}
I0729 19:35:00.350575 1113418 ssh_runner.go:195] Run: cat /etc/os-release
I0729 19:35:00.355210 1113418 info.go:137] Remote host: Buildroot 2023.02.9
I0729 19:35:00.355247 1113418 filesync.go:126] Scanning /home/jenkins/minikube-integration/19312-1055011/.minikube/addons for local assets ...
I0729 19:35:00.355317 1113418 filesync.go:126] Scanning /home/jenkins/minikube-integration/19312-1055011/.minikube/files for local assets ...
I0729 19:35:00.355438 1113418 filesync.go:149] local asset: /home/jenkins/minikube-integration/19312-1055011/.minikube/files/etc/ssl/certs/10622722.pem -> 10622722.pem in /etc/ssl/certs
I0729 19:35:00.355561 1113418 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0729 19:35:00.365845 1113418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-1055011/.minikube/files/etc/ssl/certs/10622722.pem --> /etc/ssl/certs/10622722.pem (1708 bytes)
I0729 19:35:00.392865 1113418 start.go:296] duration metric: took 134.207648ms for postStartSetup
I0729 19:35:00.392934 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetConfigRaw
I0729 19:35:00.393625 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetIP
I0729 19:35:00.396571 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:35:00.397010 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:35:00.397041 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:35:00.397248 1113418 profile.go:143] Saving config to /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/config.json ...
I0729 19:35:00.397480 1113418 start.go:128] duration metric: took 30.149531346s to createHost
I0729 19:35:00.397507 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHHostname
I0729 19:35:00.400026 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:35:00.400390 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:35:00.400421 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:35:00.400585 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHPort
I0729 19:35:00.400772 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHKeyPath
I0729 19:35:00.400966 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHKeyPath
I0729 19:35:00.401144 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHUsername
I0729 19:35:00.401378 1113418 main.go:141] libmachine: Using SSH client type: native
I0729 19:35:00.401603 1113418 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.65 22 <nil> <nil>}
I0729 19:35:00.401632 1113418 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0729 19:35:00.520176 1113418 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722281700.506578621
I0729 19:35:00.520218 1113418 fix.go:216] guest clock: 1722281700.506578621
I0729 19:35:00.520225 1113418 fix.go:229] Guest: 2024-07-29 19:35:00.506578621 +0000 UTC Remote: 2024-07-29 19:35:00.397494773 +0000 UTC m=+46.696038150 (delta=109.083848ms)
I0729 19:35:00.520257 1113418 fix.go:200] guest clock delta is within tolerance: 109.083848ms
I0729 19:35:00.520268 1113418 start.go:83] releasing machines lock for "old-k8s-version-021528", held for 30.272497001s
I0729 19:35:00.520299 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .DriverName
I0729 19:35:00.520579 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetIP
I0729 19:35:00.523649 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:35:00.524025 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:35:00.524058 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:35:00.524185 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .DriverName
I0729 19:35:00.524746 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .DriverName
I0729 19:35:00.524944 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .DriverName
I0729 19:35:00.525055 1113418 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0729 19:35:00.525110 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHHostname
I0729 19:35:00.525177 1113418 ssh_runner.go:195] Run: cat /version.json
I0729 19:35:00.525199 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHHostname
I0729 19:35:00.527977 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:35:00.528305 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:35:00.528337 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:35:00.528358 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:35:00.528496 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHPort
I0729 19:35:00.528692 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHKeyPath
I0729 19:35:00.528862 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHUsername
I0729 19:35:00.528912 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:35:00.528940 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:35:00.529015 1113418 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19312-1055011/.minikube/machines/old-k8s-version-021528/id_rsa Username:docker}
I0729 19:35:00.529128 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHPort
I0729 19:35:00.529329 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHKeyPath
I0729 19:35:00.529499 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetSSHUsername
I0729 19:35:00.529684 1113418 sshutil.go:53] new ssh client: &{IP:192.168.39.65 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19312-1055011/.minikube/machines/old-k8s-version-021528/id_rsa Username:docker}
I0729 19:35:00.639507 1113418 ssh_runner.go:195] Run: systemctl --version
I0729 19:35:00.648375 1113418 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0729 19:35:00.821205 1113418 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0729 19:35:00.828048 1113418 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0729 19:35:00.828143 1113418 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0729 19:35:00.846281 1113418 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0729 19:35:00.846318 1113418 start.go:495] detecting cgroup driver to use...
I0729 19:35:00.846405 1113418 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0729 19:35:00.864526 1113418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0729 19:35:00.883716 1113418 docker.go:217] disabling cri-docker service (if available) ...
I0729 19:35:00.883780 1113418 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0729 19:35:00.899233 1113418 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0729 19:35:00.915912 1113418 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0729 19:35:01.047810 1113418 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0729 19:35:01.231307 1113418 docker.go:233] disabling docker service ...
I0729 19:35:01.231381 1113418 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0729 19:35:01.247031 1113418 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0729 19:35:01.262229 1113418 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0729 19:35:01.397618 1113418 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0729 19:35:01.537000 1113418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0729 19:35:01.554183 1113418 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0729 19:35:01.574722 1113418 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0729 19:35:01.574780 1113418 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0729 19:35:01.585521 1113418 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0729 19:35:01.585610 1113418 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0729 19:35:01.596463 1113418 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0729 19:35:01.609747 1113418 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0729 19:35:01.621499 1113418 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0729 19:35:01.632696 1113418 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0729 19:35:01.642719 1113418 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0729 19:35:01.642811 1113418 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0729 19:35:01.657422 1113418 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0729 19:35:01.667492 1113418 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0729 19:35:01.791811 1113418 ssh_runner.go:195] Run: sudo systemctl restart crio
I0729 19:35:01.949310 1113418 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0729 19:35:01.949400 1113418 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0729 19:35:01.955527 1113418 start.go:563] Will wait 60s for crictl version
I0729 19:35:01.955597 1113418 ssh_runner.go:195] Run: which crictl
I0729 19:35:01.959937 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0729 19:35:02.001607 1113418 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0729 19:35:02.001714 1113418 ssh_runner.go:195] Run: crio --version
I0729 19:35:02.032220 1113418 ssh_runner.go:195] Run: crio --version
I0729 19:35:02.064085 1113418 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0729 19:35:02.065166 1113418 main.go:141] libmachine: (old-k8s-version-021528) Calling .GetIP
I0729 19:35:02.068371 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:35:02.068754 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:12:c7:d2", ip: ""} in network mk-old-k8s-version-021528: {Iface:virbr1 ExpiryTime:2024-07-29 20:34:47 +0000 UTC Type:0 Mac:52:54:00:12:c7:d2 Iaid: IPaddr:192.168.39.65 Prefix:24 Hostname:old-k8s-version-021528 Clientid:01:52:54:00:12:c7:d2}
I0729 19:35:02.068785 1113418 main.go:141] libmachine: (old-k8s-version-021528) DBG | domain old-k8s-version-021528 has defined IP address 192.168.39.65 and MAC address 52:54:00:12:c7:d2 in network mk-old-k8s-version-021528
I0729 19:35:02.069051 1113418 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0729 19:35:02.073167 1113418 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0729 19:35:02.086617 1113418 kubeadm.go:883] updating cluster {Name:old-k8s-version-021528 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19319/minikube-v1.33.1-1721690939-19319-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-021528 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.65 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0729 19:35:02.086765 1113418 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0729 19:35:02.086826 1113418 ssh_runner.go:195] Run: sudo crictl images --output json
I0729 19:35:02.124555 1113418 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0729 19:35:02.124624 1113418 ssh_runner.go:195] Run: which lz4
I0729 19:35:02.129189 1113418 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0729 19:35:02.134215 1113418 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0729 19:35:02.134258 1113418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-1055011/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0729 19:35:03.903816 1113418 crio.go:462] duration metric: took 1.774666249s to copy over tarball
I0729 19:35:03.903900 1113418 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0729 19:35:07.009196 1113418 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.105259532s)
I0729 19:35:07.009241 1113418 crio.go:469] duration metric: took 3.10539516s to extract the tarball
I0729 19:35:07.009252 1113418 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0729 19:35:07.053305 1113418 ssh_runner.go:195] Run: sudo crictl images --output json
I0729 19:35:07.102437 1113418 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0729 19:35:07.102468 1113418 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0729 19:35:07.102565 1113418 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0729 19:35:07.102589 1113418 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0729 19:35:07.102630 1113418 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0729 19:35:07.102641 1113418 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0729 19:35:07.102665 1113418 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0729 19:35:07.102821 1113418 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0729 19:35:07.102605 1113418 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0729 19:35:07.102827 1113418 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0729 19:35:07.104022 1113418 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0729 19:35:07.104090 1113418 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0729 19:35:07.104089 1113418 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0729 19:35:07.104094 1113418 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0729 19:35:07.104097 1113418 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0729 19:35:07.104163 1113418 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0729 19:35:07.104097 1113418 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0729 19:35:07.104635 1113418 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0729 19:35:07.265012 1113418 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0729 19:35:07.272810 1113418 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0729 19:35:07.281020 1113418 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0729 19:35:07.285683 1113418 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0729 19:35:07.288164 1113418 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0729 19:35:07.317114 1113418 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0729 19:35:07.348748 1113418 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0729 19:35:07.348796 1113418 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0729 19:35:07.348851 1113418 ssh_runner.go:195] Run: which crictl
I0729 19:35:07.358573 1113418 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0729 19:35:07.371246 1113418 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0729 19:35:07.442411 1113418 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0729 19:35:07.442464 1113418 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0729 19:35:07.442474 1113418 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0729 19:35:07.442513 1113418 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0729 19:35:07.442528 1113418 ssh_runner.go:195] Run: which crictl
I0729 19:35:07.442556 1113418 ssh_runner.go:195] Run: which crictl
I0729 19:35:07.476462 1113418 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0729 19:35:07.476521 1113418 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0729 19:35:07.476524 1113418 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0729 19:35:07.476562 1113418 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0729 19:35:07.476578 1113418 ssh_runner.go:195] Run: which crictl
I0729 19:35:07.476625 1113418 ssh_runner.go:195] Run: which crictl
I0729 19:35:07.525954 1113418 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0729 19:35:07.525999 1113418 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0729 19:35:07.526002 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0729 19:35:07.526019 1113418 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0729 19:35:07.526038 1113418 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0729 19:35:07.526040 1113418 ssh_runner.go:195] Run: which crictl
I0729 19:35:07.526066 1113418 ssh_runner.go:195] Run: which crictl
I0729 19:35:07.609311 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0729 19:35:07.609344 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0729 19:35:07.609406 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0729 19:35:07.609421 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0729 19:35:07.609466 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0729 19:35:07.609497 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0729 19:35:07.609528 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0729 19:35:07.787347 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0729 19:35:07.787452 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0729 19:35:07.787470 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0729 19:35:07.787571 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0729 19:35:07.787650 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0729 19:35:07.787666 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0729 19:35:07.787895 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0729 19:35:07.943213 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0729 19:35:07.943259 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0729 19:35:07.943268 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0729 19:35:07.943333 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0729 19:35:07.943367 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0729 19:35:07.943427 1113418 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19312-1055011/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0729 19:35:07.943449 1113418 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0729 19:35:08.054210 1113418 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19312-1055011/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0729 19:35:08.081511 1113418 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19312-1055011/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0729 19:35:08.081519 1113418 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19312-1055011/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0729 19:35:08.081601 1113418 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19312-1055011/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0729 19:35:08.081637 1113418 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19312-1055011/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0729 19:35:08.088730 1113418 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19312-1055011/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0729 19:35:08.088792 1113418 cache_images.go:92] duration metric: took 986.295877ms to LoadCachedImages
W0729 19:35:08.088888 1113418 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19312-1055011/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19312-1055011/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
I0729 19:35:08.088907 1113418 kubeadm.go:934] updating node { 192.168.39.65 8443 v1.20.0 crio true true} ...
I0729 19:35:08.089063 1113418 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-021528 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.65
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-021528 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0729 19:35:08.089133 1113418 ssh_runner.go:195] Run: crio config
I0729 19:35:08.135999 1113418 cni.go:84] Creating CNI manager for ""
I0729 19:35:08.136033 1113418 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0729 19:35:08.136045 1113418 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0729 19:35:08.136072 1113418 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.65 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-021528 NodeName:old-k8s-version-021528 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.65"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.65 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0729 19:35:08.136261 1113418 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.65
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-021528"
kubeletExtraArgs:
node-ip: 192.168.39.65
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.65"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0729 19:35:08.136333 1113418 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0729 19:35:08.147350 1113418 binaries.go:44] Found k8s binaries, skipping transfer
I0729 19:35:08.147430 1113418 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0729 19:35:08.158167 1113418 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0729 19:35:08.180245 1113418 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0729 19:35:08.201691 1113418 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0729 19:35:08.223296 1113418 ssh_runner.go:195] Run: grep 192.168.39.65 control-plane.minikube.internal$ /etc/hosts
I0729 19:35:08.231015 1113418 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.65 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0729 19:35:08.248209 1113418 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0729 19:35:08.394076 1113418 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0729 19:35:08.412408 1113418 certs.go:68] Setting up /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528 for IP: 192.168.39.65
I0729 19:35:08.412437 1113418 certs.go:194] generating shared ca certs ...
I0729 19:35:08.412457 1113418 certs.go:226] acquiring lock for ca certs: {Name:mkd1f0b3d7e82ac23e713dd6b75409e103935b02 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 19:35:08.412637 1113418 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19312-1055011/.minikube/ca.key
I0729 19:35:08.412699 1113418 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19312-1055011/.minikube/proxy-client-ca.key
I0729 19:35:08.412715 1113418 certs.go:256] generating profile certs ...
I0729 19:35:08.412792 1113418 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/client.key
I0729 19:35:08.412812 1113418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/client.crt with IP's: []
I0729 19:35:08.588200 1113418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/client.crt ...
I0729 19:35:08.588233 1113418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/client.crt: {Name:mk79265f7e4e8f2a1c7cae0f161ed1f49b6bd9de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 19:35:08.606500 1113418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/client.key ...
I0729 19:35:08.606539 1113418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/client.key: {Name:mka8afd28e0df6b10f22b32fd80519fe2c75f176 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 19:35:08.606769 1113418 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/apiserver.key.1bfec4c5
I0729 19:35:08.606800 1113418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/apiserver.crt.1bfec4c5 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.65]
I0729 19:35:08.840337 1113418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/apiserver.crt.1bfec4c5 ...
I0729 19:35:08.840379 1113418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/apiserver.crt.1bfec4c5: {Name:mk4c3889f19377860e930a0b13606dc585d817fe Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 19:35:08.847678 1113418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/apiserver.key.1bfec4c5 ...
I0729 19:35:08.847719 1113418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/apiserver.key.1bfec4c5: {Name:mk614014e9bfe4f8e185a039ab5c41025e55c6a6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 19:35:08.847852 1113418 certs.go:381] copying /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/apiserver.crt.1bfec4c5 -> /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/apiserver.crt
I0729 19:35:08.847957 1113418 certs.go:385] copying /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/apiserver.key.1bfec4c5 -> /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/apiserver.key
I0729 19:35:08.848043 1113418 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/proxy-client.key
I0729 19:35:08.848081 1113418 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/proxy-client.crt with IP's: []
I0729 19:35:08.948029 1113418 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/proxy-client.crt ...
I0729 19:35:08.948064 1113418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/proxy-client.crt: {Name:mk00791235583fe81d37a14428f36c2b931f2c01 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 19:35:08.948292 1113418 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/proxy-client.key ...
I0729 19:35:08.948314 1113418 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/proxy-client.key: {Name:mk58dc7332a8f3ed921a1ae3bf4d49011f43ddba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 19:35:08.948594 1113418 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-1055011/.minikube/certs/1062272.pem (1338 bytes)
W0729 19:35:08.948649 1113418 certs.go:480] ignoring /home/jenkins/minikube-integration/19312-1055011/.minikube/certs/1062272_empty.pem, impossibly tiny 0 bytes
I0729 19:35:08.948665 1113418 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-1055011/.minikube/certs/ca-key.pem (1675 bytes)
I0729 19:35:08.948700 1113418 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-1055011/.minikube/certs/ca.pem (1082 bytes)
I0729 19:35:08.948736 1113418 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-1055011/.minikube/certs/cert.pem (1123 bytes)
I0729 19:35:08.948768 1113418 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-1055011/.minikube/certs/key.pem (1679 bytes)
I0729 19:35:08.948823 1113418 certs.go:484] found cert: /home/jenkins/minikube-integration/19312-1055011/.minikube/files/etc/ssl/certs/10622722.pem (1708 bytes)
I0729 19:35:08.949478 1113418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-1055011/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0729 19:35:08.979303 1113418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-1055011/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0729 19:35:09.006372 1113418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-1055011/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0729 19:35:09.032911 1113418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-1055011/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0729 19:35:09.059602 1113418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0729 19:35:09.088266 1113418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0729 19:35:09.117719 1113418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0729 19:35:09.144822 1113418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-1055011/.minikube/profiles/old-k8s-version-021528/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0729 19:35:09.172052 1113418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-1055011/.minikube/certs/1062272.pem --> /usr/share/ca-certificates/1062272.pem (1338 bytes)
I0729 19:35:09.200147 1113418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-1055011/.minikube/files/etc/ssl/certs/10622722.pem --> /usr/share/ca-certificates/10622722.pem (1708 bytes)
I0729 19:35:09.226286 1113418 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19312-1055011/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0729 19:35:09.257033 1113418 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0729 19:35:09.285562 1113418 ssh_runner.go:195] Run: openssl version
I0729 19:35:09.294478 1113418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/10622722.pem && ln -fs /usr/share/ca-certificates/10622722.pem /etc/ssl/certs/10622722.pem"
I0729 19:35:09.309696 1113418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/10622722.pem
I0729 19:35:09.314952 1113418 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 29 18:30 /usr/share/ca-certificates/10622722.pem
I0729 19:35:09.315042 1113418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/10622722.pem
I0729 19:35:09.322333 1113418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/10622722.pem /etc/ssl/certs/3ec20f2e.0"
I0729 19:35:09.343868 1113418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0729 19:35:09.363290 1113418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0729 19:35:09.371126 1113418 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 29 18:17 /usr/share/ca-certificates/minikubeCA.pem
I0729 19:35:09.371205 1113418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0729 19:35:09.380576 1113418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0729 19:35:09.396003 1113418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1062272.pem && ln -fs /usr/share/ca-certificates/1062272.pem /etc/ssl/certs/1062272.pem"
I0729 19:35:09.410150 1113418 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1062272.pem
I0729 19:35:09.415887 1113418 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 29 18:30 /usr/share/ca-certificates/1062272.pem
I0729 19:35:09.415966 1113418 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1062272.pem
I0729 19:35:09.422023 1113418 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1062272.pem /etc/ssl/certs/51391683.0"
I0729 19:35:09.435122 1113418 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0729 19:35:09.440030 1113418 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0729 19:35:09.440105 1113418 kubeadm.go:392] StartCluster: {Name:old-k8s-version-021528 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19319/minikube-v1.33.1-1721690939-19319-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-021528 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.65 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0729 19:35:09.440214 1113418 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0729 19:35:09.440290 1113418 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0729 19:35:09.484761 1113418 cri.go:89] found id: ""
I0729 19:35:09.484854 1113418 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0729 19:35:09.497709 1113418 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0729 19:35:09.512948 1113418 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0729 19:35:09.528085 1113418 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0729 19:35:09.528116 1113418 kubeadm.go:157] found existing configuration files:
I0729 19:35:09.528173 1113418 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0729 19:35:09.540151 1113418 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0729 19:35:09.540229 1113418 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0729 19:35:09.550546 1113418 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0729 19:35:09.560169 1113418 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0729 19:35:09.560248 1113418 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0729 19:35:09.570994 1113418 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0729 19:35:09.581443 1113418 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0729 19:35:09.581524 1113418 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0729 19:35:09.593207 1113418 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0729 19:35:09.605053 1113418 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0729 19:35:09.605129 1113418 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0729 19:35:09.615110 1113418 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0729 19:35:09.925548 1113418 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0729 19:37:08.839483 1113418 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0729 19:37:08.839577 1113418 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0729 19:37:08.841265 1113418 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0729 19:37:08.841328 1113418 kubeadm.go:310] [preflight] Running pre-flight checks
I0729 19:37:08.841438 1113418 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0729 19:37:08.841571 1113418 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0729 19:37:08.841721 1113418 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0729 19:37:08.841825 1113418 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0729 19:37:08.843251 1113418 out.go:204] - Generating certificates and keys ...
I0729 19:37:08.843347 1113418 kubeadm.go:310] [certs] Using existing ca certificate authority
I0729 19:37:08.843438 1113418 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0729 19:37:08.843522 1113418 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0729 19:37:08.843596 1113418 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0729 19:37:08.843655 1113418 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0729 19:37:08.843698 1113418 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0729 19:37:08.843742 1113418 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0729 19:37:08.843889 1113418 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-021528] and IPs [192.168.39.65 127.0.0.1 ::1]
I0729 19:37:08.843957 1113418 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0729 19:37:08.844118 1113418 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-021528] and IPs [192.168.39.65 127.0.0.1 ::1]
I0729 19:37:08.844176 1113418 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0729 19:37:08.844266 1113418 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0729 19:37:08.844322 1113418 kubeadm.go:310] [certs] Generating "sa" key and public key
I0729 19:37:08.844404 1113418 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0729 19:37:08.844475 1113418 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0729 19:37:08.844526 1113418 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0729 19:37:08.844622 1113418 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0729 19:37:08.844707 1113418 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0729 19:37:08.844845 1113418 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0729 19:37:08.844921 1113418 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0729 19:37:08.844978 1113418 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0729 19:37:08.845076 1113418 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0729 19:37:08.846472 1113418 out.go:204] - Booting up control plane ...
I0729 19:37:08.846564 1113418 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0729 19:37:08.846648 1113418 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0729 19:37:08.846732 1113418 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0729 19:37:08.846822 1113418 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0729 19:37:08.846998 1113418 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0729 19:37:08.847045 1113418 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0729 19:37:08.847102 1113418 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 19:37:08.847283 1113418 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 19:37:08.847394 1113418 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 19:37:08.847618 1113418 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 19:37:08.847692 1113418 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 19:37:08.847884 1113418 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 19:37:08.847984 1113418 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 19:37:08.848240 1113418 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 19:37:08.848303 1113418 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 19:37:08.848456 1113418 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 19:37:08.848463 1113418 kubeadm.go:310]
I0729 19:37:08.848513 1113418 kubeadm.go:310] Unfortunately, an error has occurred:
I0729 19:37:08.848571 1113418 kubeadm.go:310] timed out waiting for the condition
I0729 19:37:08.848581 1113418 kubeadm.go:310]
I0729 19:37:08.848629 1113418 kubeadm.go:310] This error is likely caused by:
I0729 19:37:08.848677 1113418 kubeadm.go:310] - The kubelet is not running
I0729 19:37:08.848779 1113418 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0729 19:37:08.848792 1113418 kubeadm.go:310]
I0729 19:37:08.848935 1113418 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0729 19:37:08.848986 1113418 kubeadm.go:310] - 'systemctl status kubelet'
I0729 19:37:08.849033 1113418 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0729 19:37:08.849042 1113418 kubeadm.go:310]
I0729 19:37:08.849192 1113418 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0729 19:37:08.849313 1113418 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0729 19:37:08.849323 1113418 kubeadm.go:310]
I0729 19:37:08.849448 1113418 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0729 19:37:08.849566 1113418 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0729 19:37:08.849637 1113418 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0729 19:37:08.849696 1113418 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0729 19:37:08.849732 1113418 kubeadm.go:310]
W0729 19:37:08.849841 1113418 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-021528] and IPs [192.168.39.65 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-021528] and IPs [192.168.39.65 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-021528] and IPs [192.168.39.65 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-021528] and IPs [192.168.39.65 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0729 19:37:08.849899 1113418 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0729 19:37:11.125730 1113418 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.275798259s)
I0729 19:37:11.125828 1113418 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0729 19:37:11.141216 1113418 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0729 19:37:11.152076 1113418 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0729 19:37:11.152098 1113418 kubeadm.go:157] found existing configuration files:
I0729 19:37:11.152144 1113418 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0729 19:37:11.162492 1113418 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0729 19:37:11.162556 1113418 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0729 19:37:11.173631 1113418 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0729 19:37:11.183034 1113418 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0729 19:37:11.183109 1113418 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0729 19:37:11.192831 1113418 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0729 19:37:11.202396 1113418 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0729 19:37:11.202459 1113418 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0729 19:37:11.212157 1113418 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0729 19:37:11.221578 1113418 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0729 19:37:11.221649 1113418 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0729 19:37:11.234622 1113418 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0729 19:37:11.318047 1113418 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0729 19:37:11.318171 1113418 kubeadm.go:310] [preflight] Running pre-flight checks
I0729 19:37:11.461420 1113418 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0729 19:37:11.461551 1113418 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0729 19:37:11.461658 1113418 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0729 19:37:11.641300 1113418 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0729 19:37:11.643199 1113418 out.go:204] - Generating certificates and keys ...
I0729 19:37:11.643311 1113418 kubeadm.go:310] [certs] Using existing ca certificate authority
I0729 19:37:11.643400 1113418 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0729 19:37:11.643513 1113418 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0729 19:37:11.643624 1113418 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0729 19:37:11.643745 1113418 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0729 19:37:11.643828 1113418 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0729 19:37:11.643939 1113418 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0729 19:37:11.644364 1113418 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0729 19:37:11.644687 1113418 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0729 19:37:11.644989 1113418 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0729 19:37:11.645090 1113418 kubeadm.go:310] [certs] Using the existing "sa" key
I0729 19:37:11.645186 1113418 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0729 19:37:11.834348 1113418 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0729 19:37:11.929750 1113418 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0729 19:37:12.113097 1113418 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0729 19:37:12.190944 1113418 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0729 19:37:12.208918 1113418 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0729 19:37:12.210120 1113418 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0729 19:37:12.210179 1113418 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0729 19:37:12.395641 1113418 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0729 19:37:12.397266 1113418 out.go:204] - Booting up control plane ...
I0729 19:37:12.397413 1113418 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0729 19:37:12.404969 1113418 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0729 19:37:12.408985 1113418 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0729 19:37:12.409102 1113418 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0729 19:37:12.411300 1113418 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0729 19:37:52.412766 1113418 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0729 19:37:52.413014 1113418 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 19:37:52.413225 1113418 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 19:37:57.413843 1113418 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 19:37:57.414073 1113418 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 19:38:07.414613 1113418 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 19:38:07.414933 1113418 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 19:38:27.415750 1113418 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 19:38:27.415942 1113418 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 19:39:07.415244 1113418 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 19:39:07.415512 1113418 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 19:39:07.415522 1113418 kubeadm.go:310]
I0729 19:39:07.415556 1113418 kubeadm.go:310] Unfortunately, an error has occurred:
I0729 19:39:07.415619 1113418 kubeadm.go:310] timed out waiting for the condition
I0729 19:39:07.415645 1113418 kubeadm.go:310]
I0729 19:39:07.415695 1113418 kubeadm.go:310] This error is likely caused by:
I0729 19:39:07.415737 1113418 kubeadm.go:310] - The kubelet is not running
I0729 19:39:07.415877 1113418 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0729 19:39:07.415890 1113418 kubeadm.go:310]
I0729 19:39:07.416039 1113418 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0729 19:39:07.416086 1113418 kubeadm.go:310] - 'systemctl status kubelet'
I0729 19:39:07.416132 1113418 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0729 19:39:07.416143 1113418 kubeadm.go:310]
I0729 19:39:07.416369 1113418 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0729 19:39:07.416462 1113418 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0729 19:39:07.416477 1113418 kubeadm.go:310]
I0729 19:39:07.416609 1113418 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0729 19:39:07.416695 1113418 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0729 19:39:07.416815 1113418 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0729 19:39:07.416895 1113418 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0729 19:39:07.416906 1113418 kubeadm.go:310]
I0729 19:39:07.418102 1113418 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0729 19:39:07.418221 1113418 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0729 19:39:07.418318 1113418 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0729 19:39:07.418402 1113418 kubeadm.go:394] duration metric: took 3m57.97830366s to StartCluster
I0729 19:39:07.418469 1113418 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0729 19:39:07.418527 1113418 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0729 19:39:07.461297 1113418 cri.go:89] found id: ""
I0729 19:39:07.461332 1113418 logs.go:276] 0 containers: []
W0729 19:39:07.461340 1113418 logs.go:278] No container was found matching "kube-apiserver"
I0729 19:39:07.461357 1113418 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0729 19:39:07.461415 1113418 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0729 19:39:07.494969 1113418 cri.go:89] found id: ""
I0729 19:39:07.495002 1113418 logs.go:276] 0 containers: []
W0729 19:39:07.495009 1113418 logs.go:278] No container was found matching "etcd"
I0729 19:39:07.495016 1113418 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0729 19:39:07.495075 1113418 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0729 19:39:07.528137 1113418 cri.go:89] found id: ""
I0729 19:39:07.528166 1113418 logs.go:276] 0 containers: []
W0729 19:39:07.528173 1113418 logs.go:278] No container was found matching "coredns"
I0729 19:39:07.528179 1113418 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0729 19:39:07.528232 1113418 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0729 19:39:07.560947 1113418 cri.go:89] found id: ""
I0729 19:39:07.560973 1113418 logs.go:276] 0 containers: []
W0729 19:39:07.560980 1113418 logs.go:278] No container was found matching "kube-scheduler"
I0729 19:39:07.560987 1113418 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0729 19:39:07.561049 1113418 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0729 19:39:07.593607 1113418 cri.go:89] found id: ""
I0729 19:39:07.593639 1113418 logs.go:276] 0 containers: []
W0729 19:39:07.593648 1113418 logs.go:278] No container was found matching "kube-proxy"
I0729 19:39:07.593657 1113418 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0729 19:39:07.593711 1113418 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0729 19:39:07.626423 1113418 cri.go:89] found id: ""
I0729 19:39:07.626452 1113418 logs.go:276] 0 containers: []
W0729 19:39:07.626460 1113418 logs.go:278] No container was found matching "kube-controller-manager"
I0729 19:39:07.626466 1113418 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0729 19:39:07.626524 1113418 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0729 19:39:07.665053 1113418 cri.go:89] found id: ""
I0729 19:39:07.665080 1113418 logs.go:276] 0 containers: []
W0729 19:39:07.665087 1113418 logs.go:278] No container was found matching "kindnet"
I0729 19:39:07.665096 1113418 logs.go:123] Gathering logs for kubelet ...
I0729 19:39:07.665107 1113418 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0729 19:39:07.717897 1113418 logs.go:123] Gathering logs for dmesg ...
I0729 19:39:07.717937 1113418 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0729 19:39:07.732905 1113418 logs.go:123] Gathering logs for describe nodes ...
I0729 19:39:07.732932 1113418 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0729 19:39:07.842732 1113418 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0729 19:39:07.842759 1113418 logs.go:123] Gathering logs for CRI-O ...
I0729 19:39:07.842777 1113418 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0729 19:39:07.945203 1113418 logs.go:123] Gathering logs for container status ...
I0729 19:39:07.945255 1113418 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0729 19:39:07.996675 1113418 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0729 19:39:07.996734 1113418 out.go:239] *
*
W0729 19:39:07.996808 1113418 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0729 19:39:07.996841 1113418 out.go:239] *
*
W0729 19:39:07.998193 1113418 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0729 19:39:08.001849 1113418 out.go:177]
W0729 19:39:08.003111 1113418 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0729 19:39:08.003183 1113418 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0729 19:39:08.003215 1113418 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0729 19:39:08.004807 1113418 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-021528 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-021528 -n old-k8s-version-021528
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-021528 -n old-k8s-version-021528: exit status 6 (227.862075ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0729 19:39:08.286425 1120072 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-021528" does not appear in /home/jenkins/minikube-integration/19312-1055011/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-021528" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (294.61s)