=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-019549 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
E0717 18:30:41.791780 21577 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/addons-435911/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-019549 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m27.201164285s)
-- stdout --
* [old-k8s-version-019549] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19283
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19283-14386/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19283-14386/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-019549" primary control-plane node in "old-k8s-version-019549" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0717 18:30:39.690065 74819 out.go:291] Setting OutFile to fd 1 ...
I0717 18:30:39.690190 74819 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 18:30:39.690202 74819 out.go:304] Setting ErrFile to fd 2...
I0717 18:30:39.690206 74819 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 18:30:39.690467 74819 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19283-14386/.minikube/bin
I0717 18:30:39.691197 74819 out.go:298] Setting JSON to false
I0717 18:30:39.692418 74819 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":7983,"bootTime":1721233057,"procs":305,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0717 18:30:39.692475 74819 start.go:139] virtualization: kvm guest
I0717 18:30:39.694812 74819 out.go:177] * [old-k8s-version-019549] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0717 18:30:39.696294 74819 notify.go:220] Checking for updates...
I0717 18:30:39.696301 74819 out.go:177] - MINIKUBE_LOCATION=19283
I0717 18:30:39.697659 74819 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0717 18:30:39.699051 74819 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19283-14386/kubeconfig
I0717 18:30:39.700450 74819 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19283-14386/.minikube
I0717 18:30:39.701992 74819 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0717 18:30:39.703369 74819 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0717 18:30:39.705069 74819 config.go:182] Loaded profile config "enable-default-cni-235476": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2
I0717 18:30:39.705159 74819 config.go:182] Loaded profile config "flannel-235476": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2
I0717 18:30:39.705270 74819 config.go:182] Loaded profile config "pause-371172": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2
I0717 18:30:39.705342 74819 driver.go:392] Setting default libvirt URI to qemu:///system
I0717 18:30:39.742890 74819 out.go:177] * Using the kvm2 driver based on user configuration
I0717 18:30:39.744171 74819 start.go:297] selected driver: kvm2
I0717 18:30:39.744186 74819 start.go:901] validating driver "kvm2" against <nil>
I0717 18:30:39.744195 74819 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0717 18:30:39.744920 74819 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0717 18:30:39.745072 74819 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19283-14386/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0717 18:30:39.760510 74819 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0717 18:30:39.760559 74819 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0717 18:30:39.760771 74819 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0717 18:30:39.760796 74819 cni.go:84] Creating CNI manager for ""
I0717 18:30:39.760804 74819 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0717 18:30:39.760813 74819 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0717 18:30:39.760861 74819 start.go:340] cluster config:
{Name:old-k8s-version-019549 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721146479-19264@sha256:7ee06b7e8fb4a6c7fce11a567253ea7d43fed61ee0beca281a1ac2c2566a2a2e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-019549 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0717 18:30:39.760991 74819 iso.go:125] acquiring lock: {Name:mk51ed12bcfc9e673ec68e34040c2adda4f249c8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0717 18:30:39.762860 74819 out.go:177] * Starting "old-k8s-version-019549" primary control-plane node in "old-k8s-version-019549" cluster
I0717 18:30:39.764094 74819 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0717 18:30:39.764144 74819 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19283-14386/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0717 18:30:39.764156 74819 cache.go:56] Caching tarball of preloaded images
I0717 18:30:39.764249 74819 preload.go:172] Found /home/jenkins/minikube-integration/19283-14386/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0717 18:30:39.764264 74819 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0717 18:30:39.764396 74819 profile.go:143] Saving config to /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/config.json ...
I0717 18:30:39.764430 74819 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/config.json: {Name:mk0415238db4f30840385a6cddecf79c168d41d1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 18:30:39.764588 74819 start.go:360] acquireMachinesLock for old-k8s-version-019549: {Name:mk9777099aa5222699e7eb1a959d6393d4c7cab9 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0717 18:30:39.764621 74819 start.go:364] duration metric: took 17.904µs to acquireMachinesLock for "old-k8s-version-019549"
I0717 18:30:39.764640 74819 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-019549 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19264/minikube-v1.33.1-1721146474-19264-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721146479-19264@sha256:7ee06b7e8fb4a6c7fce11a567253ea7d43fed61ee0beca281a1ac2c2566a2a2e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-019549 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0717 18:30:39.764723 74819 start.go:125] createHost starting for "" (driver="kvm2")
I0717 18:30:39.766169 74819 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0717 18:30:39.766305 74819 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0717 18:30:39.766353 74819 main.go:141] libmachine: Launching plugin server for driver kvm2
I0717 18:30:39.780556 74819 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38823
I0717 18:30:39.781020 74819 main.go:141] libmachine: () Calling .GetVersion
I0717 18:30:39.781553 74819 main.go:141] libmachine: Using API Version 1
I0717 18:30:39.781574 74819 main.go:141] libmachine: () Calling .SetConfigRaw
I0717 18:30:39.781949 74819 main.go:141] libmachine: () Calling .GetMachineName
I0717 18:30:39.782189 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetMachineName
I0717 18:30:39.782350 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .DriverName
I0717 18:30:39.782511 74819 start.go:159] libmachine.API.Create for "old-k8s-version-019549" (driver="kvm2")
I0717 18:30:39.782538 74819 client.go:168] LocalClient.Create starting
I0717 18:30:39.782578 74819 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19283-14386/.minikube/certs/ca.pem
I0717 18:30:39.782616 74819 main.go:141] libmachine: Decoding PEM data...
I0717 18:30:39.782633 74819 main.go:141] libmachine: Parsing certificate...
I0717 18:30:39.782687 74819 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19283-14386/.minikube/certs/cert.pem
I0717 18:30:39.782704 74819 main.go:141] libmachine: Decoding PEM data...
I0717 18:30:39.782717 74819 main.go:141] libmachine: Parsing certificate...
I0717 18:30:39.782731 74819 main.go:141] libmachine: Running pre-create checks...
I0717 18:30:39.782744 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .PreCreateCheck
I0717 18:30:39.783151 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetConfigRaw
I0717 18:30:39.783613 74819 main.go:141] libmachine: Creating machine...
I0717 18:30:39.783629 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .Create
I0717 18:30:39.783763 74819 main.go:141] libmachine: (old-k8s-version-019549) Creating KVM machine...
I0717 18:30:39.785160 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found existing default KVM network
I0717 18:30:39.786770 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:39.786641 74843 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00026e0d0}
I0717 18:30:39.786791 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | created network xml:
I0717 18:30:39.786802 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | <network>
I0717 18:30:39.786814 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | <name>mk-old-k8s-version-019549</name>
I0717 18:30:39.786822 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | <dns enable='no'/>
I0717 18:30:39.786829 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG |
I0717 18:30:39.786838 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0717 18:30:39.786849 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | <dhcp>
I0717 18:30:39.786855 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0717 18:30:39.786863 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | </dhcp>
I0717 18:30:39.786868 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | </ip>
I0717 18:30:39.786874 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG |
I0717 18:30:39.786880 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | </network>
I0717 18:30:39.786891 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG |
I0717 18:30:39.791942 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | trying to create private KVM network mk-old-k8s-version-019549 192.168.39.0/24...
I0717 18:30:39.871303 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | private KVM network mk-old-k8s-version-019549 192.168.39.0/24 created
I0717 18:30:39.871335 74819 main.go:141] libmachine: (old-k8s-version-019549) Setting up store path in /home/jenkins/minikube-integration/19283-14386/.minikube/machines/old-k8s-version-019549 ...
I0717 18:30:39.871352 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:39.871271 74843 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19283-14386/.minikube
I0717 18:30:39.871376 74819 main.go:141] libmachine: (old-k8s-version-019549) Building disk image from file:///home/jenkins/minikube-integration/19283-14386/.minikube/cache/iso/amd64/minikube-v1.33.1-1721146474-19264-amd64.iso
I0717 18:30:39.871517 74819 main.go:141] libmachine: (old-k8s-version-019549) Downloading /home/jenkins/minikube-integration/19283-14386/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19283-14386/.minikube/cache/iso/amd64/minikube-v1.33.1-1721146474-19264-amd64.iso...
I0717 18:30:40.134523 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:40.134415 74843 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19283-14386/.minikube/machines/old-k8s-version-019549/id_rsa...
I0717 18:30:40.380691 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:40.380573 74843 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19283-14386/.minikube/machines/old-k8s-version-019549/old-k8s-version-019549.rawdisk...
I0717 18:30:40.380733 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | Writing magic tar header
I0717 18:30:40.380749 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | Writing SSH key tar header
I0717 18:30:40.380761 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:40.380687 74843 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19283-14386/.minikube/machines/old-k8s-version-019549 ...
I0717 18:30:40.380843 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19283-14386/.minikube/machines/old-k8s-version-019549
I0717 18:30:40.380876 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19283-14386/.minikube/machines
I0717 18:30:40.380891 74819 main.go:141] libmachine: (old-k8s-version-019549) Setting executable bit set on /home/jenkins/minikube-integration/19283-14386/.minikube/machines/old-k8s-version-019549 (perms=drwx------)
I0717 18:30:40.380904 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19283-14386/.minikube
I0717 18:30:40.380918 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19283-14386
I0717 18:30:40.380930 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0717 18:30:40.380959 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | Checking permissions on dir: /home/jenkins
I0717 18:30:40.380980 74819 main.go:141] libmachine: (old-k8s-version-019549) Setting executable bit set on /home/jenkins/minikube-integration/19283-14386/.minikube/machines (perms=drwxr-xr-x)
I0717 18:30:40.380989 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | Checking permissions on dir: /home
I0717 18:30:40.381002 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | Skipping /home - not owner
I0717 18:30:40.381024 74819 main.go:141] libmachine: (old-k8s-version-019549) Setting executable bit set on /home/jenkins/minikube-integration/19283-14386/.minikube (perms=drwxr-xr-x)
I0717 18:30:40.381039 74819 main.go:141] libmachine: (old-k8s-version-019549) Setting executable bit set on /home/jenkins/minikube-integration/19283-14386 (perms=drwxrwxr-x)
I0717 18:30:40.381062 74819 main.go:141] libmachine: (old-k8s-version-019549) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0717 18:30:40.381078 74819 main.go:141] libmachine: (old-k8s-version-019549) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0717 18:30:40.381092 74819 main.go:141] libmachine: (old-k8s-version-019549) Creating domain...
I0717 18:30:40.382108 74819 main.go:141] libmachine: (old-k8s-version-019549) define libvirt domain using xml:
I0717 18:30:40.382140 74819 main.go:141] libmachine: (old-k8s-version-019549) <domain type='kvm'>
I0717 18:30:40.382151 74819 main.go:141] libmachine: (old-k8s-version-019549) <name>old-k8s-version-019549</name>
I0717 18:30:40.382169 74819 main.go:141] libmachine: (old-k8s-version-019549) <memory unit='MiB'>2200</memory>
I0717 18:30:40.382178 74819 main.go:141] libmachine: (old-k8s-version-019549) <vcpu>2</vcpu>
I0717 18:30:40.382185 74819 main.go:141] libmachine: (old-k8s-version-019549) <features>
I0717 18:30:40.382194 74819 main.go:141] libmachine: (old-k8s-version-019549) <acpi/>
I0717 18:30:40.382200 74819 main.go:141] libmachine: (old-k8s-version-019549) <apic/>
I0717 18:30:40.382212 74819 main.go:141] libmachine: (old-k8s-version-019549) <pae/>
I0717 18:30:40.382226 74819 main.go:141] libmachine: (old-k8s-version-019549)
I0717 18:30:40.382237 74819 main.go:141] libmachine: (old-k8s-version-019549) </features>
I0717 18:30:40.382246 74819 main.go:141] libmachine: (old-k8s-version-019549) <cpu mode='host-passthrough'>
I0717 18:30:40.382270 74819 main.go:141] libmachine: (old-k8s-version-019549)
I0717 18:30:40.382290 74819 main.go:141] libmachine: (old-k8s-version-019549) </cpu>
I0717 18:30:40.382298 74819 main.go:141] libmachine: (old-k8s-version-019549) <os>
I0717 18:30:40.382306 74819 main.go:141] libmachine: (old-k8s-version-019549) <type>hvm</type>
I0717 18:30:40.382314 74819 main.go:141] libmachine: (old-k8s-version-019549) <boot dev='cdrom'/>
I0717 18:30:40.382322 74819 main.go:141] libmachine: (old-k8s-version-019549) <boot dev='hd'/>
I0717 18:30:40.382331 74819 main.go:141] libmachine: (old-k8s-version-019549) <bootmenu enable='no'/>
I0717 18:30:40.382340 74819 main.go:141] libmachine: (old-k8s-version-019549) </os>
I0717 18:30:40.382348 74819 main.go:141] libmachine: (old-k8s-version-019549) <devices>
I0717 18:30:40.382359 74819 main.go:141] libmachine: (old-k8s-version-019549) <disk type='file' device='cdrom'>
I0717 18:30:40.382373 74819 main.go:141] libmachine: (old-k8s-version-019549) <source file='/home/jenkins/minikube-integration/19283-14386/.minikube/machines/old-k8s-version-019549/boot2docker.iso'/>
I0717 18:30:40.382383 74819 main.go:141] libmachine: (old-k8s-version-019549) <target dev='hdc' bus='scsi'/>
I0717 18:30:40.382391 74819 main.go:141] libmachine: (old-k8s-version-019549) <readonly/>
I0717 18:30:40.382400 74819 main.go:141] libmachine: (old-k8s-version-019549) </disk>
I0717 18:30:40.382409 74819 main.go:141] libmachine: (old-k8s-version-019549) <disk type='file' device='disk'>
I0717 18:30:40.382417 74819 main.go:141] libmachine: (old-k8s-version-019549) <driver name='qemu' type='raw' cache='default' io='threads' />
I0717 18:30:40.382430 74819 main.go:141] libmachine: (old-k8s-version-019549) <source file='/home/jenkins/minikube-integration/19283-14386/.minikube/machines/old-k8s-version-019549/old-k8s-version-019549.rawdisk'/>
I0717 18:30:40.382442 74819 main.go:141] libmachine: (old-k8s-version-019549) <target dev='hda' bus='virtio'/>
I0717 18:30:40.382470 74819 main.go:141] libmachine: (old-k8s-version-019549) </disk>
I0717 18:30:40.382486 74819 main.go:141] libmachine: (old-k8s-version-019549) <interface type='network'>
I0717 18:30:40.382498 74819 main.go:141] libmachine: (old-k8s-version-019549) <source network='mk-old-k8s-version-019549'/>
I0717 18:30:40.382510 74819 main.go:141] libmachine: (old-k8s-version-019549) <model type='virtio'/>
I0717 18:30:40.382519 74819 main.go:141] libmachine: (old-k8s-version-019549) </interface>
I0717 18:30:40.382530 74819 main.go:141] libmachine: (old-k8s-version-019549) <interface type='network'>
I0717 18:30:40.382540 74819 main.go:141] libmachine: (old-k8s-version-019549) <source network='default'/>
I0717 18:30:40.382550 74819 main.go:141] libmachine: (old-k8s-version-019549) <model type='virtio'/>
I0717 18:30:40.382560 74819 main.go:141] libmachine: (old-k8s-version-019549) </interface>
I0717 18:30:40.382575 74819 main.go:141] libmachine: (old-k8s-version-019549) <serial type='pty'>
I0717 18:30:40.382587 74819 main.go:141] libmachine: (old-k8s-version-019549) <target port='0'/>
I0717 18:30:40.382595 74819 main.go:141] libmachine: (old-k8s-version-019549) </serial>
I0717 18:30:40.382608 74819 main.go:141] libmachine: (old-k8s-version-019549) <console type='pty'>
I0717 18:30:40.382630 74819 main.go:141] libmachine: (old-k8s-version-019549) <target type='serial' port='0'/>
I0717 18:30:40.382641 74819 main.go:141] libmachine: (old-k8s-version-019549) </console>
I0717 18:30:40.382649 74819 main.go:141] libmachine: (old-k8s-version-019549) <rng model='virtio'>
I0717 18:30:40.382663 74819 main.go:141] libmachine: (old-k8s-version-019549) <backend model='random'>/dev/random</backend>
I0717 18:30:40.382671 74819 main.go:141] libmachine: (old-k8s-version-019549) </rng>
I0717 18:30:40.382679 74819 main.go:141] libmachine: (old-k8s-version-019549)
I0717 18:30:40.382690 74819 main.go:141] libmachine: (old-k8s-version-019549)
I0717 18:30:40.382699 74819 main.go:141] libmachine: (old-k8s-version-019549) </devices>
I0717 18:30:40.382706 74819 main.go:141] libmachine: (old-k8s-version-019549) </domain>
I0717 18:30:40.382716 74819 main.go:141] libmachine: (old-k8s-version-019549)
I0717 18:30:40.387455 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:39:81:22 in network default
I0717 18:30:40.388071 74819 main.go:141] libmachine: (old-k8s-version-019549) Ensuring networks are active...
I0717 18:30:40.388092 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:30:40.389001 74819 main.go:141] libmachine: (old-k8s-version-019549) Ensuring network default is active
I0717 18:30:40.389444 74819 main.go:141] libmachine: (old-k8s-version-019549) Ensuring network mk-old-k8s-version-019549 is active
I0717 18:30:40.390149 74819 main.go:141] libmachine: (old-k8s-version-019549) Getting domain xml...
I0717 18:30:40.391076 74819 main.go:141] libmachine: (old-k8s-version-019549) Creating domain...
I0717 18:30:41.686632 74819 main.go:141] libmachine: (old-k8s-version-019549) Waiting to get IP...
I0717 18:30:41.687806 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:30:41.688357 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | unable to find current IP address of domain old-k8s-version-019549 in network mk-old-k8s-version-019549
I0717 18:30:41.688391 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:41.688307 74843 retry.go:31] will retry after 274.627341ms: waiting for machine to come up
I0717 18:30:41.964736 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:30:41.965352 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | unable to find current IP address of domain old-k8s-version-019549 in network mk-old-k8s-version-019549
I0717 18:30:41.965379 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:41.965306 74843 retry.go:31] will retry after 313.517425ms: waiting for machine to come up
I0717 18:30:42.280887 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:30:42.281456 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | unable to find current IP address of domain old-k8s-version-019549 in network mk-old-k8s-version-019549
I0717 18:30:42.281478 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:42.281413 74843 retry.go:31] will retry after 445.034782ms: waiting for machine to come up
I0717 18:30:42.727833 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:30:42.728326 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | unable to find current IP address of domain old-k8s-version-019549 in network mk-old-k8s-version-019549
I0717 18:30:42.728375 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:42.728318 74843 retry.go:31] will retry after 520.980617ms: waiting for machine to come up
I0717 18:30:43.251154 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:30:43.251737 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | unable to find current IP address of domain old-k8s-version-019549 in network mk-old-k8s-version-019549
I0717 18:30:43.251780 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:43.251690 74843 retry.go:31] will retry after 465.647984ms: waiting for machine to come up
I0717 18:30:43.719302 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:30:43.719805 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | unable to find current IP address of domain old-k8s-version-019549 in network mk-old-k8s-version-019549
I0717 18:30:43.719825 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:43.719769 74843 retry.go:31] will retry after 808.348544ms: waiting for machine to come up
I0717 18:30:44.529290 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:30:44.529740 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | unable to find current IP address of domain old-k8s-version-019549 in network mk-old-k8s-version-019549
I0717 18:30:44.529794 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:44.529684 74843 retry.go:31] will retry after 734.124194ms: waiting for machine to come up
I0717 18:30:45.265134 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:30:45.265892 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | unable to find current IP address of domain old-k8s-version-019549 in network mk-old-k8s-version-019549
I0717 18:30:45.265937 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:45.265854 74843 retry.go:31] will retry after 939.260076ms: waiting for machine to come up
I0717 18:30:46.206989 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:30:46.207448 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | unable to find current IP address of domain old-k8s-version-019549 in network mk-old-k8s-version-019549
I0717 18:30:46.207474 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:46.207390 74843 retry.go:31] will retry after 1.148269743s: waiting for machine to come up
I0717 18:30:47.357904 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:30:47.358568 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | unable to find current IP address of domain old-k8s-version-019549 in network mk-old-k8s-version-019549
I0717 18:30:47.358596 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:47.358514 74843 retry.go:31] will retry after 1.959579957s: waiting for machine to come up
I0717 18:30:49.319977 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:30:49.320500 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | unable to find current IP address of domain old-k8s-version-019549 in network mk-old-k8s-version-019549
I0717 18:30:49.320526 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:49.320428 74843 retry.go:31] will retry after 1.868161384s: waiting for machine to come up
I0717 18:30:51.190160 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:30:51.190697 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | unable to find current IP address of domain old-k8s-version-019549 in network mk-old-k8s-version-019549
I0717 18:30:51.190729 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:51.190655 74843 retry.go:31] will retry after 3.577464874s: waiting for machine to come up
I0717 18:30:54.772338 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:30:54.772797 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | unable to find current IP address of domain old-k8s-version-019549 in network mk-old-k8s-version-019549
I0717 18:30:54.772827 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:54.772748 74843 retry.go:31] will retry after 2.92588429s: waiting for machine to come up
I0717 18:30:57.699684 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:30:57.700328 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | unable to find current IP address of domain old-k8s-version-019549 in network mk-old-k8s-version-019549
I0717 18:30:57.700358 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | I0717 18:30:57.700237 74843 retry.go:31] will retry after 4.440032289s: waiting for machine to come up
I0717 18:31:02.142136 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.142739 74819 main.go:141] libmachine: (old-k8s-version-019549) Found IP for machine: 192.168.39.128
I0717 18:31:02.142763 74819 main.go:141] libmachine: (old-k8s-version-019549) Reserving static IP address...
I0717 18:31:02.142773 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has current primary IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.143160 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-019549", mac: "52:54:00:60:f7:87", ip: "192.168.39.128"} in network mk-old-k8s-version-019549
I0717 18:31:02.219233 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | Getting to WaitForSSH function...
I0717 18:31:02.219259 74819 main.go:141] libmachine: (old-k8s-version-019549) Reserved static IP address: 192.168.39.128
I0717 18:31:02.219273 74819 main.go:141] libmachine: (old-k8s-version-019549) Waiting for SSH to be available...
I0717 18:31:02.222083 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.222579 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:minikube Clientid:01:52:54:00:60:f7:87}
I0717 18:31:02.222605 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.222749 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | Using SSH client type: external
I0717 18:31:02.222777 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | Using SSH private key: /home/jenkins/minikube-integration/19283-14386/.minikube/machines/old-k8s-version-019549/id_rsa (-rw-------)
I0717 18:31:02.222821 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.128 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19283-14386/.minikube/machines/old-k8s-version-019549/id_rsa -p 22] /usr/bin/ssh <nil>}
I0717 18:31:02.222841 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | About to run SSH command:
I0717 18:31:02.222856 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | exit 0
I0717 18:31:02.348741 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | SSH cmd err, output: <nil>:
I0717 18:31:02.348979 74819 main.go:141] libmachine: (old-k8s-version-019549) KVM machine creation complete!
I0717 18:31:02.349402 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetConfigRaw
I0717 18:31:02.349986 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .DriverName
I0717 18:31:02.350228 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .DriverName
I0717 18:31:02.350370 74819 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0717 18:31:02.350386 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetState
I0717 18:31:02.351666 74819 main.go:141] libmachine: Detecting operating system of created instance...
I0717 18:31:02.351682 74819 main.go:141] libmachine: Waiting for SSH to be available...
I0717 18:31:02.351689 74819 main.go:141] libmachine: Getting to WaitForSSH function...
I0717 18:31:02.351698 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHHostname
I0717 18:31:02.353966 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.354335 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:old-k8s-version-019549 Clientid:01:52:54:00:60:f7:87}
I0717 18:31:02.354360 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.354509 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHPort
I0717 18:31:02.354685 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHKeyPath
I0717 18:31:02.354864 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHKeyPath
I0717 18:31:02.354972 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHUsername
I0717 18:31:02.355146 74819 main.go:141] libmachine: Using SSH client type: native
I0717 18:31:02.355368 74819 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.39.128 22 <nil> <nil>}
I0717 18:31:02.355383 74819 main.go:141] libmachine: About to run SSH command:
exit 0
I0717 18:31:02.456155 74819 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0717 18:31:02.456179 74819 main.go:141] libmachine: Detecting the provisioner...
I0717 18:31:02.456189 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHHostname
I0717 18:31:02.458977 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.459335 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:old-k8s-version-019549 Clientid:01:52:54:00:60:f7:87}
I0717 18:31:02.459372 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.459511 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHPort
I0717 18:31:02.459700 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHKeyPath
I0717 18:31:02.459879 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHKeyPath
I0717 18:31:02.459989 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHUsername
I0717 18:31:02.460167 74819 main.go:141] libmachine: Using SSH client type: native
I0717 18:31:02.460386 74819 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.39.128 22 <nil> <nil>}
I0717 18:31:02.460400 74819 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0717 18:31:02.565568 74819 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0717 18:31:02.565634 74819 main.go:141] libmachine: found compatible host: buildroot
I0717 18:31:02.565642 74819 main.go:141] libmachine: Provisioning with buildroot...
I0717 18:31:02.565656 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetMachineName
I0717 18:31:02.565905 74819 buildroot.go:166] provisioning hostname "old-k8s-version-019549"
I0717 18:31:02.565924 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetMachineName
I0717 18:31:02.566085 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHHostname
I0717 18:31:02.568777 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.569236 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:old-k8s-version-019549 Clientid:01:52:54:00:60:f7:87}
I0717 18:31:02.569261 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.569413 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHPort
I0717 18:31:02.569572 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHKeyPath
I0717 18:31:02.569707 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHKeyPath
I0717 18:31:02.569855 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHUsername
I0717 18:31:02.570023 74819 main.go:141] libmachine: Using SSH client type: native
I0717 18:31:02.570233 74819 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.39.128 22 <nil> <nil>}
I0717 18:31:02.570250 74819 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-019549 && echo "old-k8s-version-019549" | sudo tee /etc/hostname
I0717 18:31:02.689891 74819 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-019549
I0717 18:31:02.689922 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHHostname
I0717 18:31:02.692837 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.693231 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:old-k8s-version-019549 Clientid:01:52:54:00:60:f7:87}
I0717 18:31:02.693263 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.693452 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHPort
I0717 18:31:02.693656 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHKeyPath
I0717 18:31:02.693835 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHKeyPath
I0717 18:31:02.693985 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHUsername
I0717 18:31:02.694156 74819 main.go:141] libmachine: Using SSH client type: native
I0717 18:31:02.694326 74819 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.39.128 22 <nil> <nil>}
I0717 18:31:02.694341 74819 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-019549' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-019549/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-019549' | sudo tee -a /etc/hosts;
fi
fi
I0717 18:31:02.805698 74819 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0717 18:31:02.805724 74819 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19283-14386/.minikube CaCertPath:/home/jenkins/minikube-integration/19283-14386/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19283-14386/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19283-14386/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19283-14386/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19283-14386/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19283-14386/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19283-14386/.minikube}
I0717 18:31:02.805742 74819 buildroot.go:174] setting up certificates
I0717 18:31:02.805754 74819 provision.go:84] configureAuth start
I0717 18:31:02.805766 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetMachineName
I0717 18:31:02.806020 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetIP
I0717 18:31:02.808553 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.808913 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:old-k8s-version-019549 Clientid:01:52:54:00:60:f7:87}
I0717 18:31:02.808959 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.809081 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHHostname
I0717 18:31:02.811561 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.811859 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:old-k8s-version-019549 Clientid:01:52:54:00:60:f7:87}
I0717 18:31:02.811882 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.812030 74819 provision.go:143] copyHostCerts
I0717 18:31:02.812098 74819 exec_runner.go:144] found /home/jenkins/minikube-integration/19283-14386/.minikube/key.pem, removing ...
I0717 18:31:02.812113 74819 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19283-14386/.minikube/key.pem
I0717 18:31:02.812184 74819 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19283-14386/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19283-14386/.minikube/key.pem (1679 bytes)
I0717 18:31:02.812326 74819 exec_runner.go:144] found /home/jenkins/minikube-integration/19283-14386/.minikube/ca.pem, removing ...
I0717 18:31:02.812340 74819 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19283-14386/.minikube/ca.pem
I0717 18:31:02.812382 74819 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19283-14386/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19283-14386/.minikube/ca.pem (1082 bytes)
I0717 18:31:02.812498 74819 exec_runner.go:144] found /home/jenkins/minikube-integration/19283-14386/.minikube/cert.pem, removing ...
I0717 18:31:02.812508 74819 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19283-14386/.minikube/cert.pem
I0717 18:31:02.812535 74819 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19283-14386/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19283-14386/.minikube/cert.pem (1123 bytes)
I0717 18:31:02.812595 74819 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19283-14386/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19283-14386/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19283-14386/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-019549 san=[127.0.0.1 192.168.39.128 localhost minikube old-k8s-version-019549]
I0717 18:31:02.899579 74819 provision.go:177] copyRemoteCerts
I0717 18:31:02.899636 74819 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0717 18:31:02.899658 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHHostname
I0717 18:31:02.902547 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.902893 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:old-k8s-version-019549 Clientid:01:52:54:00:60:f7:87}
I0717 18:31:02.902923 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:02.903084 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHPort
I0717 18:31:02.903268 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHKeyPath
I0717 18:31:02.903433 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHUsername
I0717 18:31:02.903571 74819 sshutil.go:53] new ssh client: &{IP:192.168.39.128 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19283-14386/.minikube/machines/old-k8s-version-019549/id_rsa Username:docker}
I0717 18:31:02.982568 74819 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19283-14386/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0717 18:31:03.007408 74819 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19283-14386/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0717 18:31:03.031336 74819 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19283-14386/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0717 18:31:03.053415 74819 provision.go:87] duration metric: took 247.64678ms to configureAuth
I0717 18:31:03.053448 74819 buildroot.go:189] setting minikube options for container-runtime
I0717 18:31:03.053637 74819 config.go:182] Loaded profile config "old-k8s-version-019549": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0717 18:31:03.053711 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHHostname
I0717 18:31:03.056427 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:03.056747 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:old-k8s-version-019549 Clientid:01:52:54:00:60:f7:87}
I0717 18:31:03.056775 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:03.056925 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHPort
I0717 18:31:03.057127 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHKeyPath
I0717 18:31:03.057271 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHKeyPath
I0717 18:31:03.057420 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHUsername
I0717 18:31:03.057596 74819 main.go:141] libmachine: Using SSH client type: native
I0717 18:31:03.057746 74819 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.39.128 22 <nil> <nil>}
I0717 18:31:03.057759 74819 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0717 18:31:03.318755 74819 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0717 18:31:03.318805 74819 main.go:141] libmachine: Checking connection to Docker...
I0717 18:31:03.318817 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetURL
I0717 18:31:03.320068 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | Using libvirt version 6000000
I0717 18:31:03.322595 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:03.322951 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:old-k8s-version-019549 Clientid:01:52:54:00:60:f7:87}
I0717 18:31:03.322985 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:03.323167 74819 main.go:141] libmachine: Docker is up and running!
I0717 18:31:03.323184 74819 main.go:141] libmachine: Reticulating splines...
I0717 18:31:03.323192 74819 client.go:171] duration metric: took 23.540643514s to LocalClient.Create
I0717 18:31:03.323213 74819 start.go:167] duration metric: took 23.540701465s to libmachine.API.Create "old-k8s-version-019549"
I0717 18:31:03.323226 74819 start.go:293] postStartSetup for "old-k8s-version-019549" (driver="kvm2")
I0717 18:31:03.323240 74819 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0717 18:31:03.323261 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .DriverName
I0717 18:31:03.323513 74819 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0717 18:31:03.323543 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHHostname
I0717 18:31:03.325606 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:03.325960 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:old-k8s-version-019549 Clientid:01:52:54:00:60:f7:87}
I0717 18:31:03.325996 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:03.326116 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHPort
I0717 18:31:03.326287 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHKeyPath
I0717 18:31:03.326464 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHUsername
I0717 18:31:03.326605 74819 sshutil.go:53] new ssh client: &{IP:192.168.39.128 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19283-14386/.minikube/machines/old-k8s-version-019549/id_rsa Username:docker}
I0717 18:31:03.406742 74819 ssh_runner.go:195] Run: cat /etc/os-release
I0717 18:31:03.410546 74819 info.go:137] Remote host: Buildroot 2023.02.9
I0717 18:31:03.410571 74819 filesync.go:126] Scanning /home/jenkins/minikube-integration/19283-14386/.minikube/addons for local assets ...
I0717 18:31:03.410637 74819 filesync.go:126] Scanning /home/jenkins/minikube-integration/19283-14386/.minikube/files for local assets ...
I0717 18:31:03.410727 74819 filesync.go:149] local asset: /home/jenkins/minikube-integration/19283-14386/.minikube/files/etc/ssl/certs/215772.pem -> 215772.pem in /etc/ssl/certs
I0717 18:31:03.410846 74819 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0717 18:31:03.419372 74819 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19283-14386/.minikube/files/etc/ssl/certs/215772.pem --> /etc/ssl/certs/215772.pem (1708 bytes)
I0717 18:31:03.443338 74819 start.go:296] duration metric: took 120.094121ms for postStartSetup
I0717 18:31:03.443396 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetConfigRaw
I0717 18:31:03.444076 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetIP
I0717 18:31:03.447503 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:03.447898 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:old-k8s-version-019549 Clientid:01:52:54:00:60:f7:87}
I0717 18:31:03.447932 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:03.448143 74819 profile.go:143] Saving config to /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/config.json ...
I0717 18:31:03.448347 74819 start.go:128] duration metric: took 23.683613273s to createHost
I0717 18:31:03.448377 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHHostname
I0717 18:31:03.450939 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:03.451321 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:old-k8s-version-019549 Clientid:01:52:54:00:60:f7:87}
I0717 18:31:03.451348 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:03.451476 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHPort
I0717 18:31:03.451635 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHKeyPath
I0717 18:31:03.451798 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHKeyPath
I0717 18:31:03.451942 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHUsername
I0717 18:31:03.452083 74819 main.go:141] libmachine: Using SSH client type: native
I0717 18:31:03.452244 74819 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da20] 0x830780 <nil> [] 0s} 192.168.39.128 22 <nil> <nil>}
I0717 18:31:03.452263 74819 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0717 18:31:03.553662 74819 main.go:141] libmachine: SSH cmd err, output: <nil>: 1721241063.526693702
I0717 18:31:03.553683 74819 fix.go:216] guest clock: 1721241063.526693702
I0717 18:31:03.553690 74819 fix.go:229] Guest: 2024-07-17 18:31:03.526693702 +0000 UTC Remote: 2024-07-17 18:31:03.448359739 +0000 UTC m=+23.791903532 (delta=78.333963ms)
I0717 18:31:03.553713 74819 fix.go:200] guest clock delta is within tolerance: 78.333963ms
I0717 18:31:03.553720 74819 start.go:83] releasing machines lock for "old-k8s-version-019549", held for 23.789089913s
I0717 18:31:03.553746 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .DriverName
I0717 18:31:03.554020 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetIP
I0717 18:31:03.556774 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:03.557238 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:old-k8s-version-019549 Clientid:01:52:54:00:60:f7:87}
I0717 18:31:03.557268 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:03.557442 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .DriverName
I0717 18:31:03.557912 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .DriverName
I0717 18:31:03.558200 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .DriverName
I0717 18:31:03.558331 74819 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0717 18:31:03.558387 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHHostname
I0717 18:31:03.558475 74819 ssh_runner.go:195] Run: cat /version.json
I0717 18:31:03.558501 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHHostname
I0717 18:31:03.561597 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:03.561787 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:03.561877 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:old-k8s-version-019549 Clientid:01:52:54:00:60:f7:87}
I0717 18:31:03.561900 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:03.562025 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHPort
I0717 18:31:03.562209 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHKeyPath
I0717 18:31:03.562202 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:old-k8s-version-019549 Clientid:01:52:54:00:60:f7:87}
I0717 18:31:03.562296 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:03.562420 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHPort
I0717 18:31:03.562439 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHUsername
I0717 18:31:03.562630 74819 sshutil.go:53] new ssh client: &{IP:192.168.39.128 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19283-14386/.minikube/machines/old-k8s-version-019549/id_rsa Username:docker}
I0717 18:31:03.562644 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHKeyPath
I0717 18:31:03.562802 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetSSHUsername
I0717 18:31:03.562949 74819 sshutil.go:53] new ssh client: &{IP:192.168.39.128 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19283-14386/.minikube/machines/old-k8s-version-019549/id_rsa Username:docker}
I0717 18:31:03.693184 74819 ssh_runner.go:195] Run: systemctl --version
I0717 18:31:03.699299 74819 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0717 18:31:03.860954 74819 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0717 18:31:03.866362 74819 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0717 18:31:03.866411 74819 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0717 18:31:03.881024 74819 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0717 18:31:03.881048 74819 start.go:495] detecting cgroup driver to use...
I0717 18:31:03.881111 74819 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0717 18:31:03.897061 74819 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0717 18:31:03.910491 74819 docker.go:217] disabling cri-docker service (if available) ...
I0717 18:31:03.910555 74819 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0717 18:31:03.927395 74819 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0717 18:31:03.943571 74819 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0717 18:31:04.078120 74819 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0717 18:31:04.228524 74819 docker.go:233] disabling docker service ...
I0717 18:31:04.228579 74819 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0717 18:31:04.241717 74819 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0717 18:31:04.253318 74819 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0717 18:31:04.389696 74819 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0717 18:31:04.547641 74819 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0717 18:31:04.561107 74819 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0717 18:31:04.588440 74819 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0717 18:31:04.588516 74819 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0717 18:31:04.598857 74819 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0717 18:31:04.598920 74819 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0717 18:31:04.608383 74819 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0717 18:31:04.620382 74819 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0717 18:31:04.632365 74819 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0717 18:31:04.645402 74819 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0717 18:31:04.655819 74819 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0717 18:31:04.655873 74819 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0717 18:31:04.672205 74819 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0717 18:31:04.683069 74819 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0717 18:31:04.814694 74819 ssh_runner.go:195] Run: sudo systemctl restart crio
I0717 18:31:04.946936 74819 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0717 18:31:04.947009 74819 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0717 18:31:04.952031 74819 start.go:563] Will wait 60s for crictl version
I0717 18:31:04.952122 74819 ssh_runner.go:195] Run: which crictl
I0717 18:31:04.955700 74819 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0717 18:31:04.996629 74819 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0717 18:31:04.996719 74819 ssh_runner.go:195] Run: crio --version
I0717 18:31:05.029675 74819 ssh_runner.go:195] Run: crio --version
I0717 18:31:05.065966 74819 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0717 18:31:05.067359 74819 main.go:141] libmachine: (old-k8s-version-019549) Calling .GetIP
I0717 18:31:05.070279 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:05.070826 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:60:f7:87", ip: ""} in network mk-old-k8s-version-019549: {Iface:virbr1 ExpiryTime:2024-07-17 19:30:54 +0000 UTC Type:0 Mac:52:54:00:60:f7:87 Iaid: IPaddr:192.168.39.128 Prefix:24 Hostname:old-k8s-version-019549 Clientid:01:52:54:00:60:f7:87}
I0717 18:31:05.070853 74819 main.go:141] libmachine: (old-k8s-version-019549) DBG | domain old-k8s-version-019549 has defined IP address 192.168.39.128 and MAC address 52:54:00:60:f7:87 in network mk-old-k8s-version-019549
I0717 18:31:05.071093 74819 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0717 18:31:05.075313 74819 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0717 18:31:05.087602 74819 kubeadm.go:883] updating cluster {Name:old-k8s-version-019549 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19264/minikube-v1.33.1-1721146474-19264-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721146479-19264@sha256:7ee06b7e8fb4a6c7fce11a567253ea7d43fed61ee0beca281a1ac2c2566a2a2e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-019549 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.128 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0717 18:31:05.087732 74819 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0717 18:31:05.087798 74819 ssh_runner.go:195] Run: sudo crictl images --output json
I0717 18:31:05.120180 74819 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0717 18:31:05.120317 74819 ssh_runner.go:195] Run: which lz4
I0717 18:31:05.124594 74819 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0717 18:31:05.128983 74819 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0717 18:31:05.129014 74819 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19283-14386/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0717 18:31:06.592094 74819 crio.go:462] duration metric: took 1.467531696s to copy over tarball
I0717 18:31:06.592169 74819 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0717 18:31:09.250346 74819 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.658146052s)
I0717 18:31:09.250403 74819 crio.go:469] duration metric: took 2.658260674s to extract the tarball
I0717 18:31:09.250413 74819 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0717 18:31:09.292840 74819 ssh_runner.go:195] Run: sudo crictl images --output json
I0717 18:31:09.338541 74819 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0717 18:31:09.338566 74819 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0717 18:31:09.338651 74819 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0717 18:31:09.338677 74819 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0717 18:31:09.338698 74819 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0717 18:31:09.338737 74819 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0717 18:31:09.338659 74819 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0717 18:31:09.338699 74819 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0717 18:31:09.338652 74819 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0717 18:31:09.338677 74819 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0717 18:31:09.340798 74819 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0717 18:31:09.340867 74819 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0717 18:31:09.340798 74819 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0717 18:31:09.341176 74819 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0717 18:31:09.341203 74819 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0717 18:31:09.341640 74819 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0717 18:31:09.341905 74819 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0717 18:31:09.342949 74819 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0717 18:31:09.573907 74819 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0717 18:31:09.577260 74819 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0717 18:31:09.594991 74819 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0717 18:31:09.606235 74819 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0717 18:31:09.616492 74819 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0717 18:31:09.621325 74819 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0717 18:31:09.628838 74819 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0717 18:31:09.628890 74819 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0717 18:31:09.628931 74819 ssh_runner.go:195] Run: which crictl
I0717 18:31:09.632543 74819 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0717 18:31:09.695537 74819 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0717 18:31:09.695597 74819 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0717 18:31:09.695650 74819 ssh_runner.go:195] Run: which crictl
I0717 18:31:09.744300 74819 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0717 18:31:09.744333 74819 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0717 18:31:09.744346 74819 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0717 18:31:09.744368 74819 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0717 18:31:09.744399 74819 ssh_runner.go:195] Run: which crictl
I0717 18:31:09.744413 74819 ssh_runner.go:195] Run: which crictl
I0717 18:31:09.756232 74819 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0717 18:31:09.756245 74819 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0717 18:31:09.756276 74819 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0717 18:31:09.756276 74819 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0717 18:31:09.756301 74819 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0717 18:31:09.756313 74819 ssh_runner.go:195] Run: which crictl
I0717 18:31:09.756319 74819 ssh_runner.go:195] Run: which crictl
I0717 18:31:09.756407 74819 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0717 18:31:09.756324 74819 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0717 18:31:09.756457 74819 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0717 18:31:09.756473 74819 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0717 18:31:09.756413 74819 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0717 18:31:09.756499 74819 ssh_runner.go:195] Run: which crictl
I0717 18:31:09.842781 74819 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19283-14386/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0717 18:31:09.842882 74819 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19283-14386/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0717 18:31:09.842921 74819 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19283-14386/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0717 18:31:09.842959 74819 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0717 18:31:09.843020 74819 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19283-14386/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0717 18:31:09.843024 74819 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0717 18:31:09.843070 74819 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0717 18:31:09.903970 74819 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19283-14386/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0717 18:31:09.904070 74819 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19283-14386/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0717 18:31:09.904094 74819 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19283-14386/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0717 18:31:10.238129 74819 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0717 18:31:10.379548 74819 cache_images.go:92] duration metric: took 1.040963855s to LoadCachedImages
W0717 18:31:10.379626 74819 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19283-14386/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19283-14386/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0: no such file or directory
I0717 18:31:10.379642 74819 kubeadm.go:934] updating node { 192.168.39.128 8443 v1.20.0 crio true true} ...
I0717 18:31:10.379777 74819 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-019549 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.128
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-019549 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0717 18:31:10.379865 74819 ssh_runner.go:195] Run: crio config
I0717 18:31:10.437791 74819 cni.go:84] Creating CNI manager for ""
I0717 18:31:10.437812 74819 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0717 18:31:10.437824 74819 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0717 18:31:10.437847 74819 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.128 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-019549 NodeName:old-k8s-version-019549 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.128"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.128 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0717 18:31:10.438009 74819 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.128
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-019549"
kubeletExtraArgs:
node-ip: 192.168.39.128
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.128"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0717 18:31:10.438088 74819 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0717 18:31:10.449956 74819 binaries.go:44] Found k8s binaries, skipping transfer
I0717 18:31:10.450013 74819 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0717 18:31:10.460463 74819 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0717 18:31:10.476547 74819 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0717 18:31:10.492084 74819 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0717 18:31:10.509445 74819 ssh_runner.go:195] Run: grep 192.168.39.128 control-plane.minikube.internal$ /etc/hosts
I0717 18:31:10.513251 74819 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.128 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0717 18:31:10.526119 74819 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0717 18:31:10.677870 74819 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0717 18:31:10.697202 74819 certs.go:68] Setting up /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549 for IP: 192.168.39.128
I0717 18:31:10.697234 74819 certs.go:194] generating shared ca certs ...
I0717 18:31:10.697256 74819 certs.go:226] acquiring lock for ca certs: {Name:mkc28fdf3682821f5875d0a18529b464529e842e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 18:31:10.697433 74819 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19283-14386/.minikube/ca.key
I0717 18:31:10.697498 74819 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19283-14386/.minikube/proxy-client-ca.key
I0717 18:31:10.697520 74819 certs.go:256] generating profile certs ...
I0717 18:31:10.697592 74819 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/client.key
I0717 18:31:10.697615 74819 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/client.crt with IP's: []
I0717 18:31:10.798057 74819 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/client.crt ...
I0717 18:31:10.798087 74819 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/client.crt: {Name:mkf350edecab257be64f4da587d8ed64e15927ae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 18:31:10.798256 74819 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/client.key ...
I0717 18:31:10.798272 74819 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/client.key: {Name:mk3f3535f97adf5bab10ce3ef99f5497e1e10ecd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 18:31:10.798382 74819 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/apiserver.key.9c9b0a7e
I0717 18:31:10.798414 74819 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/apiserver.crt.9c9b0a7e with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.128]
I0717 18:31:10.963734 74819 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/apiserver.crt.9c9b0a7e ...
I0717 18:31:10.963772 74819 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/apiserver.crt.9c9b0a7e: {Name:mk97d4c073e4301fe87beb7d727c35e706ad890a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 18:31:10.963986 74819 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/apiserver.key.9c9b0a7e ...
I0717 18:31:10.964011 74819 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/apiserver.key.9c9b0a7e: {Name:mk2be4e280f915f64dab3da0849fe53c325279f8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 18:31:10.964125 74819 certs.go:381] copying /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/apiserver.crt.9c9b0a7e -> /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/apiserver.crt
I0717 18:31:10.964248 74819 certs.go:385] copying /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/apiserver.key.9c9b0a7e -> /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/apiserver.key
I0717 18:31:10.964358 74819 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/proxy-client.key
I0717 18:31:10.964384 74819 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/proxy-client.crt with IP's: []
I0717 18:31:11.060742 74819 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/proxy-client.crt ...
I0717 18:31:11.060775 74819 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/proxy-client.crt: {Name:mk80eaee2913c38fd7107fdb9d5ddd21824fe96a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 18:31:11.060976 74819 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/proxy-client.key ...
I0717 18:31:11.060995 74819 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/proxy-client.key: {Name:mk17d6687cf5ffccba2793e502afa1292fd8c841 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0717 18:31:11.061186 74819 certs.go:484] found cert: /home/jenkins/minikube-integration/19283-14386/.minikube/certs/21577.pem (1338 bytes)
W0717 18:31:11.061239 74819 certs.go:480] ignoring /home/jenkins/minikube-integration/19283-14386/.minikube/certs/21577_empty.pem, impossibly tiny 0 bytes
I0717 18:31:11.061254 74819 certs.go:484] found cert: /home/jenkins/minikube-integration/19283-14386/.minikube/certs/ca-key.pem (1675 bytes)
I0717 18:31:11.061290 74819 certs.go:484] found cert: /home/jenkins/minikube-integration/19283-14386/.minikube/certs/ca.pem (1082 bytes)
I0717 18:31:11.061334 74819 certs.go:484] found cert: /home/jenkins/minikube-integration/19283-14386/.minikube/certs/cert.pem (1123 bytes)
I0717 18:31:11.061375 74819 certs.go:484] found cert: /home/jenkins/minikube-integration/19283-14386/.minikube/certs/key.pem (1679 bytes)
I0717 18:31:11.061434 74819 certs.go:484] found cert: /home/jenkins/minikube-integration/19283-14386/.minikube/files/etc/ssl/certs/215772.pem (1708 bytes)
I0717 18:31:11.062074 74819 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19283-14386/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0717 18:31:11.087934 74819 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19283-14386/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0717 18:31:11.112128 74819 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19283-14386/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0717 18:31:11.135768 74819 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19283-14386/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0717 18:31:11.158964 74819 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0717 18:31:11.181513 74819 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0717 18:31:11.205179 74819 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0717 18:31:11.231072 74819 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19283-14386/.minikube/profiles/old-k8s-version-019549/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0717 18:31:11.253263 74819 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19283-14386/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0717 18:31:11.276704 74819 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19283-14386/.minikube/certs/21577.pem --> /usr/share/ca-certificates/21577.pem (1338 bytes)
I0717 18:31:11.298682 74819 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19283-14386/.minikube/files/etc/ssl/certs/215772.pem --> /usr/share/ca-certificates/215772.pem (1708 bytes)
I0717 18:31:11.327204 74819 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0717 18:31:11.343947 74819 ssh_runner.go:195] Run: openssl version
I0717 18:31:11.349912 74819 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/215772.pem && ln -fs /usr/share/ca-certificates/215772.pem /etc/ssl/certs/215772.pem"
I0717 18:31:11.360185 74819 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/215772.pem
I0717 18:31:11.364577 74819 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 17 17:25 /usr/share/ca-certificates/215772.pem
I0717 18:31:11.364625 74819 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/215772.pem
I0717 18:31:11.370278 74819 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/215772.pem /etc/ssl/certs/3ec20f2e.0"
I0717 18:31:11.380294 74819 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0717 18:31:11.390373 74819 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0717 18:31:11.394540 74819 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 17 17:12 /usr/share/ca-certificates/minikubeCA.pem
I0717 18:31:11.394590 74819 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0717 18:31:11.399795 74819 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0717 18:31:11.409697 74819 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/21577.pem && ln -fs /usr/share/ca-certificates/21577.pem /etc/ssl/certs/21577.pem"
I0717 18:31:11.420059 74819 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/21577.pem
I0717 18:31:11.424212 74819 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 17 17:25 /usr/share/ca-certificates/21577.pem
I0717 18:31:11.424258 74819 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/21577.pem
I0717 18:31:11.429786 74819 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/21577.pem /etc/ssl/certs/51391683.0"
I0717 18:31:11.439630 74819 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0717 18:31:11.443342 74819 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0717 18:31:11.443388 74819 kubeadm.go:392] StartCluster: {Name:old-k8s-version-019549 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19264/minikube-v1.33.1-1721146474-19264-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721146479-19264@sha256:7ee06b7e8fb4a6c7fce11a567253ea7d43fed61ee0beca281a1ac2c2566a2a2e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-019549 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.128 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0717 18:31:11.443459 74819 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0717 18:31:11.443514 74819 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0717 18:31:11.487361 74819 cri.go:89] found id: ""
I0717 18:31:11.487439 74819 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0717 18:31:11.497497 74819 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0717 18:31:11.510104 74819 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0717 18:31:11.520369 74819 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0717 18:31:11.520390 74819 kubeadm.go:157] found existing configuration files:
I0717 18:31:11.520438 74819 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0717 18:31:11.532605 74819 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0717 18:31:11.532684 74819 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0717 18:31:11.545212 74819 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0717 18:31:11.558253 74819 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0717 18:31:11.558331 74819 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0717 18:31:11.570653 74819 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0717 18:31:11.582392 74819 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0717 18:31:11.582477 74819 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0717 18:31:11.595098 74819 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0717 18:31:11.609806 74819 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0717 18:31:11.609866 74819 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0717 18:31:11.620105 74819 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0717 18:31:11.867731 74819 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0717 18:33:09.347430 74819 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0717 18:33:09.347646 74819 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0717 18:33:09.348892 74819 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0717 18:33:09.349019 74819 kubeadm.go:310] [preflight] Running pre-flight checks
I0717 18:33:09.349289 74819 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0717 18:33:09.349491 74819 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0717 18:33:09.349667 74819 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0717 18:33:09.349988 74819 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0717 18:33:09.351845 74819 out.go:204] - Generating certificates and keys ...
I0717 18:33:09.351936 74819 kubeadm.go:310] [certs] Using existing ca certificate authority
I0717 18:33:09.352013 74819 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0717 18:33:09.352103 74819 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0717 18:33:09.352189 74819 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0717 18:33:09.352283 74819 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0717 18:33:09.352357 74819 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0717 18:33:09.352435 74819 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0717 18:33:09.352718 74819 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-019549] and IPs [192.168.39.128 127.0.0.1 ::1]
I0717 18:33:09.352793 74819 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0717 18:33:09.353014 74819 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-019549] and IPs [192.168.39.128 127.0.0.1 ::1]
I0717 18:33:09.353107 74819 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0717 18:33:09.353179 74819 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0717 18:33:09.353231 74819 kubeadm.go:310] [certs] Generating "sa" key and public key
I0717 18:33:09.353298 74819 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0717 18:33:09.353379 74819 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0717 18:33:09.353457 74819 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0717 18:33:09.353554 74819 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0717 18:33:09.353641 74819 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0717 18:33:09.353812 74819 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0717 18:33:09.353936 74819 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0717 18:33:09.353991 74819 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0717 18:33:09.354088 74819 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0717 18:33:09.355847 74819 out.go:204] - Booting up control plane ...
I0717 18:33:09.355944 74819 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0717 18:33:09.356045 74819 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0717 18:33:09.356125 74819 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0717 18:33:09.356223 74819 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0717 18:33:09.356411 74819 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0717 18:33:09.356468 74819 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0717 18:33:09.356539 74819 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 18:33:09.356729 74819 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 18:33:09.356816 74819 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 18:33:09.357002 74819 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 18:33:09.357093 74819 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 18:33:09.357280 74819 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 18:33:09.357382 74819 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 18:33:09.357647 74819 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 18:33:09.357760 74819 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 18:33:09.357955 74819 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 18:33:09.357965 74819 kubeadm.go:310]
I0717 18:33:09.358014 74819 kubeadm.go:310] Unfortunately, an error has occurred:
I0717 18:33:09.358068 74819 kubeadm.go:310] timed out waiting for the condition
I0717 18:33:09.358078 74819 kubeadm.go:310]
I0717 18:33:09.358127 74819 kubeadm.go:310] This error is likely caused by:
I0717 18:33:09.358165 74819 kubeadm.go:310] - The kubelet is not running
I0717 18:33:09.358303 74819 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0717 18:33:09.358314 74819 kubeadm.go:310]
I0717 18:33:09.358445 74819 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0717 18:33:09.358505 74819 kubeadm.go:310] - 'systemctl status kubelet'
I0717 18:33:09.358569 74819 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0717 18:33:09.358590 74819 kubeadm.go:310]
I0717 18:33:09.358706 74819 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0717 18:33:09.358802 74819 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0717 18:33:09.358812 74819 kubeadm.go:310]
I0717 18:33:09.358940 74819 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0717 18:33:09.359074 74819 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0717 18:33:09.359194 74819 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0717 18:33:09.359269 74819 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0717 18:33:09.359329 74819 kubeadm.go:310]
W0717 18:33:09.359417 74819 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-019549] and IPs [192.168.39.128 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-019549] and IPs [192.168.39.128 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-019549] and IPs [192.168.39.128 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-019549] and IPs [192.168.39.128 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0717 18:33:09.359466 74819 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0717 18:33:09.836103 74819 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0717 18:33:09.850765 74819 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0717 18:33:09.860184 74819 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0717 18:33:09.860198 74819 kubeadm.go:157] found existing configuration files:
I0717 18:33:09.860234 74819 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0717 18:33:09.868881 74819 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0717 18:33:09.868920 74819 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0717 18:33:09.877736 74819 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0717 18:33:09.885826 74819 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0717 18:33:09.885871 74819 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0717 18:33:09.894069 74819 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0717 18:33:09.901994 74819 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0717 18:33:09.902032 74819 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0717 18:33:09.910236 74819 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0717 18:33:09.917849 74819 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0717 18:33:09.917884 74819 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0717 18:33:09.926850 74819 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0717 18:33:10.119596 74819 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0717 18:35:06.295325 74819 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0717 18:35:06.295453 74819 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0717 18:35:06.297640 74819 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0717 18:35:06.297696 74819 kubeadm.go:310] [preflight] Running pre-flight checks
I0717 18:35:06.297787 74819 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0717 18:35:06.297890 74819 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0717 18:35:06.297980 74819 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0717 18:35:06.298046 74819 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0717 18:35:06.299918 74819 out.go:204] - Generating certificates and keys ...
I0717 18:35:06.299993 74819 kubeadm.go:310] [certs] Using existing ca certificate authority
I0717 18:35:06.300047 74819 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0717 18:35:06.300127 74819 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0717 18:35:06.300201 74819 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0717 18:35:06.300304 74819 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0717 18:35:06.300385 74819 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0717 18:35:06.300439 74819 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0717 18:35:06.300492 74819 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0717 18:35:06.300570 74819 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0717 18:35:06.300640 74819 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0717 18:35:06.300673 74819 kubeadm.go:310] [certs] Using the existing "sa" key
I0717 18:35:06.300720 74819 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0717 18:35:06.300762 74819 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0717 18:35:06.300809 74819 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0717 18:35:06.300863 74819 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0717 18:35:06.300916 74819 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0717 18:35:06.301032 74819 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0717 18:35:06.301180 74819 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0717 18:35:06.301254 74819 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0717 18:35:06.301348 74819 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0717 18:35:06.302821 74819 out.go:204] - Booting up control plane ...
I0717 18:35:06.302928 74819 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0717 18:35:06.303015 74819 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0717 18:35:06.303102 74819 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0717 18:35:06.303204 74819 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0717 18:35:06.303393 74819 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0717 18:35:06.303467 74819 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0717 18:35:06.303559 74819 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 18:35:06.303770 74819 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 18:35:06.303871 74819 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 18:35:06.304071 74819 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 18:35:06.304135 74819 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 18:35:06.304327 74819 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 18:35:06.304399 74819 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 18:35:06.304584 74819 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 18:35:06.304665 74819 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0717 18:35:06.304823 74819 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0717 18:35:06.304830 74819 kubeadm.go:310]
I0717 18:35:06.304863 74819 kubeadm.go:310] Unfortunately, an error has occurred:
I0717 18:35:06.304896 74819 kubeadm.go:310] timed out waiting for the condition
I0717 18:35:06.304902 74819 kubeadm.go:310]
I0717 18:35:06.304930 74819 kubeadm.go:310] This error is likely caused by:
I0717 18:35:06.304978 74819 kubeadm.go:310] - The kubelet is not running
I0717 18:35:06.305068 74819 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0717 18:35:06.305075 74819 kubeadm.go:310]
I0717 18:35:06.305157 74819 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0717 18:35:06.305214 74819 kubeadm.go:310] - 'systemctl status kubelet'
I0717 18:35:06.305256 74819 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0717 18:35:06.305268 74819 kubeadm.go:310]
I0717 18:35:06.305421 74819 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0717 18:35:06.305529 74819 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0717 18:35:06.305543 74819 kubeadm.go:310]
I0717 18:35:06.305631 74819 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0717 18:35:06.305701 74819 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0717 18:35:06.305784 74819 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0717 18:35:06.305859 74819 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0717 18:35:06.305894 74819 kubeadm.go:310]
I0717 18:35:06.305911 74819 kubeadm.go:394] duration metric: took 3m54.862527242s to StartCluster
I0717 18:35:06.305956 74819 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0717 18:35:06.306004 74819 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0717 18:35:06.347369 74819 cri.go:89] found id: ""
I0717 18:35:06.347400 74819 logs.go:276] 0 containers: []
W0717 18:35:06.347410 74819 logs.go:278] No container was found matching "kube-apiserver"
I0717 18:35:06.347421 74819 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0717 18:35:06.347478 74819 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0717 18:35:06.380733 74819 cri.go:89] found id: ""
I0717 18:35:06.380754 74819 logs.go:276] 0 containers: []
W0717 18:35:06.380761 74819 logs.go:278] No container was found matching "etcd"
I0717 18:35:06.380769 74819 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0717 18:35:06.380812 74819 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0717 18:35:06.413506 74819 cri.go:89] found id: ""
I0717 18:35:06.413532 74819 logs.go:276] 0 containers: []
W0717 18:35:06.413540 74819 logs.go:278] No container was found matching "coredns"
I0717 18:35:06.413556 74819 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0717 18:35:06.413620 74819 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0717 18:35:06.446206 74819 cri.go:89] found id: ""
I0717 18:35:06.446234 74819 logs.go:276] 0 containers: []
W0717 18:35:06.446240 74819 logs.go:278] No container was found matching "kube-scheduler"
I0717 18:35:06.446248 74819 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0717 18:35:06.446296 74819 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0717 18:35:06.477644 74819 cri.go:89] found id: ""
I0717 18:35:06.477668 74819 logs.go:276] 0 containers: []
W0717 18:35:06.477675 74819 logs.go:278] No container was found matching "kube-proxy"
I0717 18:35:06.477680 74819 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0717 18:35:06.477729 74819 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0717 18:35:06.509588 74819 cri.go:89] found id: ""
I0717 18:35:06.509620 74819 logs.go:276] 0 containers: []
W0717 18:35:06.509630 74819 logs.go:278] No container was found matching "kube-controller-manager"
I0717 18:35:06.509638 74819 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0717 18:35:06.509696 74819 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0717 18:35:06.541410 74819 cri.go:89] found id: ""
I0717 18:35:06.541434 74819 logs.go:276] 0 containers: []
W0717 18:35:06.541443 74819 logs.go:278] No container was found matching "kindnet"
I0717 18:35:06.541454 74819 logs.go:123] Gathering logs for kubelet ...
I0717 18:35:06.541468 74819 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0717 18:35:06.591073 74819 logs.go:123] Gathering logs for dmesg ...
I0717 18:35:06.591108 74819 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0717 18:35:06.604095 74819 logs.go:123] Gathering logs for describe nodes ...
I0717 18:35:06.604118 74819 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0717 18:35:06.713393 74819 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0717 18:35:06.713426 74819 logs.go:123] Gathering logs for CRI-O ...
I0717 18:35:06.713482 74819 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0717 18:35:06.804414 74819 logs.go:123] Gathering logs for container status ...
I0717 18:35:06.804450 74819 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0717 18:35:06.840985 74819 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0717 18:35:06.841035 74819 out.go:239] *
*
W0717 18:35:06.841094 74819 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0717 18:35:06.841125 74819 out.go:239] *
*
W0717 18:35:06.841978 74819 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0717 18:35:06.845882 74819 out.go:177]
W0717 18:35:06.847260 74819 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0717 18:35:06.847305 74819 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0717 18:35:06.847338 74819 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0717 18:35:06.848956 74819 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-019549 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-019549 -n old-k8s-version-019549
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-019549 -n old-k8s-version-019549: exit status 6 (226.520256ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0717 18:35:07.117916 80050 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-019549" does not appear in /home/jenkins/minikube-integration/19283-14386/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-019549" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (267.48s)