=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-360866 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-360866 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m32.172729341s)
-- stdout --
* [old-k8s-version-360866] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19338
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19338-974764/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19338-974764/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-360866" primary control-plane node in "old-k8s-version-360866" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0729 14:28:31.273056 1033083 out.go:291] Setting OutFile to fd 1 ...
I0729 14:28:31.273272 1033083 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 14:28:31.273314 1033083 out.go:304] Setting ErrFile to fd 2...
I0729 14:28:31.273327 1033083 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0729 14:28:31.273544 1033083 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19338-974764/.minikube/bin
I0729 14:28:31.274247 1033083 out.go:298] Setting JSON to false
I0729 14:28:31.275820 1033083 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":15063,"bootTime":1722248248,"procs":337,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0729 14:28:31.275950 1033083 start.go:139] virtualization: kvm guest
I0729 14:28:31.278703 1033083 out.go:177] * [old-k8s-version-360866] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0729 14:28:31.280095 1033083 notify.go:220] Checking for updates...
I0729 14:28:31.280180 1033083 out.go:177] - MINIKUBE_LOCATION=19338
I0729 14:28:31.283448 1033083 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0729 14:28:31.285434 1033083 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19338-974764/kubeconfig
I0729 14:28:31.286790 1033083 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19338-974764/.minikube
I0729 14:28:31.288073 1033083 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0729 14:28:31.289349 1033083 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0729 14:28:31.291328 1033083 config.go:182] Loaded profile config "bridge-513289": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0729 14:28:31.291489 1033083 config.go:182] Loaded profile config "enable-default-cni-513289": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0729 14:28:31.291610 1033083 config.go:182] Loaded profile config "flannel-513289": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.3
I0729 14:28:31.291787 1033083 driver.go:392] Setting default libvirt URI to qemu:///system
I0729 14:28:31.340237 1033083 out.go:177] * Using the kvm2 driver based on user configuration
I0729 14:28:31.341530 1033083 start.go:297] selected driver: kvm2
I0729 14:28:31.341552 1033083 start.go:901] validating driver "kvm2" against <nil>
I0729 14:28:31.341567 1033083 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0729 14:28:31.342742 1033083 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0729 14:28:31.344535 1033083 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19338-974764/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0729 14:28:31.362167 1033083 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0729 14:28:31.362247 1033083 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0729 14:28:31.362546 1033083 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0729 14:28:31.362591 1033083 cni.go:84] Creating CNI manager for ""
I0729 14:28:31.362602 1033083 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0729 14:28:31.362617 1033083 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0729 14:28:31.362709 1033083 start.go:340] cluster config:
{Name:old-k8s-version-360866 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-360866 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0729 14:28:31.362865 1033083 iso.go:125] acquiring lock: {Name:mk2bc72146110e230952d77b90cad2ea8182c9d0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0729 14:28:31.364535 1033083 out.go:177] * Starting "old-k8s-version-360866" primary control-plane node in "old-k8s-version-360866" cluster
I0729 14:28:31.365828 1033083 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0729 14:28:31.365874 1033083 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19338-974764/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0729 14:28:31.365888 1033083 cache.go:56] Caching tarball of preloaded images
I0729 14:28:31.365982 1033083 preload.go:172] Found /home/jenkins/minikube-integration/19338-974764/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0729 14:28:31.366010 1033083 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0729 14:28:31.366126 1033083 profile.go:143] Saving config to /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/config.json ...
I0729 14:28:31.366150 1033083 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/config.json: {Name:mk53ec475e7a6666c1fa7294f55c504c4c3e7a7d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 14:28:31.370940 1033083 start.go:360] acquireMachinesLock for old-k8s-version-360866: {Name:mk751e57256ca523e1aae60bb753bc041a65d89e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0729 14:28:31.371004 1033083 start.go:364] duration metric: took 33.263µs to acquireMachinesLock for "old-k8s-version-360866"
I0729 14:28:31.371030 1033083 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-360866 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19319/minikube-v1.33.1-1721690939-19319-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-360866 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0729 14:28:31.371110 1033083 start.go:125] createHost starting for "" (driver="kvm2")
I0729 14:28:31.372913 1033083 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0729 14:28:31.373096 1033083 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0729 14:28:31.373155 1033083 main.go:141] libmachine: Launching plugin server for driver kvm2
I0729 14:28:31.390783 1033083 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34027
I0729 14:28:31.391335 1033083 main.go:141] libmachine: () Calling .GetVersion
I0729 14:28:31.392000 1033083 main.go:141] libmachine: Using API Version 1
I0729 14:28:31.392027 1033083 main.go:141] libmachine: () Calling .SetConfigRaw
I0729 14:28:31.392541 1033083 main.go:141] libmachine: () Calling .GetMachineName
I0729 14:28:31.392800 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetMachineName
I0729 14:28:31.392978 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .DriverName
I0729 14:28:31.393145 1033083 start.go:159] libmachine.API.Create for "old-k8s-version-360866" (driver="kvm2")
I0729 14:28:31.393176 1033083 client.go:168] LocalClient.Create starting
I0729 14:28:31.393221 1033083 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19338-974764/.minikube/certs/ca.pem
I0729 14:28:31.393265 1033083 main.go:141] libmachine: Decoding PEM data...
I0729 14:28:31.393288 1033083 main.go:141] libmachine: Parsing certificate...
I0729 14:28:31.393369 1033083 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19338-974764/.minikube/certs/cert.pem
I0729 14:28:31.393393 1033083 main.go:141] libmachine: Decoding PEM data...
I0729 14:28:31.393412 1033083 main.go:141] libmachine: Parsing certificate...
I0729 14:28:31.393436 1033083 main.go:141] libmachine: Running pre-create checks...
I0729 14:28:31.393453 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .PreCreateCheck
I0729 14:28:31.393863 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetConfigRaw
I0729 14:28:31.394348 1033083 main.go:141] libmachine: Creating machine...
I0729 14:28:31.394366 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .Create
I0729 14:28:31.394537 1033083 main.go:141] libmachine: (old-k8s-version-360866) Creating KVM machine...
I0729 14:28:31.396044 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found existing default KVM network
I0729 14:28:31.398278 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:31.398076 1033122 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002017f0}
I0729 14:28:31.398361 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | created network xml:
I0729 14:28:31.398395 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | <network>
I0729 14:28:31.398407 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | <name>mk-old-k8s-version-360866</name>
I0729 14:28:31.398415 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | <dns enable='no'/>
I0729 14:28:31.398423 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG |
I0729 14:28:31.398431 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0729 14:28:31.398448 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | <dhcp>
I0729 14:28:31.398456 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0729 14:28:31.398465 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | </dhcp>
I0729 14:28:31.398473 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | </ip>
I0729 14:28:31.398480 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG |
I0729 14:28:31.398491 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | </network>
I0729 14:28:31.398501 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG |
I0729 14:28:31.404417 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | trying to create private KVM network mk-old-k8s-version-360866 192.168.39.0/24...
I0729 14:28:31.510743 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | private KVM network mk-old-k8s-version-360866 192.168.39.0/24 created
I0729 14:28:31.510783 1033083 main.go:141] libmachine: (old-k8s-version-360866) Setting up store path in /home/jenkins/minikube-integration/19338-974764/.minikube/machines/old-k8s-version-360866 ...
I0729 14:28:31.510798 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:31.510713 1033122 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19338-974764/.minikube
I0729 14:28:31.510811 1033083 main.go:141] libmachine: (old-k8s-version-360866) Building disk image from file:///home/jenkins/minikube-integration/19338-974764/.minikube/cache/iso/amd64/minikube-v1.33.1-1721690939-19319-amd64.iso
I0729 14:28:31.510835 1033083 main.go:141] libmachine: (old-k8s-version-360866) Downloading /home/jenkins/minikube-integration/19338-974764/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19338-974764/.minikube/cache/iso/amd64/minikube-v1.33.1-1721690939-19319-amd64.iso...
I0729 14:28:31.925132 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:31.924932 1033122 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19338-974764/.minikube/machines/old-k8s-version-360866/id_rsa...
I0729 14:28:32.197741 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:32.197638 1033122 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19338-974764/.minikube/machines/old-k8s-version-360866/old-k8s-version-360866.rawdisk...
I0729 14:28:32.197790 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | Writing magic tar header
I0729 14:28:32.197808 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | Writing SSH key tar header
I0729 14:28:32.197830 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:32.197810 1033122 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19338-974764/.minikube/machines/old-k8s-version-360866 ...
I0729 14:28:32.197953 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19338-974764/.minikube/machines/old-k8s-version-360866
I0729 14:28:32.197984 1033083 main.go:141] libmachine: (old-k8s-version-360866) Setting executable bit set on /home/jenkins/minikube-integration/19338-974764/.minikube/machines/old-k8s-version-360866 (perms=drwx------)
I0729 14:28:32.198075 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19338-974764/.minikube/machines
I0729 14:28:32.198094 1033083 main.go:141] libmachine: (old-k8s-version-360866) Setting executable bit set on /home/jenkins/minikube-integration/19338-974764/.minikube/machines (perms=drwxr-xr-x)
I0729 14:28:32.198116 1033083 main.go:141] libmachine: (old-k8s-version-360866) Setting executable bit set on /home/jenkins/minikube-integration/19338-974764/.minikube (perms=drwxr-xr-x)
I0729 14:28:32.198131 1033083 main.go:141] libmachine: (old-k8s-version-360866) Setting executable bit set on /home/jenkins/minikube-integration/19338-974764 (perms=drwxrwxr-x)
I0729 14:28:32.198142 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19338-974764/.minikube
I0729 14:28:32.198159 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19338-974764
I0729 14:28:32.198172 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0729 14:28:32.198193 1033083 main.go:141] libmachine: (old-k8s-version-360866) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0729 14:28:32.207440 1033083 main.go:141] libmachine: (old-k8s-version-360866) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0729 14:28:32.207464 1033083 main.go:141] libmachine: (old-k8s-version-360866) Creating domain...
I0729 14:28:32.207480 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | Checking permissions on dir: /home/jenkins
I0729 14:28:32.207488 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | Checking permissions on dir: /home
I0729 14:28:32.207498 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | Skipping /home - not owner
I0729 14:28:32.208146 1033083 main.go:141] libmachine: (old-k8s-version-360866) define libvirt domain using xml:
I0729 14:28:32.208170 1033083 main.go:141] libmachine: (old-k8s-version-360866) <domain type='kvm'>
I0729 14:28:32.208180 1033083 main.go:141] libmachine: (old-k8s-version-360866) <name>old-k8s-version-360866</name>
I0729 14:28:32.208189 1033083 main.go:141] libmachine: (old-k8s-version-360866) <memory unit='MiB'>2200</memory>
I0729 14:28:32.208198 1033083 main.go:141] libmachine: (old-k8s-version-360866) <vcpu>2</vcpu>
I0729 14:28:32.208205 1033083 main.go:141] libmachine: (old-k8s-version-360866) <features>
I0729 14:28:32.208213 1033083 main.go:141] libmachine: (old-k8s-version-360866) <acpi/>
I0729 14:28:32.208220 1033083 main.go:141] libmachine: (old-k8s-version-360866) <apic/>
I0729 14:28:32.208228 1033083 main.go:141] libmachine: (old-k8s-version-360866) <pae/>
I0729 14:28:32.208236 1033083 main.go:141] libmachine: (old-k8s-version-360866)
I0729 14:28:32.208263 1033083 main.go:141] libmachine: (old-k8s-version-360866) </features>
I0729 14:28:32.208284 1033083 main.go:141] libmachine: (old-k8s-version-360866) <cpu mode='host-passthrough'>
I0729 14:28:32.208305 1033083 main.go:141] libmachine: (old-k8s-version-360866)
I0729 14:28:32.208316 1033083 main.go:141] libmachine: (old-k8s-version-360866) </cpu>
I0729 14:28:32.208325 1033083 main.go:141] libmachine: (old-k8s-version-360866) <os>
I0729 14:28:32.208333 1033083 main.go:141] libmachine: (old-k8s-version-360866) <type>hvm</type>
I0729 14:28:32.208346 1033083 main.go:141] libmachine: (old-k8s-version-360866) <boot dev='cdrom'/>
I0729 14:28:32.208365 1033083 main.go:141] libmachine: (old-k8s-version-360866) <boot dev='hd'/>
I0729 14:28:32.208374 1033083 main.go:141] libmachine: (old-k8s-version-360866) <bootmenu enable='no'/>
I0729 14:28:32.208381 1033083 main.go:141] libmachine: (old-k8s-version-360866) </os>
I0729 14:28:32.208389 1033083 main.go:141] libmachine: (old-k8s-version-360866) <devices>
I0729 14:28:32.208397 1033083 main.go:141] libmachine: (old-k8s-version-360866) <disk type='file' device='cdrom'>
I0729 14:28:32.208425 1033083 main.go:141] libmachine: (old-k8s-version-360866) <source file='/home/jenkins/minikube-integration/19338-974764/.minikube/machines/old-k8s-version-360866/boot2docker.iso'/>
I0729 14:28:32.208438 1033083 main.go:141] libmachine: (old-k8s-version-360866) <target dev='hdc' bus='scsi'/>
I0729 14:28:32.208447 1033083 main.go:141] libmachine: (old-k8s-version-360866) <readonly/>
I0729 14:28:32.208454 1033083 main.go:141] libmachine: (old-k8s-version-360866) </disk>
I0729 14:28:32.208462 1033083 main.go:141] libmachine: (old-k8s-version-360866) <disk type='file' device='disk'>
I0729 14:28:32.208472 1033083 main.go:141] libmachine: (old-k8s-version-360866) <driver name='qemu' type='raw' cache='default' io='threads' />
I0729 14:28:32.208485 1033083 main.go:141] libmachine: (old-k8s-version-360866) <source file='/home/jenkins/minikube-integration/19338-974764/.minikube/machines/old-k8s-version-360866/old-k8s-version-360866.rawdisk'/>
I0729 14:28:32.208493 1033083 main.go:141] libmachine: (old-k8s-version-360866) <target dev='hda' bus='virtio'/>
I0729 14:28:32.208501 1033083 main.go:141] libmachine: (old-k8s-version-360866) </disk>
I0729 14:28:32.208517 1033083 main.go:141] libmachine: (old-k8s-version-360866) <interface type='network'>
I0729 14:28:32.208534 1033083 main.go:141] libmachine: (old-k8s-version-360866) <source network='mk-old-k8s-version-360866'/>
I0729 14:28:32.208542 1033083 main.go:141] libmachine: (old-k8s-version-360866) <model type='virtio'/>
I0729 14:28:32.208551 1033083 main.go:141] libmachine: (old-k8s-version-360866) </interface>
I0729 14:28:32.208559 1033083 main.go:141] libmachine: (old-k8s-version-360866) <interface type='network'>
I0729 14:28:32.208568 1033083 main.go:141] libmachine: (old-k8s-version-360866) <source network='default'/>
I0729 14:28:32.208576 1033083 main.go:141] libmachine: (old-k8s-version-360866) <model type='virtio'/>
I0729 14:28:32.208584 1033083 main.go:141] libmachine: (old-k8s-version-360866) </interface>
I0729 14:28:32.208596 1033083 main.go:141] libmachine: (old-k8s-version-360866) <serial type='pty'>
I0729 14:28:32.208604 1033083 main.go:141] libmachine: (old-k8s-version-360866) <target port='0'/>
I0729 14:28:32.208611 1033083 main.go:141] libmachine: (old-k8s-version-360866) </serial>
I0729 14:28:32.208620 1033083 main.go:141] libmachine: (old-k8s-version-360866) <console type='pty'>
I0729 14:28:32.208627 1033083 main.go:141] libmachine: (old-k8s-version-360866) <target type='serial' port='0'/>
I0729 14:28:32.208635 1033083 main.go:141] libmachine: (old-k8s-version-360866) </console>
I0729 14:28:32.208643 1033083 main.go:141] libmachine: (old-k8s-version-360866) <rng model='virtio'>
I0729 14:28:32.208653 1033083 main.go:141] libmachine: (old-k8s-version-360866) <backend model='random'>/dev/random</backend>
I0729 14:28:32.208659 1033083 main.go:141] libmachine: (old-k8s-version-360866) </rng>
I0729 14:28:32.208683 1033083 main.go:141] libmachine: (old-k8s-version-360866)
I0729 14:28:32.208700 1033083 main.go:141] libmachine: (old-k8s-version-360866)
I0729 14:28:32.208713 1033083 main.go:141] libmachine: (old-k8s-version-360866) </devices>
I0729 14:28:32.208720 1033083 main.go:141] libmachine: (old-k8s-version-360866) </domain>
I0729 14:28:32.208734 1033083 main.go:141] libmachine: (old-k8s-version-360866)
I0729 14:28:32.241655 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:3a:0b:69 in network default
I0729 14:28:32.242441 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:32.242469 1033083 main.go:141] libmachine: (old-k8s-version-360866) Ensuring networks are active...
I0729 14:28:32.243412 1033083 main.go:141] libmachine: (old-k8s-version-360866) Ensuring network default is active
I0729 14:28:32.243780 1033083 main.go:141] libmachine: (old-k8s-version-360866) Ensuring network mk-old-k8s-version-360866 is active
I0729 14:28:32.244387 1033083 main.go:141] libmachine: (old-k8s-version-360866) Getting domain xml...
I0729 14:28:32.245193 1033083 main.go:141] libmachine: (old-k8s-version-360866) Creating domain...
I0729 14:28:32.804896 1033083 main.go:141] libmachine: (old-k8s-version-360866) Waiting to get IP...
I0729 14:28:32.806165 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:32.806698 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | unable to find current IP address of domain old-k8s-version-360866 in network mk-old-k8s-version-360866
I0729 14:28:32.806720 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:32.806608 1033122 retry.go:31] will retry after 228.322166ms: waiting for machine to come up
I0729 14:28:33.037367 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:33.037905 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | unable to find current IP address of domain old-k8s-version-360866 in network mk-old-k8s-version-360866
I0729 14:28:33.037933 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:33.037816 1033122 retry.go:31] will retry after 249.995013ms: waiting for machine to come up
I0729 14:28:33.289328 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:33.290065 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | unable to find current IP address of domain old-k8s-version-360866 in network mk-old-k8s-version-360866
I0729 14:28:33.290088 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:33.289968 1033122 retry.go:31] will retry after 349.584363ms: waiting for machine to come up
I0729 14:28:33.641502 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:33.642096 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | unable to find current IP address of domain old-k8s-version-360866 in network mk-old-k8s-version-360866
I0729 14:28:33.642116 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:33.642030 1033122 retry.go:31] will retry after 444.332574ms: waiting for machine to come up
I0729 14:28:34.088753 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:34.089039 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | unable to find current IP address of domain old-k8s-version-360866 in network mk-old-k8s-version-360866
I0729 14:28:34.089067 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:34.089032 1033122 retry.go:31] will retry after 707.593433ms: waiting for machine to come up
I0729 14:28:34.798096 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:34.798562 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | unable to find current IP address of domain old-k8s-version-360866 in network mk-old-k8s-version-360866
I0729 14:28:34.798591 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:34.798533 1033122 retry.go:31] will retry after 594.671601ms: waiting for machine to come up
I0729 14:28:35.395034 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:35.400533 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | unable to find current IP address of domain old-k8s-version-360866 in network mk-old-k8s-version-360866
I0729 14:28:35.400568 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:35.395395 1033122 retry.go:31] will retry after 1.016936876s: waiting for machine to come up
I0729 14:28:36.414067 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:36.414581 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | unable to find current IP address of domain old-k8s-version-360866 in network mk-old-k8s-version-360866
I0729 14:28:36.414609 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:36.414563 1033122 retry.go:31] will retry after 1.003950185s: waiting for machine to come up
I0729 14:28:37.419568 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:37.420189 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | unable to find current IP address of domain old-k8s-version-360866 in network mk-old-k8s-version-360866
I0729 14:28:37.420218 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:37.420136 1033122 retry.go:31] will retry after 1.723914839s: waiting for machine to come up
I0729 14:28:39.145463 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:39.146109 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | unable to find current IP address of domain old-k8s-version-360866 in network mk-old-k8s-version-360866
I0729 14:28:39.146136 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:39.146069 1033122 retry.go:31] will retry after 1.797341647s: waiting for machine to come up
I0729 14:28:40.945369 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:40.945982 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | unable to find current IP address of domain old-k8s-version-360866 in network mk-old-k8s-version-360866
I0729 14:28:40.946039 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:40.945961 1033122 retry.go:31] will retry after 2.608222134s: waiting for machine to come up
I0729 14:28:43.555973 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:43.556568 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | unable to find current IP address of domain old-k8s-version-360866 in network mk-old-k8s-version-360866
I0729 14:28:43.556595 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:43.556525 1033122 retry.go:31] will retry after 2.82927867s: waiting for machine to come up
I0729 14:28:46.389608 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:46.390141 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | unable to find current IP address of domain old-k8s-version-360866 in network mk-old-k8s-version-360866
I0729 14:28:46.390169 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:46.390099 1033122 retry.go:31] will retry after 4.208985533s: waiting for machine to come up
I0729 14:28:50.602671 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:50.603215 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | unable to find current IP address of domain old-k8s-version-360866 in network mk-old-k8s-version-360866
I0729 14:28:50.603270 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | I0729 14:28:50.603178 1033122 retry.go:31] will retry after 3.815282729s: waiting for machine to come up
I0729 14:28:54.421712 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:54.422272 1033083 main.go:141] libmachine: (old-k8s-version-360866) Found IP for machine: 192.168.39.71
I0729 14:28:54.422296 1033083 main.go:141] libmachine: (old-k8s-version-360866) Reserving static IP address...
I0729 14:28:54.422312 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has current primary IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:54.422694 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-360866", mac: "52:54:00:18:de:25", ip: "192.168.39.71"} in network mk-old-k8s-version-360866
I0729 14:28:54.500886 1033083 main.go:141] libmachine: (old-k8s-version-360866) Reserved static IP address: 192.168.39.71
I0729 14:28:54.500918 1033083 main.go:141] libmachine: (old-k8s-version-360866) Waiting for SSH to be available...
I0729 14:28:54.500929 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | Getting to WaitForSSH function...
I0729 14:28:54.504082 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:54.504583 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:minikube Clientid:01:52:54:00:18:de:25}
I0729 14:28:54.504614 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:54.504712 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | Using SSH client type: external
I0729 14:28:54.504739 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | Using SSH private key: /home/jenkins/minikube-integration/19338-974764/.minikube/machines/old-k8s-version-360866/id_rsa (-rw-------)
I0729 14:28:54.504767 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.71 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19338-974764/.minikube/machines/old-k8s-version-360866/id_rsa -p 22] /usr/bin/ssh <nil>}
I0729 14:28:54.504780 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | About to run SSH command:
I0729 14:28:54.504799 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | exit 0
I0729 14:28:54.633259 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | SSH cmd err, output: <nil>:
I0729 14:28:54.633520 1033083 main.go:141] libmachine: (old-k8s-version-360866) KVM machine creation complete!
I0729 14:28:54.633833 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetConfigRaw
I0729 14:28:54.634454 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .DriverName
I0729 14:28:54.634777 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .DriverName
I0729 14:28:54.635000 1033083 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0729 14:28:54.635013 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetState
I0729 14:28:54.636303 1033083 main.go:141] libmachine: Detecting operating system of created instance...
I0729 14:28:54.636319 1033083 main.go:141] libmachine: Waiting for SSH to be available...
I0729 14:28:54.636327 1033083 main.go:141] libmachine: Getting to WaitForSSH function...
I0729 14:28:54.636337 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHHostname
I0729 14:28:54.638977 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:54.639346 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:old-k8s-version-360866 Clientid:01:52:54:00:18:de:25}
I0729 14:28:54.639389 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:54.639603 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHPort
I0729 14:28:54.639835 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHKeyPath
I0729 14:28:54.640001 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHKeyPath
I0729 14:28:54.640152 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHUsername
I0729 14:28:54.640361 1033083 main.go:141] libmachine: Using SSH client type: native
I0729 14:28:54.640642 1033083 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.71 22 <nil> <nil>}
I0729 14:28:54.640661 1033083 main.go:141] libmachine: About to run SSH command:
exit 0
I0729 14:28:54.748936 1033083 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0729 14:28:54.748964 1033083 main.go:141] libmachine: Detecting the provisioner...
I0729 14:28:54.748976 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHHostname
I0729 14:28:54.752709 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:54.753242 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:old-k8s-version-360866 Clientid:01:52:54:00:18:de:25}
I0729 14:28:54.753294 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:54.753604 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHPort
I0729 14:28:54.753877 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHKeyPath
I0729 14:28:54.754157 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHKeyPath
I0729 14:28:54.754345 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHUsername
I0729 14:28:54.754587 1033083 main.go:141] libmachine: Using SSH client type: native
I0729 14:28:54.754839 1033083 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.71 22 <nil> <nil>}
I0729 14:28:54.754860 1033083 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0729 14:28:54.867483 1033083 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0729 14:28:54.867596 1033083 main.go:141] libmachine: found compatible host: buildroot
I0729 14:28:54.867607 1033083 main.go:141] libmachine: Provisioning with buildroot...
I0729 14:28:54.867620 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetMachineName
I0729 14:28:54.867868 1033083 buildroot.go:166] provisioning hostname "old-k8s-version-360866"
I0729 14:28:54.867890 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetMachineName
I0729 14:28:54.868048 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHHostname
I0729 14:28:54.870879 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:54.871281 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:old-k8s-version-360866 Clientid:01:52:54:00:18:de:25}
I0729 14:28:54.871302 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:54.871535 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHPort
I0729 14:28:54.871749 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHKeyPath
I0729 14:28:54.871909 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHKeyPath
I0729 14:28:54.872019 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHUsername
I0729 14:28:54.872124 1033083 main.go:141] libmachine: Using SSH client type: native
I0729 14:28:54.872327 1033083 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.71 22 <nil> <nil>}
I0729 14:28:54.872339 1033083 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-360866 && echo "old-k8s-version-360866" | sudo tee /etc/hostname
I0729 14:28:55.013729 1033083 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-360866
I0729 14:28:55.013760 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHHostname
I0729 14:28:55.017121 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.017530 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:old-k8s-version-360866 Clientid:01:52:54:00:18:de:25}
I0729 14:28:55.017561 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.017769 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHPort
I0729 14:28:55.018024 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHKeyPath
I0729 14:28:55.018265 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHKeyPath
I0729 14:28:55.018449 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHUsername
I0729 14:28:55.018655 1033083 main.go:141] libmachine: Using SSH client type: native
I0729 14:28:55.018871 1033083 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.71 22 <nil> <nil>}
I0729 14:28:55.018898 1033083 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-360866' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-360866/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-360866' | sudo tee -a /etc/hosts;
fi
fi
I0729 14:28:55.142653 1033083 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0729 14:28:55.142691 1033083 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19338-974764/.minikube CaCertPath:/home/jenkins/minikube-integration/19338-974764/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19338-974764/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19338-974764/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19338-974764/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19338-974764/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19338-974764/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19338-974764/.minikube}
I0729 14:28:55.142730 1033083 buildroot.go:174] setting up certificates
I0729 14:28:55.142744 1033083 provision.go:84] configureAuth start
I0729 14:28:55.142759 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetMachineName
I0729 14:28:55.143097 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetIP
I0729 14:28:55.146500 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.146971 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:old-k8s-version-360866 Clientid:01:52:54:00:18:de:25}
I0729 14:28:55.146994 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.147132 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHHostname
I0729 14:28:55.149756 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.150160 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:old-k8s-version-360866 Clientid:01:52:54:00:18:de:25}
I0729 14:28:55.150198 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.150376 1033083 provision.go:143] copyHostCerts
I0729 14:28:55.150452 1033083 exec_runner.go:144] found /home/jenkins/minikube-integration/19338-974764/.minikube/key.pem, removing ...
I0729 14:28:55.150464 1033083 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19338-974764/.minikube/key.pem
I0729 14:28:55.150545 1033083 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19338-974764/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19338-974764/.minikube/key.pem (1675 bytes)
I0729 14:28:55.150697 1033083 exec_runner.go:144] found /home/jenkins/minikube-integration/19338-974764/.minikube/ca.pem, removing ...
I0729 14:28:55.150711 1033083 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19338-974764/.minikube/ca.pem
I0729 14:28:55.150749 1033083 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19338-974764/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19338-974764/.minikube/ca.pem (1078 bytes)
I0729 14:28:55.150927 1033083 exec_runner.go:144] found /home/jenkins/minikube-integration/19338-974764/.minikube/cert.pem, removing ...
I0729 14:28:55.150942 1033083 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19338-974764/.minikube/cert.pem
I0729 14:28:55.150988 1033083 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19338-974764/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19338-974764/.minikube/cert.pem (1123 bytes)
I0729 14:28:55.151077 1033083 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19338-974764/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19338-974764/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19338-974764/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-360866 san=[127.0.0.1 192.168.39.71 localhost minikube old-k8s-version-360866]
I0729 14:28:55.255992 1033083 provision.go:177] copyRemoteCerts
I0729 14:28:55.256060 1033083 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0729 14:28:55.256087 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHHostname
I0729 14:28:55.259030 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.259473 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:old-k8s-version-360866 Clientid:01:52:54:00:18:de:25}
I0729 14:28:55.259509 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.259640 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHPort
I0729 14:28:55.259835 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHKeyPath
I0729 14:28:55.259993 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHUsername
I0729 14:28:55.260161 1033083 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19338-974764/.minikube/machines/old-k8s-version-360866/id_rsa Username:docker}
I0729 14:28:55.344171 1033083 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19338-974764/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0729 14:28:55.376014 1033083 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19338-974764/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0729 14:28:55.401330 1033083 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19338-974764/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0729 14:28:55.431813 1033083 provision.go:87] duration metric: took 289.046144ms to configureAuth
I0729 14:28:55.431854 1033083 buildroot.go:189] setting minikube options for container-runtime
I0729 14:28:55.432088 1033083 config.go:182] Loaded profile config "old-k8s-version-360866": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0729 14:28:55.432202 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHHostname
I0729 14:28:55.435653 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.436053 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:old-k8s-version-360866 Clientid:01:52:54:00:18:de:25}
I0729 14:28:55.436119 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.436303 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHPort
I0729 14:28:55.436545 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHKeyPath
I0729 14:28:55.436800 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHKeyPath
I0729 14:28:55.436971 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHUsername
I0729 14:28:55.437196 1033083 main.go:141] libmachine: Using SSH client type: native
I0729 14:28:55.437411 1033083 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.71 22 <nil> <nil>}
I0729 14:28:55.437441 1033083 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0729 14:28:55.747185 1033083 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0729 14:28:55.747237 1033083 main.go:141] libmachine: Checking connection to Docker...
I0729 14:28:55.747251 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetURL
I0729 14:28:55.748709 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | Using libvirt version 6000000
I0729 14:28:55.751287 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.751816 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:old-k8s-version-360866 Clientid:01:52:54:00:18:de:25}
I0729 14:28:55.751847 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.752045 1033083 main.go:141] libmachine: Docker is up and running!
I0729 14:28:55.752060 1033083 main.go:141] libmachine: Reticulating splines...
I0729 14:28:55.752068 1033083 client.go:171] duration metric: took 24.358881527s to LocalClient.Create
I0729 14:28:55.752097 1033083 start.go:167] duration metric: took 24.358953487s to libmachine.API.Create "old-k8s-version-360866"
I0729 14:28:55.752110 1033083 start.go:293] postStartSetup for "old-k8s-version-360866" (driver="kvm2")
I0729 14:28:55.752124 1033083 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0729 14:28:55.752142 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .DriverName
I0729 14:28:55.752457 1033083 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0729 14:28:55.752491 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHHostname
I0729 14:28:55.755010 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.755458 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:old-k8s-version-360866 Clientid:01:52:54:00:18:de:25}
I0729 14:28:55.755491 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.755656 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHPort
I0729 14:28:55.755842 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHKeyPath
I0729 14:28:55.756027 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHUsername
I0729 14:28:55.756242 1033083 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19338-974764/.minikube/machines/old-k8s-version-360866/id_rsa Username:docker}
I0729 14:28:55.840838 1033083 ssh_runner.go:195] Run: cat /etc/os-release
I0729 14:28:55.845960 1033083 info.go:137] Remote host: Buildroot 2023.02.9
I0729 14:28:55.845992 1033083 filesync.go:126] Scanning /home/jenkins/minikube-integration/19338-974764/.minikube/addons for local assets ...
I0729 14:28:55.846062 1033083 filesync.go:126] Scanning /home/jenkins/minikube-integration/19338-974764/.minikube/files for local assets ...
I0729 14:28:55.846174 1033083 filesync.go:149] local asset: /home/jenkins/minikube-integration/19338-974764/.minikube/files/etc/ssl/certs/9820462.pem -> 9820462.pem in /etc/ssl/certs
I0729 14:28:55.846279 1033083 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0729 14:28:55.858605 1033083 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19338-974764/.minikube/files/etc/ssl/certs/9820462.pem --> /etc/ssl/certs/9820462.pem (1708 bytes)
I0729 14:28:55.888120 1033083 start.go:296] duration metric: took 135.989345ms for postStartSetup
I0729 14:28:55.888186 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetConfigRaw
I0729 14:28:55.889170 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetIP
I0729 14:28:55.892860 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.893331 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:old-k8s-version-360866 Clientid:01:52:54:00:18:de:25}
I0729 14:28:55.893362 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.893703 1033083 profile.go:143] Saving config to /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/config.json ...
I0729 14:28:55.893946 1033083 start.go:128] duration metric: took 24.522820544s to createHost
I0729 14:28:55.894000 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHHostname
I0729 14:28:55.897070 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.897467 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:old-k8s-version-360866 Clientid:01:52:54:00:18:de:25}
I0729 14:28:55.897500 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:55.897704 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHPort
I0729 14:28:55.897938 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHKeyPath
I0729 14:28:55.898151 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHKeyPath
I0729 14:28:55.898335 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHUsername
I0729 14:28:55.898484 1033083 main.go:141] libmachine: Using SSH client type: native
I0729 14:28:55.898691 1033083 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82da80] 0x8307e0 <nil> [] 0s} 192.168.39.71 22 <nil> <nil>}
I0729 14:28:55.898719 1033083 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0729 14:28:56.015142 1033083 main.go:141] libmachine: SSH cmd err, output: <nil>: 1722263335.995115949
I0729 14:28:56.015171 1033083 fix.go:216] guest clock: 1722263335.995115949
I0729 14:28:56.015180 1033083 fix.go:229] Guest: 2024-07-29 14:28:55.995115949 +0000 UTC Remote: 2024-07-29 14:28:55.893974006 +0000 UTC m=+24.670652751 (delta=101.141943ms)
I0729 14:28:56.015210 1033083 fix.go:200] guest clock delta is within tolerance: 101.141943ms
I0729 14:28:56.015217 1033083 start.go:83] releasing machines lock for "old-k8s-version-360866", held for 24.644202858s
I0729 14:28:56.015248 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .DriverName
I0729 14:28:56.015534 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetIP
I0729 14:28:56.018706 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:56.019185 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:old-k8s-version-360866 Clientid:01:52:54:00:18:de:25}
I0729 14:28:56.019217 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:56.019429 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .DriverName
I0729 14:28:56.020020 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .DriverName
I0729 14:28:56.020260 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .DriverName
I0729 14:28:56.020378 1033083 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0729 14:28:56.020439 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHHostname
I0729 14:28:56.020754 1033083 ssh_runner.go:195] Run: cat /version.json
I0729 14:28:56.020784 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHHostname
I0729 14:28:56.023662 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:56.023983 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:56.024079 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:old-k8s-version-360866 Clientid:01:52:54:00:18:de:25}
I0729 14:28:56.024110 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:56.024461 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:old-k8s-version-360866 Clientid:01:52:54:00:18:de:25}
I0729 14:28:56.024486 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:56.024498 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHPort
I0729 14:28:56.024731 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHPort
I0729 14:28:56.024781 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHKeyPath
I0729 14:28:56.025020 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHUsername
I0729 14:28:56.025060 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHKeyPath
I0729 14:28:56.025231 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetSSHUsername
I0729 14:28:56.025226 1033083 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19338-974764/.minikube/machines/old-k8s-version-360866/id_rsa Username:docker}
I0729 14:28:56.025677 1033083 sshutil.go:53] new ssh client: &{IP:192.168.39.71 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19338-974764/.minikube/machines/old-k8s-version-360866/id_rsa Username:docker}
I0729 14:28:56.142217 1033083 ssh_runner.go:195] Run: systemctl --version
I0729 14:28:56.151912 1033083 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0729 14:28:56.334856 1033083 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0729 14:28:56.344077 1033083 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0729 14:28:56.344178 1033083 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0729 14:28:56.363476 1033083 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0729 14:28:56.363506 1033083 start.go:495] detecting cgroup driver to use...
I0729 14:28:56.363580 1033083 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0729 14:28:56.384876 1033083 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0729 14:28:56.401968 1033083 docker.go:217] disabling cri-docker service (if available) ...
I0729 14:28:56.402085 1033083 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0729 14:28:56.422352 1033083 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0729 14:28:56.441341 1033083 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0729 14:28:56.596194 1033083 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0729 14:28:56.778640 1033083 docker.go:233] disabling docker service ...
I0729 14:28:56.778732 1033083 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0729 14:28:56.798479 1033083 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0729 14:28:56.815936 1033083 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0729 14:28:56.946778 1033083 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0729 14:28:57.076528 1033083 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0729 14:28:57.096064 1033083 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0729 14:28:57.116883 1033083 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0729 14:28:57.116955 1033083 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0729 14:28:57.130346 1033083 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0729 14:28:57.130442 1033083 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0729 14:28:57.144906 1033083 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0729 14:28:57.160964 1033083 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0729 14:28:57.176326 1033083 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0729 14:28:57.189969 1033083 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0729 14:28:57.201105 1033083 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0729 14:28:57.201180 1033083 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0729 14:28:57.218814 1033083 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0729 14:28:57.232325 1033083 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0729 14:28:57.364202 1033083 ssh_runner.go:195] Run: sudo systemctl restart crio
I0729 14:28:57.527340 1033083 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0729 14:28:57.527439 1033083 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0729 14:28:57.533358 1033083 start.go:563] Will wait 60s for crictl version
I0729 14:28:57.533418 1033083 ssh_runner.go:195] Run: which crictl
I0729 14:28:57.537637 1033083 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0729 14:28:57.585285 1033083 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0729 14:28:57.585377 1033083 ssh_runner.go:195] Run: crio --version
I0729 14:28:57.617507 1033083 ssh_runner.go:195] Run: crio --version
I0729 14:28:57.651360 1033083 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0729 14:28:57.652686 1033083 main.go:141] libmachine: (old-k8s-version-360866) Calling .GetIP
I0729 14:28:57.656645 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:57.657061 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:18:de:25", ip: ""} in network mk-old-k8s-version-360866: {Iface:virbr3 ExpiryTime:2024-07-29 15:28:47 +0000 UTC Type:0 Mac:52:54:00:18:de:25 Iaid: IPaddr:192.168.39.71 Prefix:24 Hostname:old-k8s-version-360866 Clientid:01:52:54:00:18:de:25}
I0729 14:28:57.657097 1033083 main.go:141] libmachine: (old-k8s-version-360866) DBG | domain old-k8s-version-360866 has defined IP address 192.168.39.71 and MAC address 52:54:00:18:de:25 in network mk-old-k8s-version-360866
I0729 14:28:57.657392 1033083 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0729 14:28:57.661837 1033083 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0729 14:28:57.677914 1033083 kubeadm.go:883] updating cluster {Name:old-k8s-version-360866 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19319/minikube-v1.33.1-1721690939-19319-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-360866 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.71 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0729 14:28:57.678020 1033083 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0729 14:28:57.678071 1033083 ssh_runner.go:195] Run: sudo crictl images --output json
I0729 14:28:57.712417 1033083 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0729 14:28:57.712527 1033083 ssh_runner.go:195] Run: which lz4
I0729 14:28:57.716787 1033083 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0729 14:28:57.721164 1033083 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0729 14:28:57.721197 1033083 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19338-974764/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0729 14:28:59.430984 1033083 crio.go:462] duration metric: took 1.714228279s to copy over tarball
I0729 14:28:59.431063 1033083 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0729 14:29:02.448086 1033083 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.016981225s)
I0729 14:29:02.448123 1033083 crio.go:469] duration metric: took 3.017108243s to extract the tarball
I0729 14:29:02.448133 1033083 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0729 14:29:02.492298 1033083 ssh_runner.go:195] Run: sudo crictl images --output json
I0729 14:29:02.545251 1033083 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0729 14:29:02.545289 1033083 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0729 14:29:02.545382 1033083 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0729 14:29:02.545457 1033083 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0729 14:29:02.545497 1033083 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0729 14:29:02.545715 1033083 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0729 14:29:02.545729 1033083 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0729 14:29:02.545735 1033083 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0729 14:29:02.545715 1033083 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0729 14:29:02.545390 1033083 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0729 14:29:02.554171 1033083 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0729 14:29:02.554200 1033083 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0729 14:29:02.554265 1033083 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0729 14:29:02.554367 1033083 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0729 14:29:02.554402 1033083 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0729 14:29:02.554534 1033083 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0729 14:29:02.554536 1033083 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0729 14:29:02.554579 1033083 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0729 14:29:02.726407 1033083 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0729 14:29:02.728856 1033083 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0729 14:29:02.729442 1033083 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0729 14:29:02.733189 1033083 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0729 14:29:02.745554 1033083 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0729 14:29:02.755700 1033083 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0729 14:29:02.789406 1033083 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0729 14:29:02.847803 1033083 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0729 14:29:02.847884 1033083 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0729 14:29:02.847943 1033083 ssh_runner.go:195] Run: which crictl
I0729 14:29:02.850146 1033083 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0729 14:29:02.904310 1033083 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0729 14:29:02.904375 1033083 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0729 14:29:02.904442 1033083 ssh_runner.go:195] Run: which crictl
I0729 14:29:02.924597 1033083 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0729 14:29:02.924664 1033083 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0729 14:29:02.924728 1033083 ssh_runner.go:195] Run: which crictl
I0729 14:29:02.924616 1033083 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0729 14:29:02.924816 1033083 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0729 14:29:02.924846 1033083 ssh_runner.go:195] Run: which crictl
I0729 14:29:02.945314 1033083 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0729 14:29:02.945370 1033083 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0729 14:29:02.945509 1033083 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0729 14:29:02.945533 1033083 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0729 14:29:02.945592 1033083 ssh_runner.go:195] Run: which crictl
I0729 14:29:02.945748 1033083 ssh_runner.go:195] Run: which crictl
I0729 14:29:02.958980 1033083 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0729 14:29:02.959002 1033083 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0729 14:29:02.959039 1033083 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0729 14:29:02.959078 1033083 ssh_runner.go:195] Run: which crictl
I0729 14:29:03.074412 1033083 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0729 14:29:03.074444 1033083 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0729 14:29:03.074480 1033083 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0729 14:29:03.074534 1033083 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0729 14:29:03.074538 1033083 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0729 14:29:03.074593 1033083 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19338-974764/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0729 14:29:03.074623 1033083 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0729 14:29:03.218314 1033083 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19338-974764/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0729 14:29:03.218330 1033083 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19338-974764/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0729 14:29:03.218392 1033083 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19338-974764/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0729 14:29:03.218444 1033083 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19338-974764/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0729 14:29:03.218482 1033083 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19338-974764/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0729 14:29:03.218504 1033083 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/19338-974764/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0729 14:29:03.218547 1033083 cache_images.go:92] duration metric: took 673.236936ms to LoadCachedImages
W0729 14:29:03.218630 1033083 out.go:239] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19338-974764/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/19338-974764/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0: no such file or directory
I0729 14:29:03.218646 1033083 kubeadm.go:934] updating node { 192.168.39.71 8443 v1.20.0 crio true true} ...
I0729 14:29:03.218782 1033083 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-360866 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.71
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-360866 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0729 14:29:03.218862 1033083 ssh_runner.go:195] Run: crio config
I0729 14:29:03.289105 1033083 cni.go:84] Creating CNI manager for ""
I0729 14:29:03.289127 1033083 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0729 14:29:03.289139 1033083 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0729 14:29:03.289165 1033083 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.71 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-360866 NodeName:old-k8s-version-360866 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.71"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.71 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0729 14:29:03.289356 1033083 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.71
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-360866"
kubeletExtraArgs:
node-ip: 192.168.39.71
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.71"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0729 14:29:03.289435 1033083 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0729 14:29:03.303654 1033083 binaries.go:44] Found k8s binaries, skipping transfer
I0729 14:29:03.303732 1033083 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0729 14:29:03.316796 1033083 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0729 14:29:03.338085 1033083 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0729 14:29:03.360446 1033083 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0729 14:29:03.381660 1033083 ssh_runner.go:195] Run: grep 192.168.39.71 control-plane.minikube.internal$ /etc/hosts
I0729 14:29:03.386287 1033083 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.71 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0729 14:29:03.402580 1033083 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0729 14:29:03.531845 1033083 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0729 14:29:03.550412 1033083 certs.go:68] Setting up /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866 for IP: 192.168.39.71
I0729 14:29:03.550443 1033083 certs.go:194] generating shared ca certs ...
I0729 14:29:03.550467 1033083 certs.go:226] acquiring lock for ca certs: {Name:mk49ca2c0d607456f32457f31c51812910fb9911 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 14:29:03.550655 1033083 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19338-974764/.minikube/ca.key
I0729 14:29:03.550692 1033083 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19338-974764/.minikube/proxy-client-ca.key
I0729 14:29:03.550701 1033083 certs.go:256] generating profile certs ...
I0729 14:29:03.550754 1033083 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/client.key
I0729 14:29:03.550767 1033083 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/client.crt with IP's: []
I0729 14:29:03.933720 1033083 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/client.crt ...
I0729 14:29:03.933759 1033083 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/client.crt: {Name:mk3d8bc88a0ce20bcfa5404a08a65e85db78e645 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 14:29:03.964804 1033083 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/client.key ...
I0729 14:29:03.964868 1033083 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/client.key: {Name:mk48bc2e2ebae699e7ba4e77d49d00b907178223 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 14:29:03.994138 1033083 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/apiserver.key.98c2aed0
I0729 14:29:03.994199 1033083 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/apiserver.crt.98c2aed0 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.71]
I0729 14:29:04.252140 1033083 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/apiserver.crt.98c2aed0 ...
I0729 14:29:04.252173 1033083 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/apiserver.crt.98c2aed0: {Name:mk12d5daabd152d70af6ca1d3212809f89918486 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 14:29:04.252930 1033083 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/apiserver.key.98c2aed0 ...
I0729 14:29:04.252963 1033083 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/apiserver.key.98c2aed0: {Name:mk34ecd0a48f8d96bab30ff70e0599d475d2a15d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 14:29:04.264062 1033083 certs.go:381] copying /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/apiserver.crt.98c2aed0 -> /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/apiserver.crt
I0729 14:29:04.264206 1033083 certs.go:385] copying /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/apiserver.key.98c2aed0 -> /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/apiserver.key
I0729 14:29:04.264290 1033083 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/proxy-client.key
I0729 14:29:04.264309 1033083 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/proxy-client.crt with IP's: []
I0729 14:29:04.396655 1033083 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/proxy-client.crt ...
I0729 14:29:04.396697 1033083 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/proxy-client.crt: {Name:mkeb19120719e624a67a1782b8bf1fea63a4166b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 14:29:04.397463 1033083 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/proxy-client.key ...
I0729 14:29:04.397491 1033083 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/proxy-client.key: {Name:mk27da796653fe49cc3ad4d61719a18ae344d462 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0729 14:29:04.405917 1033083 certs.go:484] found cert: /home/jenkins/minikube-integration/19338-974764/.minikube/certs/982046.pem (1338 bytes)
W0729 14:29:04.405995 1033083 certs.go:480] ignoring /home/jenkins/minikube-integration/19338-974764/.minikube/certs/982046_empty.pem, impossibly tiny 0 bytes
I0729 14:29:04.406007 1033083 certs.go:484] found cert: /home/jenkins/minikube-integration/19338-974764/.minikube/certs/ca-key.pem (1675 bytes)
I0729 14:29:04.406036 1033083 certs.go:484] found cert: /home/jenkins/minikube-integration/19338-974764/.minikube/certs/ca.pem (1078 bytes)
I0729 14:29:04.406064 1033083 certs.go:484] found cert: /home/jenkins/minikube-integration/19338-974764/.minikube/certs/cert.pem (1123 bytes)
I0729 14:29:04.406090 1033083 certs.go:484] found cert: /home/jenkins/minikube-integration/19338-974764/.minikube/certs/key.pem (1675 bytes)
I0729 14:29:04.406142 1033083 certs.go:484] found cert: /home/jenkins/minikube-integration/19338-974764/.minikube/files/etc/ssl/certs/9820462.pem (1708 bytes)
I0729 14:29:04.406951 1033083 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19338-974764/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0729 14:29:04.439141 1033083 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19338-974764/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0729 14:29:04.473037 1033083 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19338-974764/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0729 14:29:04.507087 1033083 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19338-974764/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0729 14:29:04.538985 1033083 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0729 14:29:04.615373 1033083 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0729 14:29:04.665658 1033083 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0729 14:29:04.691890 1033083 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/old-k8s-version-360866/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0729 14:29:04.717016 1033083 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19338-974764/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0729 14:29:04.743019 1033083 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19338-974764/.minikube/certs/982046.pem --> /usr/share/ca-certificates/982046.pem (1338 bytes)
I0729 14:29:04.768344 1033083 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19338-974764/.minikube/files/etc/ssl/certs/9820462.pem --> /usr/share/ca-certificates/9820462.pem (1708 bytes)
I0729 14:29:04.792612 1033083 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0729 14:29:04.810340 1033083 ssh_runner.go:195] Run: openssl version
I0729 14:29:04.817316 1033083 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0729 14:29:04.828774 1033083 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0729 14:29:04.833568 1033083 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 29 13:12 /usr/share/ca-certificates/minikubeCA.pem
I0729 14:29:04.833630 1033083 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0729 14:29:04.840263 1033083 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0729 14:29:04.851846 1033083 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/982046.pem && ln -fs /usr/share/ca-certificates/982046.pem /etc/ssl/certs/982046.pem"
I0729 14:29:04.863293 1033083 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/982046.pem
I0729 14:29:04.867773 1033083 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 29 13:24 /usr/share/ca-certificates/982046.pem
I0729 14:29:04.867832 1033083 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/982046.pem
I0729 14:29:04.873555 1033083 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/982046.pem /etc/ssl/certs/51391683.0"
I0729 14:29:04.884556 1033083 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/9820462.pem && ln -fs /usr/share/ca-certificates/9820462.pem /etc/ssl/certs/9820462.pem"
I0729 14:29:04.895309 1033083 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/9820462.pem
I0729 14:29:04.899781 1033083 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 29 13:24 /usr/share/ca-certificates/9820462.pem
I0729 14:29:04.899829 1033083 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/9820462.pem
I0729 14:29:04.906286 1033083 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/9820462.pem /etc/ssl/certs/3ec20f2e.0"
I0729 14:29:04.917685 1033083 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0729 14:29:04.921845 1033083 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0729 14:29:04.921897 1033083 kubeadm.go:392] StartCluster: {Name:old-k8s-version-360866 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19319/minikube-v1.33.1-1721690939-19319-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721902582-19326@sha256:540fb5dc7f38be17ff5276a38dfe6c8a4b1d9ba1c27c62244e6eebd7e37696e7 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-360866 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.71 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0729 14:29:04.921971 1033083 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0729 14:29:04.922048 1033083 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0729 14:29:04.962995 1033083 cri.go:89] found id: ""
I0729 14:29:04.963071 1033083 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0729 14:29:04.974907 1033083 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0729 14:29:04.984817 1033083 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0729 14:29:04.994117 1033083 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0729 14:29:04.994149 1033083 kubeadm.go:157] found existing configuration files:
I0729 14:29:04.994202 1033083 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0729 14:29:05.004445 1033083 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0729 14:29:05.004538 1033083 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0729 14:29:05.014500 1033083 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0729 14:29:05.024243 1033083 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0729 14:29:05.024301 1033083 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0729 14:29:05.033935 1033083 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0729 14:29:05.046745 1033083 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0729 14:29:05.046836 1033083 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0729 14:29:05.059294 1033083 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0729 14:29:05.068570 1033083 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0729 14:29:05.068623 1033083 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0729 14:29:05.080920 1033083 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0729 14:29:05.371363 1033083 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0729 14:29:05.371430 1033083 kubeadm.go:310] [preflight] Running pre-flight checks
I0729 14:29:05.576570 1033083 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0729 14:29:05.576735 1033083 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0729 14:29:05.576867 1033083 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0729 14:29:05.804009 1033083 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0729 14:29:05.806566 1033083 out.go:204] - Generating certificates and keys ...
I0729 14:29:05.806690 1033083 kubeadm.go:310] [certs] Using existing ca certificate authority
I0729 14:29:05.806817 1033083 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0729 14:29:06.113559 1033083 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0729 14:29:06.351141 1033083 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0729 14:29:06.625452 1033083 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0729 14:29:06.783650 1033083 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0729 14:29:07.186617 1033083 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0729 14:29:07.186993 1033083 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-360866] and IPs [192.168.39.71 127.0.0.1 ::1]
I0729 14:29:07.336334 1033083 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0729 14:29:07.336610 1033083 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-360866] and IPs [192.168.39.71 127.0.0.1 ::1]
I0729 14:29:07.726254 1033083 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0729 14:29:07.865618 1033083 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0729 14:29:08.162756 1033083 kubeadm.go:310] [certs] Generating "sa" key and public key
I0729 14:29:08.163277 1033083 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0729 14:29:08.403171 1033083 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0729 14:29:08.547258 1033083 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0729 14:29:09.171169 1033083 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0729 14:29:09.471313 1033083 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0729 14:29:09.506761 1033083 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0729 14:29:09.506952 1033083 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0729 14:29:09.507035 1033083 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0729 14:29:09.692137 1033083 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0729 14:29:09.694565 1033083 out.go:204] - Booting up control plane ...
I0729 14:29:09.694686 1033083 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0729 14:29:09.709259 1033083 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0729 14:29:09.710745 1033083 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0729 14:29:09.713841 1033083 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0729 14:29:09.718022 1033083 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0729 14:29:49.715836 1033083 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0729 14:29:49.716775 1033083 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 14:29:49.717043 1033083 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 14:29:54.717379 1033083 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 14:29:54.717610 1033083 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 14:30:04.718558 1033083 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 14:30:04.718819 1033083 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 14:30:24.720436 1033083 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 14:30:24.720666 1033083 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 14:31:04.720245 1033083 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 14:31:04.720801 1033083 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 14:31:04.720975 1033083 kubeadm.go:310]
I0729 14:31:04.721053 1033083 kubeadm.go:310] Unfortunately, an error has occurred:
I0729 14:31:04.721139 1033083 kubeadm.go:310] timed out waiting for the condition
I0729 14:31:04.721147 1033083 kubeadm.go:310]
I0729 14:31:04.721224 1033083 kubeadm.go:310] This error is likely caused by:
I0729 14:31:04.721325 1033083 kubeadm.go:310] - The kubelet is not running
I0729 14:31:04.721586 1033083 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0729 14:31:04.721603 1033083 kubeadm.go:310]
I0729 14:31:04.721802 1033083 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0729 14:31:04.721881 1033083 kubeadm.go:310] - 'systemctl status kubelet'
I0729 14:31:04.721955 1033083 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0729 14:31:04.721964 1033083 kubeadm.go:310]
I0729 14:31:04.722215 1033083 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0729 14:31:04.722454 1033083 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0729 14:31:04.722482 1033083 kubeadm.go:310]
I0729 14:31:04.722735 1033083 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0729 14:31:04.723087 1033083 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0729 14:31:04.723367 1033083 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0729 14:31:04.723568 1033083 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0729 14:31:04.723606 1033083 kubeadm.go:310]
I0729 14:31:04.724134 1033083 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0729 14:31:04.724305 1033083 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0729 14:31:04.724520 1033083 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
W0729 14:31:04.724607 1033083 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-360866] and IPs [192.168.39.71 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-360866] and IPs [192.168.39.71 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-360866] and IPs [192.168.39.71 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-360866] and IPs [192.168.39.71 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0729 14:31:04.724677 1033083 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0729 14:31:06.596801 1033083 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.87209194s)
I0729 14:31:06.596881 1033083 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0729 14:31:06.612255 1033083 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0729 14:31:06.622028 1033083 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0729 14:31:06.622049 1033083 kubeadm.go:157] found existing configuration files:
I0729 14:31:06.622091 1033083 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0729 14:31:06.631717 1033083 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0729 14:31:06.631784 1033083 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0729 14:31:06.642243 1033083 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0729 14:31:06.651613 1033083 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0729 14:31:06.651681 1033083 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0729 14:31:06.661173 1033083 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0729 14:31:06.670564 1033083 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0729 14:31:06.670619 1033083 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0729 14:31:06.679691 1033083 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0729 14:31:06.689706 1033083 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0729 14:31:06.689761 1033083 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0729 14:31:06.698739 1033083 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0729 14:31:06.766250 1033083 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0729 14:31:06.766334 1033083 kubeadm.go:310] [preflight] Running pre-flight checks
I0729 14:31:06.927966 1033083 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0729 14:31:06.928067 1033083 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0729 14:31:06.928198 1033083 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0729 14:31:07.112943 1033083 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0729 14:31:07.114783 1033083 out.go:204] - Generating certificates and keys ...
I0729 14:31:07.114894 1033083 kubeadm.go:310] [certs] Using existing ca certificate authority
I0729 14:31:07.114990 1033083 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0729 14:31:07.115097 1033083 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0729 14:31:07.115177 1033083 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0729 14:31:07.115276 1033083 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0729 14:31:07.115350 1033083 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0729 14:31:07.115676 1033083 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0729 14:31:07.116032 1033083 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0729 14:31:07.116473 1033083 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0729 14:31:07.116865 1033083 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0729 14:31:07.116904 1033083 kubeadm.go:310] [certs] Using the existing "sa" key
I0729 14:31:07.116985 1033083 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0729 14:31:07.316152 1033083 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0729 14:31:07.401859 1033083 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0729 14:31:07.552704 1033083 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0729 14:31:07.600641 1033083 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0729 14:31:07.617139 1033083 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0729 14:31:07.618488 1033083 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0729 14:31:07.618610 1033083 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0729 14:31:07.801023 1033083 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0729 14:31:07.802902 1033083 out.go:204] - Booting up control plane ...
I0729 14:31:07.803029 1033083 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0729 14:31:07.820035 1033083 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0729 14:31:07.821337 1033083 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0729 14:31:07.822102 1033083 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0729 14:31:07.824291 1033083 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0729 14:31:47.826055 1033083 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0729 14:31:47.826488 1033083 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 14:31:47.826705 1033083 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 14:31:52.827162 1033083 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 14:31:52.827378 1033083 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 14:32:02.827949 1033083 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 14:32:02.828177 1033083 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 14:32:22.829215 1033083 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 14:32:22.829445 1033083 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 14:33:02.829424 1033083 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0729 14:33:02.829626 1033083 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0729 14:33:02.829650 1033083 kubeadm.go:310]
I0729 14:33:02.829697 1033083 kubeadm.go:310] Unfortunately, an error has occurred:
I0729 14:33:02.829750 1033083 kubeadm.go:310] timed out waiting for the condition
I0729 14:33:02.829766 1033083 kubeadm.go:310]
I0729 14:33:02.829795 1033083 kubeadm.go:310] This error is likely caused by:
I0729 14:33:02.829845 1033083 kubeadm.go:310] - The kubelet is not running
I0729 14:33:02.829955 1033083 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0729 14:33:02.829971 1033083 kubeadm.go:310]
I0729 14:33:02.830079 1033083 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0729 14:33:02.830114 1033083 kubeadm.go:310] - 'systemctl status kubelet'
I0729 14:33:02.830143 1033083 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0729 14:33:02.830149 1033083 kubeadm.go:310]
I0729 14:33:02.830240 1033083 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0729 14:33:02.830327 1033083 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0729 14:33:02.830333 1033083 kubeadm.go:310]
I0729 14:33:02.830462 1033083 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0729 14:33:02.830537 1033083 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0729 14:33:02.830623 1033083 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0729 14:33:02.830722 1033083 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0729 14:33:02.830735 1033083 kubeadm.go:310]
I0729 14:33:02.831313 1033083 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0729 14:33:02.831420 1033083 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0729 14:33:02.831505 1033083 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0729 14:33:02.831592 1033083 kubeadm.go:394] duration metric: took 3m57.90970003s to StartCluster
I0729 14:33:02.831651 1033083 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0729 14:33:02.831722 1033083 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0729 14:33:02.869996 1033083 cri.go:89] found id: ""
I0729 14:33:02.870032 1033083 logs.go:276] 0 containers: []
W0729 14:33:02.870043 1033083 logs.go:278] No container was found matching "kube-apiserver"
I0729 14:33:02.870051 1033083 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0729 14:33:02.870134 1033083 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0729 14:33:02.903198 1033083 cri.go:89] found id: ""
I0729 14:33:02.903232 1033083 logs.go:276] 0 containers: []
W0729 14:33:02.903244 1033083 logs.go:278] No container was found matching "etcd"
I0729 14:33:02.903253 1033083 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0729 14:33:02.903325 1033083 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0729 14:33:02.934359 1033083 cri.go:89] found id: ""
I0729 14:33:02.934386 1033083 logs.go:276] 0 containers: []
W0729 14:33:02.934394 1033083 logs.go:278] No container was found matching "coredns"
I0729 14:33:02.934400 1033083 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0729 14:33:02.934463 1033083 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0729 14:33:02.968874 1033083 cri.go:89] found id: ""
I0729 14:33:02.968910 1033083 logs.go:276] 0 containers: []
W0729 14:33:02.968921 1033083 logs.go:278] No container was found matching "kube-scheduler"
I0729 14:33:02.968929 1033083 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0729 14:33:02.968999 1033083 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0729 14:33:02.999861 1033083 cri.go:89] found id: ""
I0729 14:33:02.999893 1033083 logs.go:276] 0 containers: []
W0729 14:33:02.999901 1033083 logs.go:278] No container was found matching "kube-proxy"
I0729 14:33:02.999907 1033083 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0729 14:33:02.999967 1033083 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0729 14:33:03.032951 1033083 cri.go:89] found id: ""
I0729 14:33:03.032981 1033083 logs.go:276] 0 containers: []
W0729 14:33:03.032989 1033083 logs.go:278] No container was found matching "kube-controller-manager"
I0729 14:33:03.032995 1033083 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0729 14:33:03.033043 1033083 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0729 14:33:03.066037 1033083 cri.go:89] found id: ""
I0729 14:33:03.066060 1033083 logs.go:276] 0 containers: []
W0729 14:33:03.066068 1033083 logs.go:278] No container was found matching "kindnet"
I0729 14:33:03.066079 1033083 logs.go:123] Gathering logs for kubelet ...
I0729 14:33:03.066097 1033083 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0729 14:33:03.116438 1033083 logs.go:123] Gathering logs for dmesg ...
I0729 14:33:03.116476 1033083 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0729 14:33:03.130142 1033083 logs.go:123] Gathering logs for describe nodes ...
I0729 14:33:03.130174 1033083 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0729 14:33:03.243204 1033083 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0729 14:33:03.243226 1033083 logs.go:123] Gathering logs for CRI-O ...
I0729 14:33:03.243241 1033083 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0729 14:33:03.337978 1033083 logs.go:123] Gathering logs for container status ...
I0729 14:33:03.338018 1033083 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0729 14:33:03.377862 1033083 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0729 14:33:03.377915 1033083 out.go:239] *
*
W0729 14:33:03.377989 1033083 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0729 14:33:03.378015 1033083 out.go:239] *
*
W0729 14:33:03.378868 1033083 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0729 14:33:03.382131 1033083 out.go:177]
W0729 14:33:03.383439 1033083 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0729 14:33:03.383497 1033083 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0729 14:33:03.383530 1033083 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0729 14:33:03.385042 1033083 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-360866 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-360866 -n old-k8s-version-360866
E0729 14:33:03.625283 982046 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19338-974764/.minikube/profiles/calico-513289/client.crt: no such file or directory
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-360866 -n old-k8s-version-360866: exit status 6 (229.445569ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0729 14:33:03.656225 1038817 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-360866" does not appear in /home/jenkins/minikube-integration/19338-974764/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-360866" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (272.45s)