=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-905554 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-905554 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m33.245428736s)
-- stdout --
* [old-k8s-version-905554] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=19008
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/19008-7755/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/19008-7755/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-905554" primary control-plane node in "old-k8s-version-905554" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0603 11:56:59.954096 67501 out.go:291] Setting OutFile to fd 1 ...
I0603 11:56:59.954231 67501 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0603 11:56:59.954242 67501 out.go:304] Setting ErrFile to fd 2...
I0603 11:56:59.954249 67501 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0603 11:56:59.954503 67501 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19008-7755/.minikube/bin
I0603 11:56:59.955232 67501 out.go:298] Setting JSON to false
I0603 11:56:59.956626 67501 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":5965,"bootTime":1717409855,"procs":298,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1060-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0603 11:56:59.956704 67501 start.go:139] virtualization: kvm guest
I0603 11:56:59.959087 67501 out.go:177] * [old-k8s-version-905554] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)
I0603 11:56:59.960889 67501 out.go:177] - MINIKUBE_LOCATION=19008
I0603 11:56:59.962159 67501 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0603 11:56:59.960942 67501 notify.go:220] Checking for updates...
I0603 11:56:59.964732 67501 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19008-7755/kubeconfig
I0603 11:56:59.966070 67501 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19008-7755/.minikube
I0603 11:56:59.967269 67501 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0603 11:56:59.968428 67501 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0603 11:56:59.970236 67501 config.go:182] Loaded profile config "bridge-034991": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0603 11:56:59.970340 67501 config.go:182] Loaded profile config "calico-034991": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0603 11:56:59.970420 67501 config.go:182] Loaded profile config "kubernetes-upgrade-179482": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.1
I0603 11:56:59.970520 67501 driver.go:392] Setting default libvirt URI to qemu:///system
I0603 11:57:00.018052 67501 out.go:177] * Using the kvm2 driver based on user configuration
I0603 11:57:00.019276 67501 start.go:297] selected driver: kvm2
I0603 11:57:00.019304 67501 start.go:901] validating driver "kvm2" against <nil>
I0603 11:57:00.019320 67501 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0603 11:57:00.020249 67501 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0603 11:57:00.020352 67501 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19008-7755/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0603 11:57:00.038824 67501 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1
I0603 11:57:00.038881 67501 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0603 11:57:00.039212 67501 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0603 11:57:00.039252 67501 cni.go:84] Creating CNI manager for ""
I0603 11:57:00.039264 67501 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0603 11:57:00.039274 67501 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0603 11:57:00.039344 67501 start.go:340] cluster config:
{Name:old-k8s-version-905554 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-905554 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0603 11:57:00.039474 67501 iso.go:125] acquiring lock: {Name:mkdc8e745fc6a0fd8e502f6ad2510510ae9abf27 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0603 11:57:00.041379 67501 out.go:177] * Starting "old-k8s-version-905554" primary control-plane node in "old-k8s-version-905554" cluster
I0603 11:57:00.043029 67501 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0603 11:57:00.043101 67501 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19008-7755/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0603 11:57:00.043110 67501 cache.go:56] Caching tarball of preloaded images
I0603 11:57:00.043191 67501 preload.go:173] Found /home/jenkins/minikube-integration/19008-7755/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0603 11:57:00.043199 67501 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0603 11:57:00.043298 67501 profile.go:143] Saving config to /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/config.json ...
I0603 11:57:00.043320 67501 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/config.json: {Name:mk53959f68545452763d1b73ef91e0947b64a6ab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 11:57:00.043447 67501 start.go:360] acquireMachinesLock for old-k8s-version-905554: {Name:mk7389fd163f37e28f7d4d842bab151f7e27bc7c Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0603 11:57:00.043488 67501 start.go:364] duration metric: took 21.579µs to acquireMachinesLock for "old-k8s-version-905554"
I0603 11:57:00.043503 67501 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-905554 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18934/minikube-v1.33.1-1716398070-18934-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-905554 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0603 11:57:00.043559 67501 start.go:125] createHost starting for "" (driver="kvm2")
I0603 11:57:00.045879 67501 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0603 11:57:00.046050 67501 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0603 11:57:00.046102 67501 main.go:141] libmachine: Launching plugin server for driver kvm2
I0603 11:57:00.064746 67501 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45861
I0603 11:57:00.065231 67501 main.go:141] libmachine: () Calling .GetVersion
I0603 11:57:00.065884 67501 main.go:141] libmachine: Using API Version 1
I0603 11:57:00.065911 67501 main.go:141] libmachine: () Calling .SetConfigRaw
I0603 11:57:00.066266 67501 main.go:141] libmachine: () Calling .GetMachineName
I0603 11:57:00.066472 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetMachineName
I0603 11:57:00.066654 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .DriverName
I0603 11:57:00.066901 67501 start.go:159] libmachine.API.Create for "old-k8s-version-905554" (driver="kvm2")
I0603 11:57:00.066927 67501 client.go:168] LocalClient.Create starting
I0603 11:57:00.066960 67501 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19008-7755/.minikube/certs/ca.pem
I0603 11:57:00.067005 67501 main.go:141] libmachine: Decoding PEM data...
I0603 11:57:00.067024 67501 main.go:141] libmachine: Parsing certificate...
I0603 11:57:00.067116 67501 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19008-7755/.minikube/certs/cert.pem
I0603 11:57:00.067148 67501 main.go:141] libmachine: Decoding PEM data...
I0603 11:57:00.067167 67501 main.go:141] libmachine: Parsing certificate...
I0603 11:57:00.067194 67501 main.go:141] libmachine: Running pre-create checks...
I0603 11:57:00.067206 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .PreCreateCheck
I0603 11:57:00.067647 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetConfigRaw
I0603 11:57:00.068172 67501 main.go:141] libmachine: Creating machine...
I0603 11:57:00.068190 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .Create
I0603 11:57:00.068748 67501 main.go:141] libmachine: (old-k8s-version-905554) Creating KVM machine...
I0603 11:57:00.069870 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found existing default KVM network
I0603 11:57:00.071931 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:00.071636 67523 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015920}
I0603 11:57:00.071950 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | created network xml:
I0603 11:57:00.071962 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | <network>
I0603 11:57:00.071971 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | <name>mk-old-k8s-version-905554</name>
I0603 11:57:00.071981 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | <dns enable='no'/>
I0603 11:57:00.071988 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG |
I0603 11:57:00.071996 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0603 11:57:00.072009 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | <dhcp>
I0603 11:57:00.072016 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0603 11:57:00.072023 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | </dhcp>
I0603 11:57:00.072035 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | </ip>
I0603 11:57:00.072042 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG |
I0603 11:57:00.072048 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | </network>
I0603 11:57:00.072057 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG |
I0603 11:57:00.076916 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | trying to create private KVM network mk-old-k8s-version-905554 192.168.39.0/24...
I0603 11:57:00.183767 67501 main.go:141] libmachine: (old-k8s-version-905554) Setting up store path in /home/jenkins/minikube-integration/19008-7755/.minikube/machines/old-k8s-version-905554 ...
I0603 11:57:00.183808 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | private KVM network mk-old-k8s-version-905554 192.168.39.0/24 created
I0603 11:57:00.183835 67501 main.go:141] libmachine: (old-k8s-version-905554) Building disk image from file:///home/jenkins/minikube-integration/19008-7755/.minikube/cache/iso/amd64/minikube-v1.33.1-1716398070-18934-amd64.iso
I0603 11:57:00.183848 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:00.182104 67523 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19008-7755/.minikube
I0603 11:57:00.183865 67501 main.go:141] libmachine: (old-k8s-version-905554) Downloading /home/jenkins/minikube-integration/19008-7755/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19008-7755/.minikube/cache/iso/amd64/minikube-v1.33.1-1716398070-18934-amd64.iso...
I0603 11:57:00.476438 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:00.476249 67523 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19008-7755/.minikube/machines/old-k8s-version-905554/id_rsa...
I0603 11:57:00.619353 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:00.619208 67523 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19008-7755/.minikube/machines/old-k8s-version-905554/old-k8s-version-905554.rawdisk...
I0603 11:57:00.619382 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | Writing magic tar header
I0603 11:57:00.619405 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | Writing SSH key tar header
I0603 11:57:00.619418 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:00.619371 67523 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19008-7755/.minikube/machines/old-k8s-version-905554 ...
I0603 11:57:00.619557 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19008-7755/.minikube/machines/old-k8s-version-905554
I0603 11:57:00.619594 67501 main.go:141] libmachine: (old-k8s-version-905554) Setting executable bit set on /home/jenkins/minikube-integration/19008-7755/.minikube/machines/old-k8s-version-905554 (perms=drwx------)
I0603 11:57:00.619606 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19008-7755/.minikube/machines
I0603 11:57:00.619624 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19008-7755/.minikube
I0603 11:57:00.619637 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19008-7755
I0603 11:57:00.619651 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0603 11:57:00.619659 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | Checking permissions on dir: /home/jenkins
I0603 11:57:00.619672 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | Checking permissions on dir: /home
I0603 11:57:00.619681 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | Skipping /home - not owner
I0603 11:57:00.619693 67501 main.go:141] libmachine: (old-k8s-version-905554) Setting executable bit set on /home/jenkins/minikube-integration/19008-7755/.minikube/machines (perms=drwxr-xr-x)
I0603 11:57:00.619704 67501 main.go:141] libmachine: (old-k8s-version-905554) Setting executable bit set on /home/jenkins/minikube-integration/19008-7755/.minikube (perms=drwxr-xr-x)
I0603 11:57:00.619720 67501 main.go:141] libmachine: (old-k8s-version-905554) Setting executable bit set on /home/jenkins/minikube-integration/19008-7755 (perms=drwxrwxr-x)
I0603 11:57:00.619730 67501 main.go:141] libmachine: (old-k8s-version-905554) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0603 11:57:00.619743 67501 main.go:141] libmachine: (old-k8s-version-905554) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0603 11:57:00.619751 67501 main.go:141] libmachine: (old-k8s-version-905554) Creating domain...
I0603 11:57:00.621020 67501 main.go:141] libmachine: (old-k8s-version-905554) define libvirt domain using xml:
I0603 11:57:00.621036 67501 main.go:141] libmachine: (old-k8s-version-905554) <domain type='kvm'>
I0603 11:57:00.621047 67501 main.go:141] libmachine: (old-k8s-version-905554) <name>old-k8s-version-905554</name>
I0603 11:57:00.621055 67501 main.go:141] libmachine: (old-k8s-version-905554) <memory unit='MiB'>2200</memory>
I0603 11:57:00.621064 67501 main.go:141] libmachine: (old-k8s-version-905554) <vcpu>2</vcpu>
I0603 11:57:00.621075 67501 main.go:141] libmachine: (old-k8s-version-905554) <features>
I0603 11:57:00.621083 67501 main.go:141] libmachine: (old-k8s-version-905554) <acpi/>
I0603 11:57:00.621090 67501 main.go:141] libmachine: (old-k8s-version-905554) <apic/>
I0603 11:57:00.621099 67501 main.go:141] libmachine: (old-k8s-version-905554) <pae/>
I0603 11:57:00.621118 67501 main.go:141] libmachine: (old-k8s-version-905554)
I0603 11:57:00.621139 67501 main.go:141] libmachine: (old-k8s-version-905554) </features>
I0603 11:57:00.621149 67501 main.go:141] libmachine: (old-k8s-version-905554) <cpu mode='host-passthrough'>
I0603 11:57:00.621156 67501 main.go:141] libmachine: (old-k8s-version-905554)
I0603 11:57:00.621162 67501 main.go:141] libmachine: (old-k8s-version-905554) </cpu>
I0603 11:57:00.621170 67501 main.go:141] libmachine: (old-k8s-version-905554) <os>
I0603 11:57:00.621178 67501 main.go:141] libmachine: (old-k8s-version-905554) <type>hvm</type>
I0603 11:57:00.621190 67501 main.go:141] libmachine: (old-k8s-version-905554) <boot dev='cdrom'/>
I0603 11:57:00.621200 67501 main.go:141] libmachine: (old-k8s-version-905554) <boot dev='hd'/>
I0603 11:57:00.621210 67501 main.go:141] libmachine: (old-k8s-version-905554) <bootmenu enable='no'/>
I0603 11:57:00.621219 67501 main.go:141] libmachine: (old-k8s-version-905554) </os>
I0603 11:57:00.621228 67501 main.go:141] libmachine: (old-k8s-version-905554) <devices>
I0603 11:57:00.621239 67501 main.go:141] libmachine: (old-k8s-version-905554) <disk type='file' device='cdrom'>
I0603 11:57:00.621257 67501 main.go:141] libmachine: (old-k8s-version-905554) <source file='/home/jenkins/minikube-integration/19008-7755/.minikube/machines/old-k8s-version-905554/boot2docker.iso'/>
I0603 11:57:00.621269 67501 main.go:141] libmachine: (old-k8s-version-905554) <target dev='hdc' bus='scsi'/>
I0603 11:57:00.621281 67501 main.go:141] libmachine: (old-k8s-version-905554) <readonly/>
I0603 11:57:00.621296 67501 main.go:141] libmachine: (old-k8s-version-905554) </disk>
I0603 11:57:00.621309 67501 main.go:141] libmachine: (old-k8s-version-905554) <disk type='file' device='disk'>
I0603 11:57:00.621322 67501 main.go:141] libmachine: (old-k8s-version-905554) <driver name='qemu' type='raw' cache='default' io='threads' />
I0603 11:57:00.621336 67501 main.go:141] libmachine: (old-k8s-version-905554) <source file='/home/jenkins/minikube-integration/19008-7755/.minikube/machines/old-k8s-version-905554/old-k8s-version-905554.rawdisk'/>
I0603 11:57:00.621344 67501 main.go:141] libmachine: (old-k8s-version-905554) <target dev='hda' bus='virtio'/>
I0603 11:57:00.621353 67501 main.go:141] libmachine: (old-k8s-version-905554) </disk>
I0603 11:57:00.621367 67501 main.go:141] libmachine: (old-k8s-version-905554) <interface type='network'>
I0603 11:57:00.621380 67501 main.go:141] libmachine: (old-k8s-version-905554) <source network='mk-old-k8s-version-905554'/>
I0603 11:57:00.621391 67501 main.go:141] libmachine: (old-k8s-version-905554) <model type='virtio'/>
I0603 11:57:00.621402 67501 main.go:141] libmachine: (old-k8s-version-905554) </interface>
I0603 11:57:00.621410 67501 main.go:141] libmachine: (old-k8s-version-905554) <interface type='network'>
I0603 11:57:00.621419 67501 main.go:141] libmachine: (old-k8s-version-905554) <source network='default'/>
I0603 11:57:00.621429 67501 main.go:141] libmachine: (old-k8s-version-905554) <model type='virtio'/>
I0603 11:57:00.621441 67501 main.go:141] libmachine: (old-k8s-version-905554) </interface>
I0603 11:57:00.621450 67501 main.go:141] libmachine: (old-k8s-version-905554) <serial type='pty'>
I0603 11:57:00.621463 67501 main.go:141] libmachine: (old-k8s-version-905554) <target port='0'/>
I0603 11:57:00.621473 67501 main.go:141] libmachine: (old-k8s-version-905554) </serial>
I0603 11:57:00.621485 67501 main.go:141] libmachine: (old-k8s-version-905554) <console type='pty'>
I0603 11:57:00.621493 67501 main.go:141] libmachine: (old-k8s-version-905554) <target type='serial' port='0'/>
I0603 11:57:00.621501 67501 main.go:141] libmachine: (old-k8s-version-905554) </console>
I0603 11:57:00.621509 67501 main.go:141] libmachine: (old-k8s-version-905554) <rng model='virtio'>
I0603 11:57:00.621525 67501 main.go:141] libmachine: (old-k8s-version-905554) <backend model='random'>/dev/random</backend>
I0603 11:57:00.621535 67501 main.go:141] libmachine: (old-k8s-version-905554) </rng>
I0603 11:57:00.621544 67501 main.go:141] libmachine: (old-k8s-version-905554)
I0603 11:57:00.621553 67501 main.go:141] libmachine: (old-k8s-version-905554)
I0603 11:57:00.621562 67501 main.go:141] libmachine: (old-k8s-version-905554) </devices>
I0603 11:57:00.621572 67501 main.go:141] libmachine: (old-k8s-version-905554) </domain>
I0603 11:57:00.621582 67501 main.go:141] libmachine: (old-k8s-version-905554)
I0603 11:57:00.626445 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:56:c2:3d in network default
I0603 11:57:00.627310 67501 main.go:141] libmachine: (old-k8s-version-905554) Ensuring networks are active...
I0603 11:57:00.627333 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:00.628331 67501 main.go:141] libmachine: (old-k8s-version-905554) Ensuring network default is active
I0603 11:57:00.628780 67501 main.go:141] libmachine: (old-k8s-version-905554) Ensuring network mk-old-k8s-version-905554 is active
I0603 11:57:00.629459 67501 main.go:141] libmachine: (old-k8s-version-905554) Getting domain xml...
I0603 11:57:00.630489 67501 main.go:141] libmachine: (old-k8s-version-905554) Creating domain...
I0603 11:57:02.202982 67501 main.go:141] libmachine: (old-k8s-version-905554) Waiting to get IP...
I0603 11:57:02.204116 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:02.204877 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | unable to find current IP address of domain old-k8s-version-905554 in network mk-old-k8s-version-905554
I0603 11:57:02.205060 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:02.204976 67523 retry.go:31] will retry after 222.199907ms: waiting for machine to come up
I0603 11:57:02.428791 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:02.429461 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | unable to find current IP address of domain old-k8s-version-905554 in network mk-old-k8s-version-905554
I0603 11:57:02.429490 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:02.429419 67523 retry.go:31] will retry after 327.649197ms: waiting for machine to come up
I0603 11:57:02.759133 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:02.759765 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | unable to find current IP address of domain old-k8s-version-905554 in network mk-old-k8s-version-905554
I0603 11:57:02.759794 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:02.759718 67523 retry.go:31] will retry after 314.31801ms: waiting for machine to come up
I0603 11:57:03.075988 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:03.076794 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | unable to find current IP address of domain old-k8s-version-905554 in network mk-old-k8s-version-905554
I0603 11:57:03.076825 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:03.076751 67523 retry.go:31] will retry after 471.996565ms: waiting for machine to come up
I0603 11:57:03.550773 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:03.551407 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | unable to find current IP address of domain old-k8s-version-905554 in network mk-old-k8s-version-905554
I0603 11:57:03.551429 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:03.551338 67523 retry.go:31] will retry after 743.277114ms: waiting for machine to come up
I0603 11:57:04.296512 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:04.297221 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | unable to find current IP address of domain old-k8s-version-905554 in network mk-old-k8s-version-905554
I0603 11:57:04.297246 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:04.297157 67523 retry.go:31] will retry after 787.192028ms: waiting for machine to come up
I0603 11:57:05.086344 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:05.086926 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | unable to find current IP address of domain old-k8s-version-905554 in network mk-old-k8s-version-905554
I0603 11:57:05.086968 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:05.086872 67523 retry.go:31] will retry after 786.846254ms: waiting for machine to come up
I0603 11:57:05.875276 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:05.875982 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | unable to find current IP address of domain old-k8s-version-905554 in network mk-old-k8s-version-905554
I0603 11:57:05.876010 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:05.875896 67523 retry.go:31] will retry after 1.13439787s: waiting for machine to come up
I0603 11:57:07.012396 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:07.012888 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | unable to find current IP address of domain old-k8s-version-905554 in network mk-old-k8s-version-905554
I0603 11:57:07.012903 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:07.012822 67523 retry.go:31] will retry after 1.707289997s: waiting for machine to come up
I0603 11:57:08.722042 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:08.722572 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | unable to find current IP address of domain old-k8s-version-905554 in network mk-old-k8s-version-905554
I0603 11:57:08.722608 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:08.722524 67523 retry.go:31] will retry after 2.284609183s: waiting for machine to come up
I0603 11:57:11.009444 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:11.010060 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | unable to find current IP address of domain old-k8s-version-905554 in network mk-old-k8s-version-905554
I0603 11:57:11.010099 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:11.010043 67523 retry.go:31] will retry after 1.936109259s: waiting for machine to come up
I0603 11:57:12.948408 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:12.949049 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | unable to find current IP address of domain old-k8s-version-905554 in network mk-old-k8s-version-905554
I0603 11:57:12.949084 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:12.948992 67523 retry.go:31] will retry after 2.945231897s: waiting for machine to come up
I0603 11:57:15.895527 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:15.896038 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | unable to find current IP address of domain old-k8s-version-905554 in network mk-old-k8s-version-905554
I0603 11:57:15.896068 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:15.895992 67523 retry.go:31] will retry after 4.36932539s: waiting for machine to come up
I0603 11:57:20.267069 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:20.267541 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | unable to find current IP address of domain old-k8s-version-905554 in network mk-old-k8s-version-905554
I0603 11:57:20.267566 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | I0603 11:57:20.267500 67523 retry.go:31] will retry after 3.920481877s: waiting for machine to come up
I0603 11:57:24.192086 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:24.192596 67501 main.go:141] libmachine: (old-k8s-version-905554) Found IP for machine: 192.168.39.155
I0603 11:57:24.192616 67501 main.go:141] libmachine: (old-k8s-version-905554) Reserving static IP address...
I0603 11:57:24.192632 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has current primary IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:24.193033 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-905554", mac: "52:54:00:3d:ed:07", ip: "192.168.39.155"} in network mk-old-k8s-version-905554
I0603 11:57:24.270776 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | Getting to WaitForSSH function...
I0603 11:57:24.270806 67501 main.go:141] libmachine: (old-k8s-version-905554) Reserved static IP address: 192.168.39.155
I0603 11:57:24.270818 67501 main.go:141] libmachine: (old-k8s-version-905554) Waiting for SSH to be available...
I0603 11:57:24.273603 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:24.274042 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:minikube Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:24.274074 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:24.274249 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | Using SSH client type: external
I0603 11:57:24.274277 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | Using SSH private key: /home/jenkins/minikube-integration/19008-7755/.minikube/machines/old-k8s-version-905554/id_rsa (-rw-------)
I0603 11:57:24.274310 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.155 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19008-7755/.minikube/machines/old-k8s-version-905554/id_rsa -p 22] /usr/bin/ssh <nil>}
I0603 11:57:24.274336 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | About to run SSH command:
I0603 11:57:24.274375 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | exit 0
I0603 11:57:24.399423 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | SSH cmd err, output: <nil>:
I0603 11:57:24.399574 67501 main.go:141] libmachine: (old-k8s-version-905554) KVM machine creation complete!
I0603 11:57:24.399937 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetConfigRaw
I0603 11:57:24.400492 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .DriverName
I0603 11:57:24.400695 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .DriverName
I0603 11:57:24.400878 67501 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0603 11:57:24.400893 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetState
I0603 11:57:24.402436 67501 main.go:141] libmachine: Detecting operating system of created instance...
I0603 11:57:24.402451 67501 main.go:141] libmachine: Waiting for SSH to be available...
I0603 11:57:24.402459 67501 main.go:141] libmachine: Getting to WaitForSSH function...
I0603 11:57:24.402468 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHHostname
I0603 11:57:24.405519 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:24.405980 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:old-k8s-version-905554 Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:24.406006 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:24.406206 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHPort
I0603 11:57:24.406382 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHKeyPath
I0603 11:57:24.406529 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHKeyPath
I0603 11:57:24.406698 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHUsername
I0603 11:57:24.406886 67501 main.go:141] libmachine: Using SSH client type: native
I0603 11:57:24.407129 67501 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.39.155 22 <nil> <nil>}
I0603 11:57:24.407146 67501 main.go:141] libmachine: About to run SSH command:
exit 0
I0603 11:57:24.518560 67501 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0603 11:57:24.518603 67501 main.go:141] libmachine: Detecting the provisioner...
I0603 11:57:24.518615 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHHostname
I0603 11:57:24.521524 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:24.521948 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:old-k8s-version-905554 Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:24.521977 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:24.522167 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHPort
I0603 11:57:24.522378 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHKeyPath
I0603 11:57:24.522560 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHKeyPath
I0603 11:57:24.522744 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHUsername
I0603 11:57:24.522935 67501 main.go:141] libmachine: Using SSH client type: native
I0603 11:57:24.523146 67501 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.39.155 22 <nil> <nil>}
I0603 11:57:24.523159 67501 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0603 11:57:24.627926 67501 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0603 11:57:24.628017 67501 main.go:141] libmachine: found compatible host: buildroot
I0603 11:57:24.628032 67501 main.go:141] libmachine: Provisioning with buildroot...
I0603 11:57:24.628048 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetMachineName
I0603 11:57:24.628306 67501 buildroot.go:166] provisioning hostname "old-k8s-version-905554"
I0603 11:57:24.628350 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetMachineName
I0603 11:57:24.628566 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHHostname
I0603 11:57:24.631768 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:24.632137 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:old-k8s-version-905554 Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:24.632186 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:24.632384 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHPort
I0603 11:57:24.632604 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHKeyPath
I0603 11:57:24.632758 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHKeyPath
I0603 11:57:24.632919 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHUsername
I0603 11:57:24.633094 67501 main.go:141] libmachine: Using SSH client type: native
I0603 11:57:24.633330 67501 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.39.155 22 <nil> <nil>}
I0603 11:57:24.633355 67501 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-905554 && echo "old-k8s-version-905554" | sudo tee /etc/hostname
I0603 11:57:24.774975 67501 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-905554
I0603 11:57:24.775000 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHHostname
I0603 11:57:24.777855 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:24.778303 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:old-k8s-version-905554 Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:24.778340 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:24.778536 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHPort
I0603 11:57:24.778725 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHKeyPath
I0603 11:57:24.778897 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHKeyPath
I0603 11:57:24.779056 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHUsername
I0603 11:57:24.779268 67501 main.go:141] libmachine: Using SSH client type: native
I0603 11:57:24.779430 67501 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.39.155 22 <nil> <nil>}
I0603 11:57:24.779447 67501 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-905554' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-905554/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-905554' | sudo tee -a /etc/hosts;
fi
fi
I0603 11:57:24.901766 67501 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0603 11:57:24.901799 67501 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19008-7755/.minikube CaCertPath:/home/jenkins/minikube-integration/19008-7755/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19008-7755/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19008-7755/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19008-7755/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19008-7755/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19008-7755/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19008-7755/.minikube}
I0603 11:57:24.901887 67501 buildroot.go:174] setting up certificates
I0603 11:57:24.901900 67501 provision.go:84] configureAuth start
I0603 11:57:24.901917 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetMachineName
I0603 11:57:24.902242 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetIP
I0603 11:57:24.905252 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:24.905815 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:old-k8s-version-905554 Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:24.905845 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:24.905989 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHHostname
I0603 11:57:24.908639 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:24.908997 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:old-k8s-version-905554 Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:24.909022 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:24.909207 67501 provision.go:143] copyHostCerts
I0603 11:57:24.909273 67501 exec_runner.go:144] found /home/jenkins/minikube-integration/19008-7755/.minikube/ca.pem, removing ...
I0603 11:57:24.909290 67501 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19008-7755/.minikube/ca.pem
I0603 11:57:24.909352 67501 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19008-7755/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19008-7755/.minikube/ca.pem (1082 bytes)
I0603 11:57:24.909445 67501 exec_runner.go:144] found /home/jenkins/minikube-integration/19008-7755/.minikube/cert.pem, removing ...
I0603 11:57:24.909454 67501 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19008-7755/.minikube/cert.pem
I0603 11:57:24.909476 67501 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19008-7755/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19008-7755/.minikube/cert.pem (1123 bytes)
I0603 11:57:24.909540 67501 exec_runner.go:144] found /home/jenkins/minikube-integration/19008-7755/.minikube/key.pem, removing ...
I0603 11:57:24.909547 67501 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19008-7755/.minikube/key.pem
I0603 11:57:24.909589 67501 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19008-7755/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19008-7755/.minikube/key.pem (1679 bytes)
I0603 11:57:24.909686 67501 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19008-7755/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19008-7755/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19008-7755/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-905554 san=[127.0.0.1 192.168.39.155 localhost minikube old-k8s-version-905554]
I0603 11:57:25.004055 67501 provision.go:177] copyRemoteCerts
I0603 11:57:25.004105 67501 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0603 11:57:25.004129 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHHostname
I0603 11:57:25.332900 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:25.333450 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:old-k8s-version-905554 Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:25.333482 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:25.333750 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHPort
I0603 11:57:25.333977 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHKeyPath
I0603 11:57:25.334232 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHUsername
I0603 11:57:25.334438 67501 sshutil.go:53] new ssh client: &{IP:192.168.39.155 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19008-7755/.minikube/machines/old-k8s-version-905554/id_rsa Username:docker}
I0603 11:57:25.426155 67501 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19008-7755/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0603 11:57:25.451975 67501 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19008-7755/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0603 11:57:25.476391 67501 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19008-7755/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0603 11:57:25.503284 67501 provision.go:87] duration metric: took 601.369285ms to configureAuth
I0603 11:57:25.503319 67501 buildroot.go:189] setting minikube options for container-runtime
I0603 11:57:25.503492 67501 config.go:182] Loaded profile config "old-k8s-version-905554": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0603 11:57:25.503556 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHHostname
I0603 11:57:25.506452 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:25.506883 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:old-k8s-version-905554 Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:25.506917 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:25.507213 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHPort
I0603 11:57:25.507424 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHKeyPath
I0603 11:57:25.507674 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHKeyPath
I0603 11:57:25.507881 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHUsername
I0603 11:57:25.508102 67501 main.go:141] libmachine: Using SSH client type: native
I0603 11:57:25.508332 67501 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.39.155 22 <nil> <nil>}
I0603 11:57:25.508351 67501 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0603 11:57:25.823108 67501 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0603 11:57:25.823144 67501 main.go:141] libmachine: Checking connection to Docker...
I0603 11:57:25.823155 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetURL
I0603 11:57:25.824751 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | Using libvirt version 6000000
I0603 11:57:25.827773 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:25.828178 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:old-k8s-version-905554 Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:25.828211 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:25.828370 67501 main.go:141] libmachine: Docker is up and running!
I0603 11:57:25.828385 67501 main.go:141] libmachine: Reticulating splines...
I0603 11:57:25.828394 67501 client.go:171] duration metric: took 25.761458329s to LocalClient.Create
I0603 11:57:25.828421 67501 start.go:167] duration metric: took 25.761520113s to libmachine.API.Create "old-k8s-version-905554"
I0603 11:57:25.828444 67501 start.go:293] postStartSetup for "old-k8s-version-905554" (driver="kvm2")
I0603 11:57:25.828469 67501 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0603 11:57:25.828492 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .DriverName
I0603 11:57:25.828829 67501 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0603 11:57:25.828895 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHHostname
I0603 11:57:25.831492 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:25.831922 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:old-k8s-version-905554 Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:25.831952 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:25.832162 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHPort
I0603 11:57:25.832352 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHKeyPath
I0603 11:57:25.832541 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHUsername
I0603 11:57:25.832694 67501 sshutil.go:53] new ssh client: &{IP:192.168.39.155 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19008-7755/.minikube/machines/old-k8s-version-905554/id_rsa Username:docker}
I0603 11:57:25.921680 67501 ssh_runner.go:195] Run: cat /etc/os-release
I0603 11:57:25.927265 67501 info.go:137] Remote host: Buildroot 2023.02.9
I0603 11:57:25.927288 67501 filesync.go:126] Scanning /home/jenkins/minikube-integration/19008-7755/.minikube/addons for local assets ...
I0603 11:57:25.927357 67501 filesync.go:126] Scanning /home/jenkins/minikube-integration/19008-7755/.minikube/files for local assets ...
I0603 11:57:25.927449 67501 filesync.go:149] local asset: /home/jenkins/minikube-integration/19008-7755/.minikube/files/etc/ssl/certs/150282.pem -> 150282.pem in /etc/ssl/certs
I0603 11:57:25.927573 67501 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0603 11:57:25.937300 67501 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19008-7755/.minikube/files/etc/ssl/certs/150282.pem --> /etc/ssl/certs/150282.pem (1708 bytes)
I0603 11:57:25.969058 67501 start.go:296] duration metric: took 140.597298ms for postStartSetup
I0603 11:57:25.969107 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetConfigRaw
I0603 11:57:25.969694 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetIP
I0603 11:57:25.972689 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:25.973047 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:old-k8s-version-905554 Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:25.973089 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:25.973404 67501 profile.go:143] Saving config to /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/config.json ...
I0603 11:57:25.973614 67501 start.go:128] duration metric: took 25.930045279s to createHost
I0603 11:57:25.973641 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHHostname
I0603 11:57:25.975966 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:25.976307 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:old-k8s-version-905554 Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:25.976334 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:25.976485 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHPort
I0603 11:57:25.976666 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHKeyPath
I0603 11:57:25.976832 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHKeyPath
I0603 11:57:25.976980 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHUsername
I0603 11:57:25.977152 67501 main.go:141] libmachine: Using SSH client type: native
I0603 11:57:25.977366 67501 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d800] 0x830560 <nil> [] 0s} 192.168.39.155 22 <nil> <nil>}
I0603 11:57:25.977392 67501 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0603 11:57:26.087958 67501 main.go:141] libmachine: SSH cmd err, output: <nil>: 1717415846.063980045
I0603 11:57:26.087992 67501 fix.go:216] guest clock: 1717415846.063980045
I0603 11:57:26.088001 67501 fix.go:229] Guest: 2024-06-03 11:57:26.063980045 +0000 UTC Remote: 2024-06-03 11:57:25.973627636 +0000 UTC m=+26.059353297 (delta=90.352409ms)
I0603 11:57:26.088024 67501 fix.go:200] guest clock delta is within tolerance: 90.352409ms
I0603 11:57:26.088031 67501 start.go:83] releasing machines lock for "old-k8s-version-905554", held for 26.044535634s
I0603 11:57:26.088061 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .DriverName
I0603 11:57:26.088309 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetIP
I0603 11:57:26.091294 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:26.091789 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:old-k8s-version-905554 Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:26.091814 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:26.092041 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .DriverName
I0603 11:57:26.092538 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .DriverName
I0603 11:57:26.092738 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .DriverName
I0603 11:57:26.092880 67501 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0603 11:57:26.092944 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHHostname
I0603 11:57:26.092949 67501 ssh_runner.go:195] Run: cat /version.json
I0603 11:57:26.092982 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHHostname
I0603 11:57:26.095755 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:26.096149 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:old-k8s-version-905554 Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:26.096170 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:26.096195 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:26.096354 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHPort
I0603 11:57:26.096556 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHKeyPath
I0603 11:57:26.096613 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:old-k8s-version-905554 Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:26.096649 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:26.096749 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHUsername
I0603 11:57:26.096827 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHPort
I0603 11:57:26.096898 67501 sshutil.go:53] new ssh client: &{IP:192.168.39.155 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19008-7755/.minikube/machines/old-k8s-version-905554/id_rsa Username:docker}
I0603 11:57:26.097019 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHKeyPath
I0603 11:57:26.097209 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetSSHUsername
I0603 11:57:26.097381 67501 sshutil.go:53] new ssh client: &{IP:192.168.39.155 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19008-7755/.minikube/machines/old-k8s-version-905554/id_rsa Username:docker}
I0603 11:57:26.184068 67501 ssh_runner.go:195] Run: systemctl --version
I0603 11:57:26.212346 67501 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0603 11:57:26.379823 67501 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0603 11:57:26.388393 67501 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0603 11:57:26.388464 67501 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0603 11:57:26.409856 67501 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0603 11:57:26.409883 67501 start.go:494] detecting cgroup driver to use...
I0603 11:57:26.409943 67501 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0603 11:57:26.430556 67501 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0603 11:57:26.450463 67501 docker.go:217] disabling cri-docker service (if available) ...
I0603 11:57:26.450522 67501 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0603 11:57:26.469657 67501 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0603 11:57:26.485661 67501 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0603 11:57:26.616441 67501 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0603 11:57:26.796006 67501 docker.go:233] disabling docker service ...
I0603 11:57:26.796077 67501 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0603 11:57:26.813068 67501 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0603 11:57:26.827998 67501 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0603 11:57:26.997481 67501 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0603 11:57:27.143507 67501 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0603 11:57:27.158438 67501 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0603 11:57:27.181400 67501 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0603 11:57:27.181471 67501 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0603 11:57:27.192656 67501 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0603 11:57:27.192721 67501 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0603 11:57:27.204311 67501 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0603 11:57:27.220042 67501 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0603 11:57:27.232270 67501 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0603 11:57:27.245596 67501 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0603 11:57:27.258475 67501 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0603 11:57:27.258527 67501 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0603 11:57:27.276714 67501 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0603 11:57:27.288448 67501 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0603 11:57:27.446486 67501 ssh_runner.go:195] Run: sudo systemctl restart crio
I0603 11:57:27.601235 67501 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0603 11:57:27.601312 67501 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0603 11:57:27.606223 67501 start.go:562] Will wait 60s for crictl version
I0603 11:57:27.606293 67501 ssh_runner.go:195] Run: which crictl
I0603 11:57:27.610252 67501 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0603 11:57:27.649362 67501 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0603 11:57:27.649427 67501 ssh_runner.go:195] Run: crio --version
I0603 11:57:27.688735 67501 ssh_runner.go:195] Run: crio --version
I0603 11:57:27.732683 67501 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0603 11:57:27.734059 67501 main.go:141] libmachine: (old-k8s-version-905554) Calling .GetIP
I0603 11:57:27.737630 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:27.738026 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3d:ed:07", ip: ""} in network mk-old-k8s-version-905554: {Iface:virbr1 ExpiryTime:2024-06-03 12:57:16 +0000 UTC Type:0 Mac:52:54:00:3d:ed:07 Iaid: IPaddr:192.168.39.155 Prefix:24 Hostname:old-k8s-version-905554 Clientid:01:52:54:00:3d:ed:07}
I0603 11:57:27.738054 67501 main.go:141] libmachine: (old-k8s-version-905554) DBG | domain old-k8s-version-905554 has defined IP address 192.168.39.155 and MAC address 52:54:00:3d:ed:07 in network mk-old-k8s-version-905554
I0603 11:57:27.738265 67501 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0603 11:57:27.742774 67501 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0603 11:57:27.755517 67501 kubeadm.go:877] updating cluster {Name:old-k8s-version-905554 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18934/minikube-v1.33.1-1716398070-18934-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-905554 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.155 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0603 11:57:27.755658 67501 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0603 11:57:27.755718 67501 ssh_runner.go:195] Run: sudo crictl images --output json
I0603 11:57:27.791869 67501 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0603 11:57:27.791940 67501 ssh_runner.go:195] Run: which lz4
I0603 11:57:27.797230 67501 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0603 11:57:27.802601 67501 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0603 11:57:27.802626 67501 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19008-7755/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0603 11:57:29.542981 67501 crio.go:462] duration metric: took 1.745786404s to copy over tarball
I0603 11:57:29.543113 67501 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0603 11:57:32.393830 67501 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.850680448s)
I0603 11:57:32.393861 67501 crio.go:469] duration metric: took 2.85084713s to extract the tarball
I0603 11:57:32.393905 67501 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0603 11:57:32.441839 67501 ssh_runner.go:195] Run: sudo crictl images --output json
I0603 11:57:32.500290 67501 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0603 11:57:32.500315 67501 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0603 11:57:32.500366 67501 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0603 11:57:32.500470 67501 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0603 11:57:32.500488 67501 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0603 11:57:32.500544 67501 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0603 11:57:32.500687 67501 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0603 11:57:32.500707 67501 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0603 11:57:32.500730 67501 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0603 11:57:32.500917 67501 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0603 11:57:32.503186 67501 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0603 11:57:32.503352 67501 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0603 11:57:32.504120 67501 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0603 11:57:32.504331 67501 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0603 11:57:32.504430 67501 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0603 11:57:32.504507 67501 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0603 11:57:32.505241 67501 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0603 11:57:32.505379 67501 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0603 11:57:32.645323 67501 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0603 11:57:32.659429 67501 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0603 11:57:32.662189 67501 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0603 11:57:32.673343 67501 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0603 11:57:32.675103 67501 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0603 11:57:32.700734 67501 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0603 11:57:32.735970 67501 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0603 11:57:32.749473 67501 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0603 11:57:32.749537 67501 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0603 11:57:32.749586 67501 ssh_runner.go:195] Run: which crictl
I0603 11:57:32.799091 67501 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0603 11:57:32.799138 67501 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0603 11:57:32.799186 67501 ssh_runner.go:195] Run: which crictl
I0603 11:57:32.831542 67501 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0603 11:57:32.831594 67501 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0603 11:57:32.831644 67501 ssh_runner.go:195] Run: which crictl
I0603 11:57:32.849381 67501 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0603 11:57:32.849423 67501 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0603 11:57:32.849472 67501 ssh_runner.go:195] Run: which crictl
I0603 11:57:32.849646 67501 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0603 11:57:32.849688 67501 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0603 11:57:32.849729 67501 ssh_runner.go:195] Run: which crictl
I0603 11:57:32.894657 67501 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0603 11:57:32.894696 67501 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0603 11:57:32.894731 67501 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0603 11:57:32.894750 67501 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0603 11:57:32.894767 67501 ssh_runner.go:195] Run: which crictl
I0603 11:57:32.894769 67501 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0603 11:57:32.894704 67501 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0603 11:57:32.894829 67501 ssh_runner.go:195] Run: which crictl
I0603 11:57:32.894846 67501 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0603 11:57:32.894857 67501 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0603 11:57:32.894789 67501 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0603 11:57:33.010527 67501 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19008-7755/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0603 11:57:33.013112 67501 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0603 11:57:33.013169 67501 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19008-7755/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0603 11:57:33.013237 67501 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19008-7755/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0603 11:57:33.013243 67501 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0603 11:57:33.013334 67501 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19008-7755/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0603 11:57:33.013352 67501 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19008-7755/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0603 11:57:33.054524 67501 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19008-7755/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0603 11:57:33.065005 67501 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/19008-7755/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0603 11:57:33.400851 67501 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0603 11:57:33.543154 67501 cache_images.go:92] duration metric: took 1.042825431s to LoadCachedImages
W0603 11:57:33.543247 67501 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/19008-7755/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/19008-7755/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I0603 11:57:33.543265 67501 kubeadm.go:928] updating node { 192.168.39.155 8443 v1.20.0 crio true true} ...
I0603 11:57:33.543393 67501 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-905554 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.155
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-905554 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0603 11:57:33.543481 67501 ssh_runner.go:195] Run: crio config
I0603 11:57:33.601534 67501 cni.go:84] Creating CNI manager for ""
I0603 11:57:33.601556 67501 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0603 11:57:33.601567 67501 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0603 11:57:33.601591 67501 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.155 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-905554 NodeName:old-k8s-version-905554 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.155"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.155 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0603 11:57:33.601741 67501 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.155
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-905554"
kubeletExtraArgs:
node-ip: 192.168.39.155
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.155"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0603 11:57:33.601794 67501 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0603 11:57:33.612419 67501 binaries.go:44] Found k8s binaries, skipping transfer
I0603 11:57:33.612490 67501 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0603 11:57:33.622435 67501 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0603 11:57:33.642463 67501 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0603 11:57:33.660971 67501 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0603 11:57:33.679459 67501 ssh_runner.go:195] Run: grep 192.168.39.155 control-plane.minikube.internal$ /etc/hosts
I0603 11:57:33.683886 67501 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.155 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0603 11:57:33.700083 67501 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0603 11:57:33.839966 67501 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0603 11:57:33.861758 67501 certs.go:68] Setting up /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554 for IP: 192.168.39.155
I0603 11:57:33.861788 67501 certs.go:194] generating shared ca certs ...
I0603 11:57:33.861809 67501 certs.go:226] acquiring lock for ca certs: {Name:mk50092df3bdecbf959926adc377ee06b75aacd9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 11:57:33.861995 67501 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19008-7755/.minikube/ca.key
I0603 11:57:33.862046 67501 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19008-7755/.minikube/proxy-client-ca.key
I0603 11:57:33.862057 67501 certs.go:256] generating profile certs ...
I0603 11:57:33.862118 67501 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/client.key
I0603 11:57:33.862137 67501 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/client.crt with IP's: []
I0603 11:57:34.083356 67501 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/client.crt ...
I0603 11:57:34.083382 67501 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/client.crt: {Name:mked7dcab8cc451284b6aab86d8d13a79c65f950 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 11:57:34.083535 67501 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/client.key ...
I0603 11:57:34.083549 67501 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/client.key: {Name:mk5fe553d0b7d97cfc1882e5e8116cbc37d4c94b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 11:57:34.083626 67501 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/apiserver.key.0d34b22c
I0603 11:57:34.083642 67501 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/apiserver.crt.0d34b22c with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.155]
I0603 11:57:34.233246 67501 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/apiserver.crt.0d34b22c ...
I0603 11:57:34.233270 67501 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/apiserver.crt.0d34b22c: {Name:mk93236c85c699afbd41e7bf78859b8df1c89639 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 11:57:34.233425 67501 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/apiserver.key.0d34b22c ...
I0603 11:57:34.233441 67501 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/apiserver.key.0d34b22c: {Name:mk18935e0d628c67cc68a882622267d954dd3587 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 11:57:34.233539 67501 certs.go:381] copying /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/apiserver.crt.0d34b22c -> /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/apiserver.crt
I0603 11:57:34.233632 67501 certs.go:385] copying /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/apiserver.key.0d34b22c -> /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/apiserver.key
I0603 11:57:34.233690 67501 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/proxy-client.key
I0603 11:57:34.233703 67501 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/proxy-client.crt with IP's: []
I0603 11:57:34.352144 67501 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/proxy-client.crt ...
I0603 11:57:34.352170 67501 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/proxy-client.crt: {Name:mk0a796d633a749c9ea20aed46e97bae303cdb56 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 11:57:34.352325 67501 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/proxy-client.key ...
I0603 11:57:34.352342 67501 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/proxy-client.key: {Name:mka2f28b78615c030e22fe112371868b3cdd54ea Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 11:57:34.352505 67501 certs.go:484] found cert: /home/jenkins/minikube-integration/19008-7755/.minikube/certs/15028.pem (1338 bytes)
W0603 11:57:34.352539 67501 certs.go:480] ignoring /home/jenkins/minikube-integration/19008-7755/.minikube/certs/15028_empty.pem, impossibly tiny 0 bytes
I0603 11:57:34.352550 67501 certs.go:484] found cert: /home/jenkins/minikube-integration/19008-7755/.minikube/certs/ca-key.pem (1679 bytes)
I0603 11:57:34.352570 67501 certs.go:484] found cert: /home/jenkins/minikube-integration/19008-7755/.minikube/certs/ca.pem (1082 bytes)
I0603 11:57:34.352594 67501 certs.go:484] found cert: /home/jenkins/minikube-integration/19008-7755/.minikube/certs/cert.pem (1123 bytes)
I0603 11:57:34.352615 67501 certs.go:484] found cert: /home/jenkins/minikube-integration/19008-7755/.minikube/certs/key.pem (1679 bytes)
I0603 11:57:34.352653 67501 certs.go:484] found cert: /home/jenkins/minikube-integration/19008-7755/.minikube/files/etc/ssl/certs/150282.pem (1708 bytes)
I0603 11:57:34.353228 67501 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19008-7755/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0603 11:57:34.380410 67501 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19008-7755/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0603 11:57:34.405636 67501 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19008-7755/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0603 11:57:34.430900 67501 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19008-7755/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0603 11:57:34.455156 67501 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0603 11:57:34.480483 67501 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0603 11:57:34.506059 67501 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0603 11:57:34.530542 67501 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/old-k8s-version-905554/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0603 11:57:34.554979 67501 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19008-7755/.minikube/files/etc/ssl/certs/150282.pem --> /usr/share/ca-certificates/150282.pem (1708 bytes)
I0603 11:57:34.580415 67501 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19008-7755/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0603 11:57:34.605410 67501 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19008-7755/.minikube/certs/15028.pem --> /usr/share/ca-certificates/15028.pem (1338 bytes)
I0603 11:57:34.630516 67501 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0603 11:57:34.648040 67501 ssh_runner.go:195] Run: openssl version
I0603 11:57:34.653968 67501 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0603 11:57:34.667523 67501 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0603 11:57:34.672336 67501 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 3 10:39 /usr/share/ca-certificates/minikubeCA.pem
I0603 11:57:34.672380 67501 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0603 11:57:34.678485 67501 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0603 11:57:34.694067 67501 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15028.pem && ln -fs /usr/share/ca-certificates/15028.pem /etc/ssl/certs/15028.pem"
I0603 11:57:34.714807 67501 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15028.pem
I0603 11:57:34.721330 67501 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 3 10:51 /usr/share/ca-certificates/15028.pem
I0603 11:57:34.721401 67501 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15028.pem
I0603 11:57:34.733135 67501 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15028.pem /etc/ssl/certs/51391683.0"
I0603 11:57:34.758371 67501 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/150282.pem && ln -fs /usr/share/ca-certificates/150282.pem /etc/ssl/certs/150282.pem"
I0603 11:57:34.776705 67501 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/150282.pem
I0603 11:57:34.783936 67501 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 3 10:51 /usr/share/ca-certificates/150282.pem
I0603 11:57:34.783992 67501 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/150282.pem
I0603 11:57:34.791136 67501 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/150282.pem /etc/ssl/certs/3ec20f2e.0"
I0603 11:57:34.803008 67501 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0603 11:57:34.807823 67501 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0603 11:57:34.807883 67501 kubeadm.go:391] StartCluster: {Name:old-k8s-version-905554 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18934/minikube-v1.33.1-1716398070-18934-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1716228441-18934@sha256:628b3f20803bc9c4302fd048087dd36cf2ff5dc9ab0ded395ec3288e2f1d0862 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-905554 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.155 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0603 11:57:34.807988 67501 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0603 11:57:34.808029 67501 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0603 11:57:34.845370 67501 cri.go:89] found id: ""
I0603 11:57:34.845449 67501 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0603 11:57:34.857817 67501 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0603 11:57:34.870019 67501 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0603 11:57:34.882690 67501 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0603 11:57:34.882712 67501 kubeadm.go:156] found existing configuration files:
I0603 11:57:34.882757 67501 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0603 11:57:34.892803 67501 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0603 11:57:34.892859 67501 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0603 11:57:34.902927 67501 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0603 11:57:34.913330 67501 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0603 11:57:34.913407 67501 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0603 11:57:34.924208 67501 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0603 11:57:34.934402 67501 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0603 11:57:34.934456 67501 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0603 11:57:34.945213 67501 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0603 11:57:34.955108 67501 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0603 11:57:35.028269 67501 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0603 11:57:35.039738 67501 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0603 11:57:35.319991 67501 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0603 11:59:34.416801 67501 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0603 11:59:34.416980 67501 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0603 11:59:34.418750 67501 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0603 11:59:34.418847 67501 kubeadm.go:309] [preflight] Running pre-flight checks
I0603 11:59:34.419011 67501 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0603 11:59:34.419273 67501 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0603 11:59:34.419472 67501 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0603 11:59:34.419611 67501 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0603 11:59:34.421265 67501 out.go:204] - Generating certificates and keys ...
I0603 11:59:34.421367 67501 kubeadm.go:309] [certs] Using existing ca certificate authority
I0603 11:59:34.421434 67501 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0603 11:59:34.421507 67501 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0603 11:59:34.421562 67501 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0603 11:59:34.421641 67501 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0603 11:59:34.421716 67501 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0603 11:59:34.421800 67501 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0603 11:59:34.421997 67501 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-905554] and IPs [192.168.39.155 127.0.0.1 ::1]
I0603 11:59:34.422079 67501 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0603 11:59:34.422242 67501 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-905554] and IPs [192.168.39.155 127.0.0.1 ::1]
I0603 11:59:34.422339 67501 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0603 11:59:34.422418 67501 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0603 11:59:34.422480 67501 kubeadm.go:309] [certs] Generating "sa" key and public key
I0603 11:59:34.422550 67501 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0603 11:59:34.422624 67501 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0603 11:59:34.422727 67501 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0603 11:59:34.422830 67501 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0603 11:59:34.422912 67501 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0603 11:59:34.423098 67501 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0603 11:59:34.423220 67501 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0603 11:59:34.423279 67501 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0603 11:59:34.423384 67501 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0603 11:59:34.424801 67501 out.go:204] - Booting up control plane ...
I0603 11:59:34.424881 67501 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0603 11:59:34.424968 67501 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0603 11:59:34.425054 67501 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0603 11:59:34.425140 67501 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0603 11:59:34.425320 67501 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0603 11:59:34.425385 67501 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0603 11:59:34.425472 67501 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 11:59:34.425709 67501 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 11:59:34.425799 67501 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 11:59:34.426033 67501 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 11:59:34.426125 67501 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 11:59:34.426371 67501 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 11:59:34.426458 67501 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 11:59:34.426693 67501 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 11:59:34.426787 67501 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 11:59:34.427023 67501 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 11:59:34.427051 67501 kubeadm.go:309]
I0603 11:59:34.427102 67501 kubeadm.go:309] Unfortunately, an error has occurred:
I0603 11:59:34.427170 67501 kubeadm.go:309] timed out waiting for the condition
I0603 11:59:34.427192 67501 kubeadm.go:309]
I0603 11:59:34.427245 67501 kubeadm.go:309] This error is likely caused by:
I0603 11:59:34.427294 67501 kubeadm.go:309] - The kubelet is not running
I0603 11:59:34.427422 67501 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0603 11:59:34.427433 67501 kubeadm.go:309]
I0603 11:59:34.427581 67501 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0603 11:59:34.427637 67501 kubeadm.go:309] - 'systemctl status kubelet'
I0603 11:59:34.427685 67501 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0603 11:59:34.427694 67501 kubeadm.go:309]
I0603 11:59:34.427865 67501 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0603 11:59:34.428000 67501 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0603 11:59:34.428017 67501 kubeadm.go:309]
I0603 11:59:34.428148 67501 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0603 11:59:34.428263 67501 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0603 11:59:34.428376 67501 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0603 11:59:34.428503 67501 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0603 11:59:34.428537 67501 kubeadm.go:309]
W0603 11:59:34.428641 67501 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-905554] and IPs [192.168.39.155 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-905554] and IPs [192.168.39.155 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-905554] and IPs [192.168.39.155 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-905554] and IPs [192.168.39.155 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0603 11:59:34.428689 67501 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0603 11:59:36.013070 67501 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (1.584345913s)
I0603 11:59:36.013147 67501 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0603 11:59:36.028345 67501 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0603 11:59:36.039965 67501 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0603 11:59:36.039984 67501 kubeadm.go:156] found existing configuration files:
I0603 11:59:36.040030 67501 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0603 11:59:36.049575 67501 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0603 11:59:36.049629 67501 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0603 11:59:36.058967 67501 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0603 11:59:36.068249 67501 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0603 11:59:36.068297 67501 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0603 11:59:36.078170 67501 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0603 11:59:36.089046 67501 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0603 11:59:36.089104 67501 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0603 11:59:36.100249 67501 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0603 11:59:36.110787 67501 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0603 11:59:36.110833 67501 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0603 11:59:36.120643 67501 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0603 11:59:36.188926 67501 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0603 11:59:36.188999 67501 kubeadm.go:309] [preflight] Running pre-flight checks
I0603 11:59:36.319598 67501 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0603 11:59:36.319738 67501 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0603 11:59:36.319861 67501 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0603 11:59:36.505528 67501 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0603 11:59:36.507522 67501 out.go:204] - Generating certificates and keys ...
I0603 11:59:36.507623 67501 kubeadm.go:309] [certs] Using existing ca certificate authority
I0603 11:59:36.507698 67501 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0603 11:59:36.507814 67501 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0603 11:59:36.507920 67501 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0603 11:59:36.508004 67501 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0603 11:59:36.508064 67501 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0603 11:59:36.508161 67501 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0603 11:59:36.508226 67501 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0603 11:59:36.508288 67501 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0603 11:59:36.508361 67501 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0603 11:59:36.508395 67501 kubeadm.go:309] [certs] Using the existing "sa" key
I0603 11:59:36.508442 67501 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0603 11:59:36.839296 67501 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0603 11:59:36.993903 67501 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0603 11:59:37.150612 67501 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0603 11:59:37.347133 67501 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0603 11:59:37.362936 67501 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0603 11:59:37.363083 67501 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0603 11:59:37.363123 67501 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0603 11:59:37.496535 67501 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0603 11:59:37.498434 67501 out.go:204] - Booting up control plane ...
I0603 11:59:37.498550 67501 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0603 11:59:37.503866 67501 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0603 11:59:37.505150 67501 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0603 11:59:37.506382 67501 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0603 11:59:37.513487 67501 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0603 12:00:17.516189 67501 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0603 12:00:17.516758 67501 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 12:00:17.516956 67501 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 12:00:22.517753 67501 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 12:00:22.517966 67501 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 12:00:32.518023 67501 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 12:00:32.518231 67501 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 12:00:52.517530 67501 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 12:00:52.517742 67501 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 12:01:32.517949 67501 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0603 12:01:32.518231 67501 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0603 12:01:32.518256 67501 kubeadm.go:309]
I0603 12:01:32.518312 67501 kubeadm.go:309] Unfortunately, an error has occurred:
I0603 12:01:32.518424 67501 kubeadm.go:309] timed out waiting for the condition
I0603 12:01:32.518443 67501 kubeadm.go:309]
I0603 12:01:32.518490 67501 kubeadm.go:309] This error is likely caused by:
I0603 12:01:32.518542 67501 kubeadm.go:309] - The kubelet is not running
I0603 12:01:32.518683 67501 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0603 12:01:32.518694 67501 kubeadm.go:309]
I0603 12:01:32.518829 67501 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0603 12:01:32.518879 67501 kubeadm.go:309] - 'systemctl status kubelet'
I0603 12:01:32.518927 67501 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0603 12:01:32.518936 67501 kubeadm.go:309]
I0603 12:01:32.519089 67501 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0603 12:01:32.519204 67501 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0603 12:01:32.519216 67501 kubeadm.go:309]
I0603 12:01:32.519362 67501 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0603 12:01:32.519473 67501 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0603 12:01:32.519573 67501 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0603 12:01:32.519667 67501 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0603 12:01:32.519678 67501 kubeadm.go:309]
I0603 12:01:32.520284 67501 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0603 12:01:32.520390 67501 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0603 12:01:32.520494 67501 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0603 12:01:32.520552 67501 kubeadm.go:393] duration metric: took 3m57.712672742s to StartCluster
I0603 12:01:32.520605 67501 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0603 12:01:32.520654 67501 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0603 12:01:32.567001 67501 cri.go:89] found id: ""
I0603 12:01:32.567030 67501 logs.go:276] 0 containers: []
W0603 12:01:32.567063 67501 logs.go:278] No container was found matching "kube-apiserver"
I0603 12:01:32.567071 67501 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0603 12:01:32.567124 67501 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0603 12:01:32.613701 67501 cri.go:89] found id: ""
I0603 12:01:32.613725 67501 logs.go:276] 0 containers: []
W0603 12:01:32.613733 67501 logs.go:278] No container was found matching "etcd"
I0603 12:01:32.613741 67501 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0603 12:01:32.613798 67501 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0603 12:01:32.649865 67501 cri.go:89] found id: ""
I0603 12:01:32.649891 67501 logs.go:276] 0 containers: []
W0603 12:01:32.649897 67501 logs.go:278] No container was found matching "coredns"
I0603 12:01:32.649903 67501 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0603 12:01:32.649949 67501 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0603 12:01:32.684188 67501 cri.go:89] found id: ""
I0603 12:01:32.684221 67501 logs.go:276] 0 containers: []
W0603 12:01:32.684231 67501 logs.go:278] No container was found matching "kube-scheduler"
I0603 12:01:32.684238 67501 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0603 12:01:32.684287 67501 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0603 12:01:32.723702 67501 cri.go:89] found id: ""
I0603 12:01:32.723730 67501 logs.go:276] 0 containers: []
W0603 12:01:32.723741 67501 logs.go:278] No container was found matching "kube-proxy"
I0603 12:01:32.723747 67501 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0603 12:01:32.723799 67501 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0603 12:01:32.761870 67501 cri.go:89] found id: ""
I0603 12:01:32.761889 67501 logs.go:276] 0 containers: []
W0603 12:01:32.761899 67501 logs.go:278] No container was found matching "kube-controller-manager"
I0603 12:01:32.761907 67501 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0603 12:01:32.761957 67501 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0603 12:01:32.800342 67501 cri.go:89] found id: ""
I0603 12:01:32.800366 67501 logs.go:276] 0 containers: []
W0603 12:01:32.800373 67501 logs.go:278] No container was found matching "kindnet"
I0603 12:01:32.800388 67501 logs.go:123] Gathering logs for CRI-O ...
I0603 12:01:32.800398 67501 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0603 12:01:32.899626 67501 logs.go:123] Gathering logs for container status ...
I0603 12:01:32.899663 67501 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0603 12:01:32.943691 67501 logs.go:123] Gathering logs for kubelet ...
I0603 12:01:32.943720 67501 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0603 12:01:32.992302 67501 logs.go:123] Gathering logs for dmesg ...
I0603 12:01:32.992330 67501 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0603 12:01:33.007971 67501 logs.go:123] Gathering logs for describe nodes ...
I0603 12:01:33.007995 67501 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0603 12:01:33.144029 67501 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
W0603 12:01:33.144076 67501 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0603 12:01:33.144120 67501 out.go:239] *
*
W0603 12:01:33.144174 67501 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0603 12:01:33.144202 67501 out.go:239] *
*
W0603 12:01:33.145154 67501 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0603 12:01:33.148206 67501 out.go:177]
W0603 12:01:33.149466 67501 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0603 12:01:33.149511 67501 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0603 12:01:33.149534 67501 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0603 12:01:33.150956 67501 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-905554 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-905554 -n old-k8s-version-905554
E0603 12:01:33.293662 15028 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19008-7755/.minikube/profiles/enable-default-cni-034991/client.crt: no such file or directory
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-905554 -n old-k8s-version-905554: exit status 6 (224.281333ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0603 12:01:33.414727 72677 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-905554" does not appear in /home/jenkins/minikube-integration/19008-7755/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-905554" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (273.52s)