=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-867585 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-867585 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m48.316878177s)
-- stdout --
* [old-k8s-version-867585] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18702
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18702-3854/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18702-3854/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-867585" primary control-plane node in "old-k8s-version-867585" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0421 19:38:46.533745 54509 out.go:291] Setting OutFile to fd 1 ...
I0421 19:38:46.533893 54509 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0421 19:38:46.533906 54509 out.go:304] Setting ErrFile to fd 2...
I0421 19:38:46.533915 54509 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0421 19:38:46.534452 54509 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18702-3854/.minikube/bin
I0421 19:38:46.535469 54509 out.go:298] Setting JSON to false
I0421 19:38:46.536464 54509 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":4825,"bootTime":1713723502,"procs":214,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0421 19:38:46.536539 54509 start.go:139] virtualization: kvm guest
I0421 19:38:46.538743 54509 out.go:177] * [old-k8s-version-867585] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)
I0421 19:38:46.540301 54509 notify.go:220] Checking for updates...
I0421 19:38:46.540339 54509 out.go:177] - MINIKUBE_LOCATION=18702
I0421 19:38:46.541776 54509 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0421 19:38:46.542939 54509 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18702-3854/kubeconfig
I0421 19:38:46.544414 54509 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18702-3854/.minikube
I0421 19:38:46.545680 54509 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0421 19:38:46.547244 54509 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0421 19:38:46.549377 54509 config.go:182] Loaded profile config "cert-options-015184": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0421 19:38:46.549521 54509 config.go:182] Loaded profile config "kubernetes-upgrade-595552": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0421 19:38:46.549701 54509 config.go:182] Loaded profile config "pause-321307": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0421 19:38:46.549813 54509 driver.go:392] Setting default libvirt URI to qemu:///system
I0421 19:38:46.588315 54509 out.go:177] * Using the kvm2 driver based on user configuration
I0421 19:38:46.589424 54509 start.go:297] selected driver: kvm2
I0421 19:38:46.589435 54509 start.go:901] validating driver "kvm2" against <nil>
I0421 19:38:46.589445 54509 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0421 19:38:46.590236 54509 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0421 19:38:46.590333 54509 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18702-3854/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0421 19:38:46.605293 54509 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0
I0421 19:38:46.605344 54509 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0421 19:38:46.605601 54509 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0421 19:38:46.605662 54509 cni.go:84] Creating CNI manager for ""
I0421 19:38:46.605680 54509 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0421 19:38:46.605691 54509 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0421 19:38:46.605757 54509 start.go:340] cluster config:
{Name:old-k8s-version-867585 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713569670-18702@sha256:1db7a12e122807eaef46d49daa14095f818f9bfb653fcf62060f6eb507c1f0d8 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-867585 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0421 19:38:46.605893 54509 iso.go:125] acquiring lock: {Name:mkcc127c99cb9de76f55e1497bea18abd579a402 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0421 19:38:46.607606 54509 out.go:177] * Starting "old-k8s-version-867585" primary control-plane node in "old-k8s-version-867585" cluster
I0421 19:38:46.609001 54509 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0421 19:38:46.609032 54509 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18702-3854/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0421 19:38:46.609042 54509 cache.go:56] Caching tarball of preloaded images
I0421 19:38:46.609111 54509 preload.go:173] Found /home/jenkins/minikube-integration/18702-3854/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0421 19:38:46.609121 54509 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0421 19:38:46.609202 54509 profile.go:143] Saving config to /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/config.json ...
I0421 19:38:46.609219 54509 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/config.json: {Name:mk5d7a899d339d828b05f0d4db66221faebae7da Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0421 19:38:46.609337 54509 start.go:360] acquireMachinesLock for old-k8s-version-867585: {Name:mk500410bccf0ae2077d12a7d9160aa55630c445 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0421 19:38:59.509702 54509 start.go:364] duration metric: took 12.900321436s to acquireMachinesLock for "old-k8s-version-867585"
I0421 19:38:59.509792 54509 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-867585 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.33.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713569670-18702@sha256:1db7a12e122807eaef46d49daa14095f818f9bfb653fcf62060f6eb507c1f0d8 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 C
lusterName:old-k8s-version-867585 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p M
ountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0421 19:38:59.509932 54509 start.go:125] createHost starting for "" (driver="kvm2")
I0421 19:38:59.658523 54509 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0421 19:38:59.658786 54509 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0421 19:38:59.658828 54509 main.go:141] libmachine: Launching plugin server for driver kvm2
I0421 19:38:59.674049 54509 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38397
I0421 19:38:59.674493 54509 main.go:141] libmachine: () Calling .GetVersion
I0421 19:38:59.675138 54509 main.go:141] libmachine: Using API Version 1
I0421 19:38:59.675164 54509 main.go:141] libmachine: () Calling .SetConfigRaw
I0421 19:38:59.675537 54509 main.go:141] libmachine: () Calling .GetMachineName
I0421 19:38:59.675717 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetMachineName
I0421 19:38:59.675866 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .DriverName
I0421 19:38:59.676007 54509 start.go:159] libmachine.API.Create for "old-k8s-version-867585" (driver="kvm2")
I0421 19:38:59.676040 54509 client.go:168] LocalClient.Create starting
I0421 19:38:59.676092 54509 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18702-3854/.minikube/certs/ca.pem
I0421 19:38:59.676140 54509 main.go:141] libmachine: Decoding PEM data...
I0421 19:38:59.676162 54509 main.go:141] libmachine: Parsing certificate...
I0421 19:38:59.676227 54509 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18702-3854/.minikube/certs/cert.pem
I0421 19:38:59.676256 54509 main.go:141] libmachine: Decoding PEM data...
I0421 19:38:59.676277 54509 main.go:141] libmachine: Parsing certificate...
I0421 19:38:59.676306 54509 main.go:141] libmachine: Running pre-create checks...
I0421 19:38:59.676318 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .PreCreateCheck
I0421 19:38:59.676705 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetConfigRaw
I0421 19:38:59.677126 54509 main.go:141] libmachine: Creating machine...
I0421 19:38:59.677141 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .Create
I0421 19:38:59.677261 54509 main.go:141] libmachine: (old-k8s-version-867585) Creating KVM machine...
I0421 19:38:59.678467 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found existing default KVM network
I0421 19:38:59.679982 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:38:59.679828 54734 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:c0:6b:83} reservation:<nil>}
I0421 19:38:59.681245 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:38:59.681158 54734 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002a0710}
I0421 19:38:59.681275 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | created network xml:
I0421 19:38:59.681288 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | <network>
I0421 19:38:59.681302 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | <name>mk-old-k8s-version-867585</name>
I0421 19:38:59.681312 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | <dns enable='no'/>
I0421 19:38:59.681322 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG |
I0421 19:38:59.681336 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | <ip address='192.168.50.1' netmask='255.255.255.0'>
I0421 19:38:59.681347 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | <dhcp>
I0421 19:38:59.681373 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | <range start='192.168.50.2' end='192.168.50.253'/>
I0421 19:38:59.681391 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | </dhcp>
I0421 19:38:59.681401 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | </ip>
I0421 19:38:59.681409 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG |
I0421 19:38:59.681501 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | </network>
I0421 19:38:59.681535 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG |
I0421 19:38:59.825339 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | trying to create private KVM network mk-old-k8s-version-867585 192.168.50.0/24...
I0421 19:38:59.911789 54509 main.go:141] libmachine: (old-k8s-version-867585) Setting up store path in /home/jenkins/minikube-integration/18702-3854/.minikube/machines/old-k8s-version-867585 ...
I0421 19:38:59.911824 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | private KVM network mk-old-k8s-version-867585 192.168.50.0/24 created
I0421 19:38:59.911842 54509 main.go:141] libmachine: (old-k8s-version-867585) Building disk image from file:///home/jenkins/minikube-integration/18702-3854/.minikube/cache/iso/amd64/minikube-v1.33.0-amd64.iso
I0421 19:38:59.911865 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:38:59.911697 54734 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18702-3854/.minikube
I0421 19:38:59.912009 54509 main.go:141] libmachine: (old-k8s-version-867585) Downloading /home/jenkins/minikube-integration/18702-3854/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18702-3854/.minikube/cache/iso/amd64/minikube-v1.33.0-amd64.iso...
I0421 19:39:00.157189 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:00.157021 54734 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18702-3854/.minikube/machines/old-k8s-version-867585/id_rsa...
I0421 19:39:00.267028 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:00.266861 54734 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18702-3854/.minikube/machines/old-k8s-version-867585/old-k8s-version-867585.rawdisk...
I0421 19:39:00.267060 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | Writing magic tar header
I0421 19:39:00.267080 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | Writing SSH key tar header
I0421 19:39:00.267094 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:00.267060 54734 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18702-3854/.minikube/machines/old-k8s-version-867585 ...
I0421 19:39:00.267190 54509 main.go:141] libmachine: (old-k8s-version-867585) Setting executable bit set on /home/jenkins/minikube-integration/18702-3854/.minikube/machines/old-k8s-version-867585 (perms=drwx------)
I0421 19:39:00.267212 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18702-3854/.minikube/machines/old-k8s-version-867585
I0421 19:39:00.267224 54509 main.go:141] libmachine: (old-k8s-version-867585) Setting executable bit set on /home/jenkins/minikube-integration/18702-3854/.minikube/machines (perms=drwxr-xr-x)
I0421 19:39:00.267248 54509 main.go:141] libmachine: (old-k8s-version-867585) Setting executable bit set on /home/jenkins/minikube-integration/18702-3854/.minikube (perms=drwxr-xr-x)
I0421 19:39:00.267264 54509 main.go:141] libmachine: (old-k8s-version-867585) Setting executable bit set on /home/jenkins/minikube-integration/18702-3854 (perms=drwxrwxr-x)
I0421 19:39:00.267280 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18702-3854/.minikube/machines
I0421 19:39:00.267295 54509 main.go:141] libmachine: (old-k8s-version-867585) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0421 19:39:00.267312 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18702-3854/.minikube
I0421 19:39:00.267330 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18702-3854
I0421 19:39:00.267348 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0421 19:39:00.267365 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | Checking permissions on dir: /home/jenkins
I0421 19:39:00.267377 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | Checking permissions on dir: /home
I0421 19:39:00.267386 54509 main.go:141] libmachine: (old-k8s-version-867585) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0421 19:39:00.267400 54509 main.go:141] libmachine: (old-k8s-version-867585) Creating domain...
I0421 19:39:00.267441 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | Skipping /home - not owner
I0421 19:39:00.268577 54509 main.go:141] libmachine: (old-k8s-version-867585) define libvirt domain using xml:
I0421 19:39:00.268623 54509 main.go:141] libmachine: (old-k8s-version-867585) <domain type='kvm'>
I0421 19:39:00.268636 54509 main.go:141] libmachine: (old-k8s-version-867585) <name>old-k8s-version-867585</name>
I0421 19:39:00.268653 54509 main.go:141] libmachine: (old-k8s-version-867585) <memory unit='MiB'>2200</memory>
I0421 19:39:00.268667 54509 main.go:141] libmachine: (old-k8s-version-867585) <vcpu>2</vcpu>
I0421 19:39:00.268683 54509 main.go:141] libmachine: (old-k8s-version-867585) <features>
I0421 19:39:00.268696 54509 main.go:141] libmachine: (old-k8s-version-867585) <acpi/>
I0421 19:39:00.268706 54509 main.go:141] libmachine: (old-k8s-version-867585) <apic/>
I0421 19:39:00.268728 54509 main.go:141] libmachine: (old-k8s-version-867585) <pae/>
I0421 19:39:00.268741 54509 main.go:141] libmachine: (old-k8s-version-867585)
I0421 19:39:00.268751 54509 main.go:141] libmachine: (old-k8s-version-867585) </features>
I0421 19:39:00.268765 54509 main.go:141] libmachine: (old-k8s-version-867585) <cpu mode='host-passthrough'>
I0421 19:39:00.268779 54509 main.go:141] libmachine: (old-k8s-version-867585)
I0421 19:39:00.268791 54509 main.go:141] libmachine: (old-k8s-version-867585) </cpu>
I0421 19:39:00.268808 54509 main.go:141] libmachine: (old-k8s-version-867585) <os>
I0421 19:39:00.268818 54509 main.go:141] libmachine: (old-k8s-version-867585) <type>hvm</type>
I0421 19:39:00.268829 54509 main.go:141] libmachine: (old-k8s-version-867585) <boot dev='cdrom'/>
I0421 19:39:00.268842 54509 main.go:141] libmachine: (old-k8s-version-867585) <boot dev='hd'/>
I0421 19:39:00.268857 54509 main.go:141] libmachine: (old-k8s-version-867585) <bootmenu enable='no'/>
I0421 19:39:00.268869 54509 main.go:141] libmachine: (old-k8s-version-867585) </os>
I0421 19:39:00.268883 54509 main.go:141] libmachine: (old-k8s-version-867585) <devices>
I0421 19:39:00.268896 54509 main.go:141] libmachine: (old-k8s-version-867585) <disk type='file' device='cdrom'>
I0421 19:39:00.268915 54509 main.go:141] libmachine: (old-k8s-version-867585) <source file='/home/jenkins/minikube-integration/18702-3854/.minikube/machines/old-k8s-version-867585/boot2docker.iso'/>
I0421 19:39:00.268928 54509 main.go:141] libmachine: (old-k8s-version-867585) <target dev='hdc' bus='scsi'/>
I0421 19:39:00.268942 54509 main.go:141] libmachine: (old-k8s-version-867585) <readonly/>
I0421 19:39:00.268964 54509 main.go:141] libmachine: (old-k8s-version-867585) </disk>
I0421 19:39:00.268980 54509 main.go:141] libmachine: (old-k8s-version-867585) <disk type='file' device='disk'>
I0421 19:39:00.268994 54509 main.go:141] libmachine: (old-k8s-version-867585) <driver name='qemu' type='raw' cache='default' io='threads' />
I0421 19:39:00.269019 54509 main.go:141] libmachine: (old-k8s-version-867585) <source file='/home/jenkins/minikube-integration/18702-3854/.minikube/machines/old-k8s-version-867585/old-k8s-version-867585.rawdisk'/>
I0421 19:39:00.269033 54509 main.go:141] libmachine: (old-k8s-version-867585) <target dev='hda' bus='virtio'/>
I0421 19:39:00.269043 54509 main.go:141] libmachine: (old-k8s-version-867585) </disk>
I0421 19:39:00.269051 54509 main.go:141] libmachine: (old-k8s-version-867585) <interface type='network'>
I0421 19:39:00.269062 54509 main.go:141] libmachine: (old-k8s-version-867585) <source network='mk-old-k8s-version-867585'/>
I0421 19:39:00.269075 54509 main.go:141] libmachine: (old-k8s-version-867585) <model type='virtio'/>
I0421 19:39:00.269089 54509 main.go:141] libmachine: (old-k8s-version-867585) </interface>
I0421 19:39:00.269102 54509 main.go:141] libmachine: (old-k8s-version-867585) <interface type='network'>
I0421 19:39:00.269116 54509 main.go:141] libmachine: (old-k8s-version-867585) <source network='default'/>
I0421 19:39:00.269127 54509 main.go:141] libmachine: (old-k8s-version-867585) <model type='virtio'/>
I0421 19:39:00.269135 54509 main.go:141] libmachine: (old-k8s-version-867585) </interface>
I0421 19:39:00.269147 54509 main.go:141] libmachine: (old-k8s-version-867585) <serial type='pty'>
I0421 19:39:00.269162 54509 main.go:141] libmachine: (old-k8s-version-867585) <target port='0'/>
I0421 19:39:00.269170 54509 main.go:141] libmachine: (old-k8s-version-867585) </serial>
I0421 19:39:00.269185 54509 main.go:141] libmachine: (old-k8s-version-867585) <console type='pty'>
I0421 19:39:00.269198 54509 main.go:141] libmachine: (old-k8s-version-867585) <target type='serial' port='0'/>
I0421 19:39:00.269211 54509 main.go:141] libmachine: (old-k8s-version-867585) </console>
I0421 19:39:00.269225 54509 main.go:141] libmachine: (old-k8s-version-867585) <rng model='virtio'>
I0421 19:39:00.269240 54509 main.go:141] libmachine: (old-k8s-version-867585) <backend model='random'>/dev/random</backend>
I0421 19:39:00.269253 54509 main.go:141] libmachine: (old-k8s-version-867585) </rng>
I0421 19:39:00.269264 54509 main.go:141] libmachine: (old-k8s-version-867585)
I0421 19:39:00.269276 54509 main.go:141] libmachine: (old-k8s-version-867585)
I0421 19:39:00.269286 54509 main.go:141] libmachine: (old-k8s-version-867585) </devices>
I0421 19:39:00.269298 54509 main.go:141] libmachine: (old-k8s-version-867585) </domain>
I0421 19:39:00.269315 54509 main.go:141] libmachine: (old-k8s-version-867585)
I0421 19:39:00.398876 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:48:07:9d in network default
I0421 19:39:00.399689 54509 main.go:141] libmachine: (old-k8s-version-867585) Ensuring networks are active...
I0421 19:39:00.399729 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:00.400716 54509 main.go:141] libmachine: (old-k8s-version-867585) Ensuring network default is active
I0421 19:39:00.401299 54509 main.go:141] libmachine: (old-k8s-version-867585) Ensuring network mk-old-k8s-version-867585 is active
I0421 19:39:00.401872 54509 main.go:141] libmachine: (old-k8s-version-867585) Getting domain xml...
I0421 19:39:00.402761 54509 main.go:141] libmachine: (old-k8s-version-867585) Creating domain...
I0421 19:39:02.021791 54509 main.go:141] libmachine: (old-k8s-version-867585) Waiting to get IP...
I0421 19:39:02.022781 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:02.023235 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | unable to find current IP address of domain old-k8s-version-867585 in network mk-old-k8s-version-867585
I0421 19:39:02.023285 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:02.023220 54734 retry.go:31] will retry after 263.98706ms: waiting for machine to come up
I0421 19:39:02.288817 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:02.289325 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | unable to find current IP address of domain old-k8s-version-867585 in network mk-old-k8s-version-867585
I0421 19:39:02.289354 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:02.289278 54734 retry.go:31] will retry after 291.103058ms: waiting for machine to come up
I0421 19:39:02.581836 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:02.582309 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | unable to find current IP address of domain old-k8s-version-867585 in network mk-old-k8s-version-867585
I0421 19:39:02.582344 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:02.582244 54734 retry.go:31] will retry after 426.902793ms: waiting for machine to come up
I0421 19:39:03.011082 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:03.011566 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | unable to find current IP address of domain old-k8s-version-867585 in network mk-old-k8s-version-867585
I0421 19:39:03.011599 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:03.011519 54734 retry.go:31] will retry after 449.278177ms: waiting for machine to come up
I0421 19:39:03.462071 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:03.462494 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | unable to find current IP address of domain old-k8s-version-867585 in network mk-old-k8s-version-867585
I0421 19:39:03.462525 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:03.462441 54734 retry.go:31] will retry after 731.678108ms: waiting for machine to come up
I0421 19:39:04.196347 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:04.196813 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | unable to find current IP address of domain old-k8s-version-867585 in network mk-old-k8s-version-867585
I0421 19:39:04.196849 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:04.196785 54734 retry.go:31] will retry after 758.001946ms: waiting for machine to come up
I0421 19:39:04.955929 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:04.956402 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | unable to find current IP address of domain old-k8s-version-867585 in network mk-old-k8s-version-867585
I0421 19:39:04.956437 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:04.956327 54734 retry.go:31] will retry after 852.959669ms: waiting for machine to come up
I0421 19:39:05.811570 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:05.812113 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | unable to find current IP address of domain old-k8s-version-867585 in network mk-old-k8s-version-867585
I0421 19:39:05.812142 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:05.812056 54734 retry.go:31] will retry after 974.529446ms: waiting for machine to come up
I0421 19:39:06.787950 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:06.788429 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | unable to find current IP address of domain old-k8s-version-867585 in network mk-old-k8s-version-867585
I0421 19:39:06.788467 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:06.788363 54734 retry.go:31] will retry after 1.147154958s: waiting for machine to come up
I0421 19:39:07.936825 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:07.937241 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | unable to find current IP address of domain old-k8s-version-867585 in network mk-old-k8s-version-867585
I0421 19:39:07.937262 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:07.937181 54734 retry.go:31] will retry after 1.666484368s: waiting for machine to come up
I0421 19:39:09.606134 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:09.606564 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | unable to find current IP address of domain old-k8s-version-867585 in network mk-old-k8s-version-867585
I0421 19:39:09.606590 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:09.606522 54734 retry.go:31] will retry after 2.293756276s: waiting for machine to come up
I0421 19:39:11.903593 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:11.904212 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | unable to find current IP address of domain old-k8s-version-867585 in network mk-old-k8s-version-867585
I0421 19:39:11.904246 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:11.904186 54734 retry.go:31] will retry after 3.540518047s: waiting for machine to come up
I0421 19:39:15.446336 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:15.446843 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | unable to find current IP address of domain old-k8s-version-867585 in network mk-old-k8s-version-867585
I0421 19:39:15.446880 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:15.446806 54734 retry.go:31] will retry after 4.116319048s: waiting for machine to come up
I0421 19:39:19.568110 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:19.568573 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | unable to find current IP address of domain old-k8s-version-867585 in network mk-old-k8s-version-867585
I0421 19:39:19.568597 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | I0421 19:39:19.568527 54734 retry.go:31] will retry after 5.17720153s: waiting for machine to come up
I0421 19:39:24.747007 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:24.747482 54509 main.go:141] libmachine: (old-k8s-version-867585) Found IP for machine: 192.168.50.42
I0421 19:39:24.747512 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has current primary IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:24.747522 54509 main.go:141] libmachine: (old-k8s-version-867585) Reserving static IP address...
I0421 19:39:24.747887 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-867585", mac: "52:54:00:00:e4:26", ip: "192.168.50.42"} in network mk-old-k8s-version-867585
I0421 19:39:24.823570 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | Getting to WaitForSSH function...
I0421 19:39:24.823604 54509 main.go:141] libmachine: (old-k8s-version-867585) Reserved static IP address: 192.168.50.42
I0421 19:39:24.823617 54509 main.go:141] libmachine: (old-k8s-version-867585) Waiting for SSH to be available...
I0421 19:39:24.826154 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:24.826648 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:minikube Clientid:01:52:54:00:00:e4:26}
I0421 19:39:24.826693 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:24.826862 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | Using SSH client type: external
I0421 19:39:24.826904 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | Using SSH private key: /home/jenkins/minikube-integration/18702-3854/.minikube/machines/old-k8s-version-867585/id_rsa (-rw-------)
I0421 19:39:24.826944 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.42 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18702-3854/.minikube/machines/old-k8s-version-867585/id_rsa -p 22] /usr/bin/ssh <nil>}
I0421 19:39:24.826973 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | About to run SSH command:
I0421 19:39:24.826994 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | exit 0
I0421 19:39:24.950735 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | SSH cmd err, output: <nil>:
I0421 19:39:24.951071 54509 main.go:141] libmachine: (old-k8s-version-867585) KVM machine creation complete!
I0421 19:39:24.951393 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetConfigRaw
I0421 19:39:24.951944 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .DriverName
I0421 19:39:24.952172 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .DriverName
I0421 19:39:24.952330 54509 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0421 19:39:24.952355 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetState
I0421 19:39:24.953647 54509 main.go:141] libmachine: Detecting operating system of created instance...
I0421 19:39:24.953663 54509 main.go:141] libmachine: Waiting for SSH to be available...
I0421 19:39:24.953669 54509 main.go:141] libmachine: Getting to WaitForSSH function...
I0421 19:39:24.953674 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHHostname
I0421 19:39:24.956258 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:24.956594 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:old-k8s-version-867585 Clientid:01:52:54:00:00:e4:26}
I0421 19:39:24.956622 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:24.956775 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHPort
I0421 19:39:24.956947 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHKeyPath
I0421 19:39:24.957105 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHKeyPath
I0421 19:39:24.957250 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHUsername
I0421 19:39:24.957434 54509 main.go:141] libmachine: Using SSH client type: native
I0421 19:39:24.957668 54509 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.50.42 22 <nil> <nil>}
I0421 19:39:24.957681 54509 main.go:141] libmachine: About to run SSH command:
exit 0
I0421 19:39:25.065620 54509 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0421 19:39:25.065649 54509 main.go:141] libmachine: Detecting the provisioner...
I0421 19:39:25.065666 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHHostname
I0421 19:39:25.068477 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:25.068843 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:old-k8s-version-867585 Clientid:01:52:54:00:00:e4:26}
I0421 19:39:25.068871 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:25.069076 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHPort
I0421 19:39:25.069255 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHKeyPath
I0421 19:39:25.069458 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHKeyPath
I0421 19:39:25.069608 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHUsername
I0421 19:39:25.069753 54509 main.go:141] libmachine: Using SSH client type: native
I0421 19:39:25.069937 54509 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.50.42 22 <nil> <nil>}
I0421 19:39:25.069947 54509 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0421 19:39:25.171826 54509 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0421 19:39:25.171901 54509 main.go:141] libmachine: found compatible host: buildroot
I0421 19:39:25.171910 54509 main.go:141] libmachine: Provisioning with buildroot...
I0421 19:39:25.171920 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetMachineName
I0421 19:39:25.172166 54509 buildroot.go:166] provisioning hostname "old-k8s-version-867585"
I0421 19:39:25.172199 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetMachineName
I0421 19:39:25.172404 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHHostname
I0421 19:39:25.174968 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:25.175315 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:old-k8s-version-867585 Clientid:01:52:54:00:00:e4:26}
I0421 19:39:25.175340 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:25.175599 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHPort
I0421 19:39:25.175785 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHKeyPath
I0421 19:39:25.175978 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHKeyPath
I0421 19:39:25.176114 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHUsername
I0421 19:39:25.176296 54509 main.go:141] libmachine: Using SSH client type: native
I0421 19:39:25.176504 54509 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.50.42 22 <nil> <nil>}
I0421 19:39:25.176517 54509 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-867585 && echo "old-k8s-version-867585" | sudo tee /etc/hostname
I0421 19:39:25.299628 54509 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-867585
I0421 19:39:25.299660 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHHostname
I0421 19:39:25.302446 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:25.302976 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:old-k8s-version-867585 Clientid:01:52:54:00:00:e4:26}
I0421 19:39:25.303006 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:25.303237 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHPort
I0421 19:39:25.303458 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHKeyPath
I0421 19:39:25.303633 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHKeyPath
I0421 19:39:25.303770 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHUsername
I0421 19:39:25.303954 54509 main.go:141] libmachine: Using SSH client type: native
I0421 19:39:25.304160 54509 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.50.42 22 <nil> <nil>}
I0421 19:39:25.304194 54509 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-867585' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-867585/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-867585' | sudo tee -a /etc/hosts;
fi
fi
I0421 19:39:25.416756 54509 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0421 19:39:25.416790 54509 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18702-3854/.minikube CaCertPath:/home/jenkins/minikube-integration/18702-3854/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18702-3854/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18702-3854/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18702-3854/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18702-3854/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18702-3854/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18702-3854/.minikube}
I0421 19:39:25.416814 54509 buildroot.go:174] setting up certificates
I0421 19:39:25.416825 54509 provision.go:84] configureAuth start
I0421 19:39:25.416838 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetMachineName
I0421 19:39:25.417145 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetIP
I0421 19:39:25.419708 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:25.420098 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:old-k8s-version-867585 Clientid:01:52:54:00:00:e4:26}
I0421 19:39:25.420128 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:25.420264 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHHostname
I0421 19:39:25.422507 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:25.422844 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:old-k8s-version-867585 Clientid:01:52:54:00:00:e4:26}
I0421 19:39:25.422878 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:25.423112 54509 provision.go:143] copyHostCerts
I0421 19:39:25.423166 54509 exec_runner.go:144] found /home/jenkins/minikube-integration/18702-3854/.minikube/ca.pem, removing ...
I0421 19:39:25.423175 54509 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18702-3854/.minikube/ca.pem
I0421 19:39:25.423232 54509 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18702-3854/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18702-3854/.minikube/ca.pem (1078 bytes)
I0421 19:39:25.423344 54509 exec_runner.go:144] found /home/jenkins/minikube-integration/18702-3854/.minikube/cert.pem, removing ...
I0421 19:39:25.423354 54509 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18702-3854/.minikube/cert.pem
I0421 19:39:25.423374 54509 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18702-3854/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18702-3854/.minikube/cert.pem (1123 bytes)
I0421 19:39:25.423442 54509 exec_runner.go:144] found /home/jenkins/minikube-integration/18702-3854/.minikube/key.pem, removing ...
I0421 19:39:25.423450 54509 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18702-3854/.minikube/key.pem
I0421 19:39:25.423467 54509 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18702-3854/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18702-3854/.minikube/key.pem (1679 bytes)
I0421 19:39:25.423526 54509 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18702-3854/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18702-3854/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18702-3854/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-867585 san=[127.0.0.1 192.168.50.42 localhost minikube old-k8s-version-867585]
I0421 19:39:25.701103 54509 provision.go:177] copyRemoteCerts
I0421 19:39:25.701156 54509 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0421 19:39:25.701178 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHHostname
I0421 19:39:25.703856 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:25.704230 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:old-k8s-version-867585 Clientid:01:52:54:00:00:e4:26}
I0421 19:39:25.704260 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:25.704419 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHPort
I0421 19:39:25.704611 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHKeyPath
I0421 19:39:25.704777 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHUsername
I0421 19:39:25.704902 54509 sshutil.go:53] new ssh client: &{IP:192.168.50.42 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18702-3854/.minikube/machines/old-k8s-version-867585/id_rsa Username:docker}
I0421 19:39:25.787738 54509 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18702-3854/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0421 19:39:25.816337 54509 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18702-3854/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0421 19:39:25.843077 54509 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18702-3854/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0421 19:39:25.868598 54509 provision.go:87] duration metric: took 451.761201ms to configureAuth
I0421 19:39:25.868624 54509 buildroot.go:189] setting minikube options for container-runtime
I0421 19:39:25.868779 54509 config.go:182] Loaded profile config "old-k8s-version-867585": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0421 19:39:25.868848 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHHostname
I0421 19:39:25.871457 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:25.871787 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:old-k8s-version-867585 Clientid:01:52:54:00:00:e4:26}
I0421 19:39:25.871808 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:25.872002 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHPort
I0421 19:39:25.872220 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHKeyPath
I0421 19:39:25.872382 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHKeyPath
I0421 19:39:25.872528 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHUsername
I0421 19:39:25.872680 54509 main.go:141] libmachine: Using SSH client type: native
I0421 19:39:25.872834 54509 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.50.42 22 <nil> <nil>}
I0421 19:39:25.872851 54509 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0421 19:39:26.151747 54509 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0421 19:39:26.151774 54509 main.go:141] libmachine: Checking connection to Docker...
I0421 19:39:26.151784 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetURL
I0421 19:39:26.153124 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | Using libvirt version 6000000
I0421 19:39:26.155303 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:26.155631 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:old-k8s-version-867585 Clientid:01:52:54:00:00:e4:26}
I0421 19:39:26.155659 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:26.155828 54509 main.go:141] libmachine: Docker is up and running!
I0421 19:39:26.155842 54509 main.go:141] libmachine: Reticulating splines...
I0421 19:39:26.155848 54509 client.go:171] duration metric: took 26.479799547s to LocalClient.Create
I0421 19:39:26.155871 54509 start.go:167] duration metric: took 26.479866151s to libmachine.API.Create "old-k8s-version-867585"
I0421 19:39:26.155880 54509 start.go:293] postStartSetup for "old-k8s-version-867585" (driver="kvm2")
I0421 19:39:26.155891 54509 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0421 19:39:26.155906 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .DriverName
I0421 19:39:26.156169 54509 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0421 19:39:26.156201 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHHostname
I0421 19:39:26.158365 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:26.158671 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:old-k8s-version-867585 Clientid:01:52:54:00:00:e4:26}
I0421 19:39:26.158698 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:26.158834 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHPort
I0421 19:39:26.158989 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHKeyPath
I0421 19:39:26.159140 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHUsername
I0421 19:39:26.159276 54509 sshutil.go:53] new ssh client: &{IP:192.168.50.42 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18702-3854/.minikube/machines/old-k8s-version-867585/id_rsa Username:docker}
I0421 19:39:26.241031 54509 ssh_runner.go:195] Run: cat /etc/os-release
I0421 19:39:26.245861 54509 info.go:137] Remote host: Buildroot 2023.02.9
I0421 19:39:26.245896 54509 filesync.go:126] Scanning /home/jenkins/minikube-integration/18702-3854/.minikube/addons for local assets ...
I0421 19:39:26.245965 54509 filesync.go:126] Scanning /home/jenkins/minikube-integration/18702-3854/.minikube/files for local assets ...
I0421 19:39:26.246106 54509 filesync.go:149] local asset: /home/jenkins/minikube-integration/18702-3854/.minikube/files/etc/ssl/certs/111752.pem -> 111752.pem in /etc/ssl/certs
I0421 19:39:26.246233 54509 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0421 19:39:26.255891 54509 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18702-3854/.minikube/files/etc/ssl/certs/111752.pem --> /etc/ssl/certs/111752.pem (1708 bytes)
I0421 19:39:26.282641 54509 start.go:296] duration metric: took 126.747303ms for postStartSetup
I0421 19:39:26.282693 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetConfigRaw
I0421 19:39:26.283356 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetIP
I0421 19:39:26.286534 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:26.286892 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:old-k8s-version-867585 Clientid:01:52:54:00:00:e4:26}
I0421 19:39:26.286931 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:26.287179 54509 profile.go:143] Saving config to /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/config.json ...
I0421 19:39:26.287356 54509 start.go:128] duration metric: took 26.777413706s to createHost
I0421 19:39:26.287380 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHHostname
I0421 19:39:26.289595 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:26.289920 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:old-k8s-version-867585 Clientid:01:52:54:00:00:e4:26}
I0421 19:39:26.289941 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:26.290096 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHPort
I0421 19:39:26.290268 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHKeyPath
I0421 19:39:26.290398 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHKeyPath
I0421 19:39:26.290566 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHUsername
I0421 19:39:26.290737 54509 main.go:141] libmachine: Using SSH client type: native
I0421 19:39:26.290890 54509 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.50.42 22 <nil> <nil>}
I0421 19:39:26.290902 54509 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0421 19:39:26.391377 54509 main.go:141] libmachine: SSH cmd err, output: <nil>: 1713728366.376861624
I0421 19:39:26.391400 54509 fix.go:216] guest clock: 1713728366.376861624
I0421 19:39:26.391409 54509 fix.go:229] Guest: 2024-04-21 19:39:26.376861624 +0000 UTC Remote: 2024-04-21 19:39:26.287366588 +0000 UTC m=+39.799829849 (delta=89.495036ms)
I0421 19:39:26.391431 54509 fix.go:200] guest clock delta is within tolerance: 89.495036ms
I0421 19:39:26.391437 54509 start.go:83] releasing machines lock for "old-k8s-version-867585", held for 26.881703462s
I0421 19:39:26.391470 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .DriverName
I0421 19:39:26.391794 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetIP
I0421 19:39:26.394689 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:26.395117 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:old-k8s-version-867585 Clientid:01:52:54:00:00:e4:26}
I0421 19:39:26.395147 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:26.395352 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .DriverName
I0421 19:39:26.395971 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .DriverName
I0421 19:39:26.396192 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .DriverName
I0421 19:39:26.396332 54509 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0421 19:39:26.396367 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHHostname
I0421 19:39:26.396444 54509 ssh_runner.go:195] Run: cat /version.json
I0421 19:39:26.396467 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHHostname
I0421 19:39:26.399290 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:26.399644 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:26.399707 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:old-k8s-version-867585 Clientid:01:52:54:00:00:e4:26}
I0421 19:39:26.399759 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:26.399910 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:old-k8s-version-867585 Clientid:01:52:54:00:00:e4:26}
I0421 19:39:26.399933 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHPort
I0421 19:39:26.399961 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:26.400123 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHKeyPath
I0421 19:39:26.400162 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHPort
I0421 19:39:26.400262 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHKeyPath
I0421 19:39:26.400312 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHUsername
I0421 19:39:26.400405 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetSSHUsername
I0421 19:39:26.400461 54509 sshutil.go:53] new ssh client: &{IP:192.168.50.42 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18702-3854/.minikube/machines/old-k8s-version-867585/id_rsa Username:docker}
I0421 19:39:26.400524 54509 sshutil.go:53] new ssh client: &{IP:192.168.50.42 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18702-3854/.minikube/machines/old-k8s-version-867585/id_rsa Username:docker}
I0421 19:39:26.479895 54509 ssh_runner.go:195] Run: systemctl --version
I0421 19:39:26.503785 54509 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0421 19:39:26.678379 54509 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0421 19:39:26.686596 54509 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0421 19:39:26.686662 54509 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0421 19:39:26.707799 54509 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0421 19:39:26.707827 54509 start.go:494] detecting cgroup driver to use...
I0421 19:39:26.707900 54509 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0421 19:39:26.727169 54509 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0421 19:39:26.746432 54509 docker.go:217] disabling cri-docker service (if available) ...
I0421 19:39:26.746509 54509 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0421 19:39:26.762268 54509 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0421 19:39:26.779820 54509 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0421 19:39:26.905311 54509 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0421 19:39:27.091551 54509 docker.go:233] disabling docker service ...
I0421 19:39:27.091621 54509 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0421 19:39:27.110337 54509 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0421 19:39:27.126025 54509 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0421 19:39:27.277164 54509 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0421 19:39:27.436591 54509 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0421 19:39:27.459709 54509 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0421 19:39:27.481565 54509 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0421 19:39:27.481628 54509 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0421 19:39:27.496107 54509 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0421 19:39:27.496183 54509 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0421 19:39:27.509330 54509 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0421 19:39:27.523394 54509 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0421 19:39:27.539404 54509 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0421 19:39:27.554470 54509 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0421 19:39:27.567298 54509 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0421 19:39:27.567348 54509 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0421 19:39:27.585849 54509 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0421 19:39:27.598087 54509 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0421 19:39:27.755381 54509 ssh_runner.go:195] Run: sudo systemctl restart crio
I0421 19:39:27.913376 54509 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0421 19:39:27.913451 54509 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0421 19:39:27.919327 54509 start.go:562] Will wait 60s for crictl version
I0421 19:39:27.919389 54509 ssh_runner.go:195] Run: which crictl
I0421 19:39:27.924322 54509 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0421 19:39:27.972573 54509 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0421 19:39:27.972648 54509 ssh_runner.go:195] Run: crio --version
I0421 19:39:28.008377 54509 ssh_runner.go:195] Run: crio --version
I0421 19:39:28.048981 54509 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0421 19:39:28.050216 54509 main.go:141] libmachine: (old-k8s-version-867585) Calling .GetIP
I0421 19:39:28.053251 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:28.053660 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:00:e4:26", ip: ""} in network mk-old-k8s-version-867585: {Iface:virbr2 ExpiryTime:2024-04-21 20:39:16 +0000 UTC Type:0 Mac:52:54:00:00:e4:26 Iaid: IPaddr:192.168.50.42 Prefix:24 Hostname:old-k8s-version-867585 Clientid:01:52:54:00:00:e4:26}
I0421 19:39:28.053711 54509 main.go:141] libmachine: (old-k8s-version-867585) DBG | domain old-k8s-version-867585 has defined IP address 192.168.50.42 and MAC address 52:54:00:00:e4:26 in network mk-old-k8s-version-867585
I0421 19:39:28.053986 54509 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts
I0421 19:39:28.058769 54509 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0421 19:39:28.078634 54509 kubeadm.go:877] updating cluster {Name:old-k8s-version-867585 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.33.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713569670-18702@sha256:1db7a12e122807eaef46d49daa14095f818f9bfb653fcf62060f6eb507c1f0d8 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-
version-867585 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.42 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUI
D:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0421 19:39:28.078729 54509 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0421 19:39:28.078767 54509 ssh_runner.go:195] Run: sudo crictl images --output json
I0421 19:39:28.130449 54509 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0421 19:39:28.130536 54509 ssh_runner.go:195] Run: which lz4
I0421 19:39:28.135589 54509 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0421 19:39:28.140395 54509 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0421 19:39:28.140422 54509 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18702-3854/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0421 19:39:30.249508 54509 crio.go:462] duration metric: took 2.113972197s to copy over tarball
I0421 19:39:30.249574 54509 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0421 19:39:33.272051 54509 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.022454281s)
I0421 19:39:33.272074 54509 crio.go:469] duration metric: took 3.022538929s to extract the tarball
I0421 19:39:33.272081 54509 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0421 19:39:33.321506 54509 ssh_runner.go:195] Run: sudo crictl images --output json
I0421 19:39:33.371280 54509 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0421 19:39:33.371306 54509 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0421 19:39:33.371379 54509 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0421 19:39:33.371400 54509 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0421 19:39:33.371418 54509 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0421 19:39:33.371437 54509 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0421 19:39:33.371475 54509 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0421 19:39:33.371484 54509 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0421 19:39:33.371612 54509 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0421 19:39:33.371643 54509 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0421 19:39:33.372723 54509 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0421 19:39:33.372823 54509 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0421 19:39:33.372858 54509 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0421 19:39:33.372925 54509 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0421 19:39:33.372723 54509 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0421 19:39:33.372954 54509 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0421 19:39:33.373025 54509 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0421 19:39:33.373155 54509 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0421 19:39:33.512067 54509 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0421 19:39:33.520981 54509 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0421 19:39:33.525006 54509 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0421 19:39:33.526887 54509 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0421 19:39:33.526903 54509 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0421 19:39:33.586448 54509 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0421 19:39:33.593329 54509 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0421 19:39:33.593389 54509 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0421 19:39:33.593434 54509 ssh_runner.go:195] Run: which crictl
I0421 19:39:33.599516 54509 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0421 19:39:33.680438 54509 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0421 19:39:33.680483 54509 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0421 19:39:33.680526 54509 ssh_runner.go:195] Run: which crictl
I0421 19:39:33.701047 54509 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0421 19:39:33.701092 54509 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0421 19:39:33.701122 54509 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0421 19:39:33.701147 54509 ssh_runner.go:195] Run: which crictl
I0421 19:39:33.701153 54509 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0421 19:39:33.701173 54509 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0421 19:39:33.701173 54509 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0421 19:39:33.701216 54509 ssh_runner.go:195] Run: which crictl
I0421 19:39:33.701264 54509 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0421 19:39:33.701288 54509 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0421 19:39:33.701216 54509 ssh_runner.go:195] Run: which crictl
I0421 19:39:33.701309 54509 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0421 19:39:33.701347 54509 ssh_runner.go:195] Run: which crictl
I0421 19:39:33.748398 54509 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0421 19:39:33.748441 54509 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0421 19:39:33.748461 54509 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0421 19:39:33.748493 54509 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0421 19:39:33.748512 54509 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0421 19:39:33.748526 54509 ssh_runner.go:195] Run: which crictl
I0421 19:39:33.779973 54509 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0421 19:39:33.780058 54509 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0421 19:39:33.780143 54509 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0421 19:39:33.782698 54509 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18702-3854/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0421 19:39:33.883827 54509 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18702-3854/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0421 19:39:33.883834 54509 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18702-3854/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0421 19:39:33.883877 54509 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18702-3854/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0421 19:39:33.909092 54509 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18702-3854/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0421 19:39:33.924982 54509 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18702-3854/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0421 19:39:33.925113 54509 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18702-3854/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0421 19:39:34.303879 54509 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0421 19:39:34.453015 54509 cache_images.go:92] duration metric: took 1.0816914s to LoadCachedImages
W0421 19:39:34.453114 54509 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18702-3854/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18702-3854/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
I0421 19:39:34.453144 54509 kubeadm.go:928] updating node { 192.168.50.42 8443 v1.20.0 crio true true} ...
I0421 19:39:34.453246 54509 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-867585 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.50.42
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-867585 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0421 19:39:34.453318 54509 ssh_runner.go:195] Run: crio config
I0421 19:39:34.512693 54509 cni.go:84] Creating CNI manager for ""
I0421 19:39:34.512720 54509 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0421 19:39:34.512735 54509 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0421 19:39:34.512759 54509 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.42 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-867585 NodeName:old-k8s-version-867585 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.42"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.42 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0421 19:39:34.512934 54509 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.50.42
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-867585"
kubeletExtraArgs:
node-ip: 192.168.50.42
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.50.42"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0421 19:39:34.513006 54509 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0421 19:39:34.524847 54509 binaries.go:44] Found k8s binaries, skipping transfer
I0421 19:39:34.524917 54509 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0421 19:39:34.536127 54509 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0421 19:39:34.555227 54509 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0421 19:39:34.579156 54509 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0421 19:39:34.600014 54509 ssh_runner.go:195] Run: grep 192.168.50.42 control-plane.minikube.internal$ /etc/hosts
I0421 19:39:34.605773 54509 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.42 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0421 19:39:34.620114 54509 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0421 19:39:34.751178 54509 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0421 19:39:34.770155 54509 certs.go:68] Setting up /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585 for IP: 192.168.50.42
I0421 19:39:34.770182 54509 certs.go:194] generating shared ca certs ...
I0421 19:39:34.770201 54509 certs.go:226] acquiring lock for ca certs: {Name:mkaca3dfdda4c6795a8c3f402fdee85570873fdc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0421 19:39:34.770366 54509 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18702-3854/.minikube/ca.key
I0421 19:39:34.770418 54509 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18702-3854/.minikube/proxy-client-ca.key
I0421 19:39:34.770430 54509 certs.go:256] generating profile certs ...
I0421 19:39:34.770506 54509 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/client.key
I0421 19:39:34.770526 54509 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/client.crt with IP's: []
I0421 19:39:34.915440 54509 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/client.crt ...
I0421 19:39:34.915477 54509 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/client.crt: {Name:mk6a8b686c37047249f490f5450772b6c7b4bbb0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0421 19:39:34.915681 54509 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/client.key ...
I0421 19:39:34.915714 54509 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/client.key: {Name:mk2ebec5c0312b9011b099a2d232048b922ddfc1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0421 19:39:34.915864 54509 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/apiserver.key.ada31577
I0421 19:39:34.915892 54509 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/apiserver.crt.ada31577 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.42]
I0421 19:39:35.146258 54509 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/apiserver.crt.ada31577 ...
I0421 19:39:35.146286 54509 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/apiserver.crt.ada31577: {Name:mkb81675dd06b08c1e57439c47dbc83ccf29942f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0421 19:39:35.146477 54509 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/apiserver.key.ada31577 ...
I0421 19:39:35.146499 54509 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/apiserver.key.ada31577: {Name:mkb5d83f46b01690f82921fafb6c0aa95cac6775 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0421 19:39:35.146617 54509 certs.go:381] copying /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/apiserver.crt.ada31577 -> /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/apiserver.crt
I0421 19:39:35.146713 54509 certs.go:385] copying /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/apiserver.key.ada31577 -> /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/apiserver.key
I0421 19:39:35.146795 54509 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/proxy-client.key
I0421 19:39:35.146817 54509 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/proxy-client.crt with IP's: []
I0421 19:39:35.391691 54509 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/proxy-client.crt ...
I0421 19:39:35.391720 54509 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/proxy-client.crt: {Name:mka9c3ac375259d465c4a299e9c552118ca1c0fb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0421 19:39:35.436552 54509 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/proxy-client.key ...
I0421 19:39:35.436592 54509 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/proxy-client.key: {Name:mk9332fcd8fa524dc019490410c206d89d341c36 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0421 19:39:35.436864 54509 certs.go:484] found cert: /home/jenkins/minikube-integration/18702-3854/.minikube/certs/11175.pem (1338 bytes)
W0421 19:39:35.436916 54509 certs.go:480] ignoring /home/jenkins/minikube-integration/18702-3854/.minikube/certs/11175_empty.pem, impossibly tiny 0 bytes
I0421 19:39:35.436933 54509 certs.go:484] found cert: /home/jenkins/minikube-integration/18702-3854/.minikube/certs/ca-key.pem (1675 bytes)
I0421 19:39:35.436971 54509 certs.go:484] found cert: /home/jenkins/minikube-integration/18702-3854/.minikube/certs/ca.pem (1078 bytes)
I0421 19:39:35.437005 54509 certs.go:484] found cert: /home/jenkins/minikube-integration/18702-3854/.minikube/certs/cert.pem (1123 bytes)
I0421 19:39:35.437038 54509 certs.go:484] found cert: /home/jenkins/minikube-integration/18702-3854/.minikube/certs/key.pem (1679 bytes)
I0421 19:39:35.437098 54509 certs.go:484] found cert: /home/jenkins/minikube-integration/18702-3854/.minikube/files/etc/ssl/certs/111752.pem (1708 bytes)
I0421 19:39:35.437647 54509 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18702-3854/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0421 19:39:35.467124 54509 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18702-3854/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0421 19:39:35.499512 54509 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18702-3854/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0421 19:39:35.530398 54509 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18702-3854/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0421 19:39:35.562705 54509 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0421 19:39:35.589140 54509 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0421 19:39:35.622251 54509 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0421 19:39:35.657505 54509 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18702-3854/.minikube/profiles/old-k8s-version-867585/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0421 19:39:35.696665 54509 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18702-3854/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0421 19:39:35.723234 54509 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18702-3854/.minikube/certs/11175.pem --> /usr/share/ca-certificates/11175.pem (1338 bytes)
I0421 19:39:35.754345 54509 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18702-3854/.minikube/files/etc/ssl/certs/111752.pem --> /usr/share/ca-certificates/111752.pem (1708 bytes)
I0421 19:39:35.800967 54509 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0421 19:39:35.837787 54509 ssh_runner.go:195] Run: openssl version
I0421 19:39:35.845076 54509 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/111752.pem && ln -fs /usr/share/ca-certificates/111752.pem /etc/ssl/certs/111752.pem"
I0421 19:39:35.861038 54509 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/111752.pem
I0421 19:39:35.868103 54509 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 21 18:35 /usr/share/ca-certificates/111752.pem
I0421 19:39:35.868174 54509 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/111752.pem
I0421 19:39:35.876859 54509 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/111752.pem /etc/ssl/certs/3ec20f2e.0"
I0421 19:39:35.894346 54509 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0421 19:39:35.909660 54509 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0421 19:39:35.915550 54509 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 21 18:23 /usr/share/ca-certificates/minikubeCA.pem
I0421 19:39:35.915623 54509 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0421 19:39:35.922687 54509 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0421 19:39:35.939713 54509 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11175.pem && ln -fs /usr/share/ca-certificates/11175.pem /etc/ssl/certs/11175.pem"
I0421 19:39:35.954310 54509 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11175.pem
I0421 19:39:35.960084 54509 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 21 18:35 /usr/share/ca-certificates/11175.pem
I0421 19:39:35.960151 54509 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11175.pem
I0421 19:39:35.966979 54509 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11175.pem /etc/ssl/certs/51391683.0"
I0421 19:39:35.986795 54509 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0421 19:39:35.994493 54509 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0421 19:39:35.994553 54509 kubeadm.go:391] StartCluster: {Name:old-k8s-version-867585 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.33.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713569670-18702@sha256:1db7a12e122807eaef46d49daa14095f818f9bfb653fcf62060f6eb507c1f0d8 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-ver
sion-867585 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.42 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:d
ocker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0421 19:39:35.994636 54509 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0421 19:39:35.994691 54509 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0421 19:39:36.045155 54509 cri.go:89] found id: ""
I0421 19:39:36.045238 54509 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0421 19:39:36.062148 54509 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0421 19:39:36.078146 54509 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0421 19:39:36.094560 54509 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0421 19:39:36.094582 54509 kubeadm.go:156] found existing configuration files:
I0421 19:39:36.094650 54509 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0421 19:39:36.110455 54509 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0421 19:39:36.110538 54509 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0421 19:39:36.128052 54509 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0421 19:39:36.144540 54509 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0421 19:39:36.144619 54509 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0421 19:39:36.161989 54509 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0421 19:39:36.178846 54509 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0421 19:39:36.178914 54509 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0421 19:39:36.194039 54509 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0421 19:39:36.206124 54509 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0421 19:39:36.206210 54509 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0421 19:39:36.223609 54509 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0421 19:39:36.371731 54509 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0421 19:39:36.371866 54509 kubeadm.go:309] [preflight] Running pre-flight checks
I0421 19:39:36.556729 54509 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0421 19:39:36.556867 54509 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0421 19:39:36.556990 54509 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0421 19:39:36.825339 54509 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0421 19:39:36.826980 54509 out.go:204] - Generating certificates and keys ...
I0421 19:39:36.827075 54509 kubeadm.go:309] [certs] Using existing ca certificate authority
I0421 19:39:36.827158 54509 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0421 19:39:37.078161 54509 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0421 19:39:37.316663 54509 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0421 19:39:37.422212 54509 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0421 19:39:37.755668 54509 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0421 19:39:37.838990 54509 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0421 19:39:37.839160 54509 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-867585] and IPs [192.168.50.42 127.0.0.1 ::1]
I0421 19:39:37.989278 54509 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0421 19:39:37.989494 54509 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-867585] and IPs [192.168.50.42 127.0.0.1 ::1]
I0421 19:39:38.245142 54509 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0421 19:39:38.667390 54509 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0421 19:39:38.951333 54509 kubeadm.go:309] [certs] Generating "sa" key and public key
I0421 19:39:38.951751 54509 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0421 19:39:39.095323 54509 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0421 19:39:39.211487 54509 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0421 19:39:39.386286 54509 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0421 19:39:39.500502 54509 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0421 19:39:39.519666 54509 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0421 19:39:39.521463 54509 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0421 19:39:39.521535 54509 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0421 19:39:39.672563 54509 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0421 19:39:39.674757 54509 out.go:204] - Booting up control plane ...
I0421 19:39:39.674889 54509 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0421 19:39:39.687967 54509 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0421 19:39:39.688072 54509 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0421 19:39:39.689763 54509 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0421 19:39:39.694025 54509 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0421 19:40:19.691826 54509 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0421 19:40:19.691936 54509 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0421 19:40:19.692298 54509 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0421 19:40:24.693158 54509 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0421 19:40:24.693479 54509 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0421 19:40:34.694027 54509 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0421 19:40:34.694280 54509 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0421 19:40:54.695591 54509 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0421 19:40:54.695909 54509 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0421 19:41:34.695409 54509 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0421 19:41:34.695657 54509 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0421 19:41:34.695671 54509 kubeadm.go:309]
I0421 19:41:34.695720 54509 kubeadm.go:309] Unfortunately, an error has occurred:
I0421 19:41:34.695777 54509 kubeadm.go:309] timed out waiting for the condition
I0421 19:41:34.695789 54509 kubeadm.go:309]
I0421 19:41:34.695867 54509 kubeadm.go:309] This error is likely caused by:
I0421 19:41:34.695927 54509 kubeadm.go:309] - The kubelet is not running
I0421 19:41:34.696069 54509 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0421 19:41:34.696080 54509 kubeadm.go:309]
I0421 19:41:34.696217 54509 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0421 19:41:34.696257 54509 kubeadm.go:309] - 'systemctl status kubelet'
I0421 19:41:34.696299 54509 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0421 19:41:34.696308 54509 kubeadm.go:309]
I0421 19:41:34.696468 54509 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0421 19:41:34.696592 54509 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0421 19:41:34.696601 54509 kubeadm.go:309]
I0421 19:41:34.696744 54509 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0421 19:41:34.696879 54509 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0421 19:41:34.696990 54509 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0421 19:41:34.697094 54509 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0421 19:41:34.697116 54509 kubeadm.go:309]
I0421 19:41:34.697751 54509 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0421 19:41:34.697884 54509 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0421 19:41:34.697970 54509 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0421 19:41:34.698134 54509 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-867585] and IPs [192.168.50.42 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-867585] and IPs [192.168.50.42 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-867585] and IPs [192.168.50.42 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-867585] and IPs [192.168.50.42 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0421 19:41:34.698178 54509 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0421 19:41:37.671012 54509 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.972783143s)
I0421 19:41:37.671097 54509 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0421 19:41:37.687639 54509 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0421 19:41:37.699870 54509 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0421 19:41:37.699892 54509 kubeadm.go:156] found existing configuration files:
I0421 19:41:37.699940 54509 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0421 19:41:37.711659 54509 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0421 19:41:37.711743 54509 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0421 19:41:37.723427 54509 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0421 19:41:37.734412 54509 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0421 19:41:37.734470 54509 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0421 19:41:37.745573 54509 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0421 19:41:37.756644 54509 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0421 19:41:37.756708 54509 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0421 19:41:37.768688 54509 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0421 19:41:37.779405 54509 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0421 19:41:37.779475 54509 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0421 19:41:37.790281 54509 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0421 19:41:37.861649 54509 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0421 19:41:37.861752 54509 kubeadm.go:309] [preflight] Running pre-flight checks
I0421 19:41:38.027449 54509 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0421 19:41:38.027547 54509 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0421 19:41:38.027678 54509 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0421 19:41:38.255934 54509 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0421 19:41:38.257851 54509 out.go:204] - Generating certificates and keys ...
I0421 19:41:38.257948 54509 kubeadm.go:309] [certs] Using existing ca certificate authority
I0421 19:41:38.258040 54509 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0421 19:41:38.258170 54509 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0421 19:41:38.258265 54509 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0421 19:41:38.258387 54509 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0421 19:41:38.258460 54509 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0421 19:41:38.258837 54509 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0421 19:41:38.259400 54509 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0421 19:41:38.259845 54509 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0421 19:41:38.260229 54509 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0421 19:41:38.260280 54509 kubeadm.go:309] [certs] Using the existing "sa" key
I0421 19:41:38.260379 54509 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0421 19:41:38.412634 54509 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0421 19:41:38.679570 54509 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0421 19:41:38.782146 54509 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0421 19:41:38.930665 54509 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0421 19:41:38.945511 54509 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0421 19:41:38.946671 54509 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0421 19:41:38.946848 54509 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0421 19:41:39.126742 54509 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0421 19:41:39.128395 54509 out.go:204] - Booting up control plane ...
I0421 19:41:39.128502 54509 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0421 19:41:39.139592 54509 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0421 19:41:39.139689 54509 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0421 19:41:39.141907 54509 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0421 19:41:39.146753 54509 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0421 19:42:19.148850 54509 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0421 19:42:19.149091 54509 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0421 19:42:19.149850 54509 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0421 19:42:24.151018 54509 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0421 19:42:24.151244 54509 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0421 19:42:34.151953 54509 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0421 19:42:34.152169 54509 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0421 19:42:54.153478 54509 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0421 19:42:54.153723 54509 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0421 19:43:34.153619 54509 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0421 19:43:34.153836 54509 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0421 19:43:34.153853 54509 kubeadm.go:309]
I0421 19:43:34.153907 54509 kubeadm.go:309] Unfortunately, an error has occurred:
I0421 19:43:34.153947 54509 kubeadm.go:309] timed out waiting for the condition
I0421 19:43:34.153954 54509 kubeadm.go:309]
I0421 19:43:34.153983 54509 kubeadm.go:309] This error is likely caused by:
I0421 19:43:34.154039 54509 kubeadm.go:309] - The kubelet is not running
I0421 19:43:34.154236 54509 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0421 19:43:34.154251 54509 kubeadm.go:309]
I0421 19:43:34.154388 54509 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0421 19:43:34.154442 54509 kubeadm.go:309] - 'systemctl status kubelet'
I0421 19:43:34.154487 54509 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0421 19:43:34.154499 54509 kubeadm.go:309]
I0421 19:43:34.154637 54509 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0421 19:43:34.154781 54509 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0421 19:43:34.154794 54509 kubeadm.go:309]
I0421 19:43:34.154941 54509 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0421 19:43:34.155073 54509 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0421 19:43:34.155211 54509 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0421 19:43:34.155326 54509 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0421 19:43:34.155354 54509 kubeadm.go:309]
I0421 19:43:34.155772 54509 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0421 19:43:34.155881 54509 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0421 19:43:34.155943 54509 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0421 19:43:34.156000 54509 kubeadm.go:393] duration metric: took 3m58.161452319s to StartCluster
I0421 19:43:34.156054 54509 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0421 19:43:34.156107 54509 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0421 19:43:34.205254 54509 cri.go:89] found id: ""
I0421 19:43:34.205280 54509 logs.go:276] 0 containers: []
W0421 19:43:34.205289 54509 logs.go:278] No container was found matching "kube-apiserver"
I0421 19:43:34.205295 54509 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0421 19:43:34.205343 54509 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0421 19:43:34.244867 54509 cri.go:89] found id: ""
I0421 19:43:34.244897 54509 logs.go:276] 0 containers: []
W0421 19:43:34.244905 54509 logs.go:278] No container was found matching "etcd"
I0421 19:43:34.244911 54509 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0421 19:43:34.244959 54509 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0421 19:43:34.282550 54509 cri.go:89] found id: ""
I0421 19:43:34.282580 54509 logs.go:276] 0 containers: []
W0421 19:43:34.282592 54509 logs.go:278] No container was found matching "coredns"
I0421 19:43:34.282600 54509 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0421 19:43:34.282663 54509 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0421 19:43:34.323222 54509 cri.go:89] found id: ""
I0421 19:43:34.323246 54509 logs.go:276] 0 containers: []
W0421 19:43:34.323255 54509 logs.go:278] No container was found matching "kube-scheduler"
I0421 19:43:34.323260 54509 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0421 19:43:34.323314 54509 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0421 19:43:34.365557 54509 cri.go:89] found id: ""
I0421 19:43:34.365588 54509 logs.go:276] 0 containers: []
W0421 19:43:34.365599 54509 logs.go:278] No container was found matching "kube-proxy"
I0421 19:43:34.365606 54509 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0421 19:43:34.365668 54509 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0421 19:43:34.403535 54509 cri.go:89] found id: ""
I0421 19:43:34.403565 54509 logs.go:276] 0 containers: []
W0421 19:43:34.403575 54509 logs.go:278] No container was found matching "kube-controller-manager"
I0421 19:43:34.403584 54509 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0421 19:43:34.403642 54509 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0421 19:43:34.442249 54509 cri.go:89] found id: ""
I0421 19:43:34.442278 54509 logs.go:276] 0 containers: []
W0421 19:43:34.442289 54509 logs.go:278] No container was found matching "kindnet"
I0421 19:43:34.442299 54509 logs.go:123] Gathering logs for kubelet ...
I0421 19:43:34.442314 54509 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0421 19:43:34.494252 54509 logs.go:123] Gathering logs for dmesg ...
I0421 19:43:34.494285 54509 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0421 19:43:34.509636 54509 logs.go:123] Gathering logs for describe nodes ...
I0421 19:43:34.509663 54509 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0421 19:43:34.632229 54509 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0421 19:43:34.632255 54509 logs.go:123] Gathering logs for CRI-O ...
I0421 19:43:34.632272 54509 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0421 19:43:34.731122 54509 logs.go:123] Gathering logs for container status ...
I0421 19:43:34.731159 54509 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0421 19:43:34.785839 54509 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0421 19:43:34.785893 54509 out.go:239] *
*
W0421 19:43:34.785952 54509 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0421 19:43:34.785982 54509 out.go:239] *
*
W0421 19:43:34.787187 54509 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0421 19:43:34.790722 54509 out.go:177]
W0421 19:43:34.791989 54509 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0421 19:43:34.792038 54509 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0421 19:43:34.792060 54509 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0421 19:43:34.794683 54509 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-867585 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-867585 -n old-k8s-version-867585
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-867585 -n old-k8s-version-867585: exit status 6 (240.357926ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0421 19:43:35.079861 57328 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-867585" does not appear in /home/jenkins/minikube-integration/18702-3854/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-867585" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (288.61s)