=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-367072 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
E0422 18:15:07.902462 18884 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/addons-934361/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-367072 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m37.161525715s)
-- stdout --
* [old-k8s-version-367072] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=18706
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/18706-11572/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/18706-11572/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-367072" primary control-plane node in "old-k8s-version-367072" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0422 18:15:05.483379 70624 out.go:291] Setting OutFile to fd 1 ...
I0422 18:15:05.483667 70624 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0422 18:15:05.483701 70624 out.go:304] Setting ErrFile to fd 2...
I0422 18:15:05.483717 70624 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0422 18:15:05.484166 70624 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18706-11572/.minikube/bin
I0422 18:15:05.485223 70624 out.go:298] Setting JSON to false
I0422 18:15:05.486301 70624 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":7051,"bootTime":1713802655,"procs":297,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0422 18:15:05.486368 70624 start.go:139] virtualization: kvm guest
I0422 18:15:05.489103 70624 out.go:177] * [old-k8s-version-367072] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)
I0422 18:15:05.490668 70624 out.go:177] - MINIKUBE_LOCATION=18706
I0422 18:15:05.490686 70624 notify.go:220] Checking for updates...
I0422 18:15:05.492244 70624 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0422 18:15:05.494019 70624 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/18706-11572/kubeconfig
I0422 18:15:05.495649 70624 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/18706-11572/.minikube
I0422 18:15:05.497015 70624 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0422 18:15:05.498396 70624 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0422 18:15:05.500339 70624 config.go:182] Loaded profile config "bridge-457191": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0422 18:15:05.500497 70624 config.go:182] Loaded profile config "calico-457191": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0422 18:15:05.500632 70624 config.go:182] Loaded profile config "flannel-457191": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0
I0422 18:15:05.500790 70624 driver.go:392] Setting default libvirt URI to qemu:///system
I0422 18:15:05.538551 70624 out.go:177] * Using the kvm2 driver based on user configuration
I0422 18:15:05.539894 70624 start.go:297] selected driver: kvm2
I0422 18:15:05.539910 70624 start.go:901] validating driver "kvm2" against <nil>
I0422 18:15:05.539923 70624 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0422 18:15:05.540701 70624 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0422 18:15:05.540776 70624 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18706-11572/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0422 18:15:05.556106 70624 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0
I0422 18:15:05.556168 70624 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0422 18:15:05.556387 70624 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0422 18:15:05.556465 70624 cni.go:84] Creating CNI manager for ""
I0422 18:15:05.556489 70624 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0422 18:15:05.556502 70624 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0422 18:15:05.556572 70624 start.go:340] cluster config:
{Name:old-k8s-version-367072 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-367072 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0422 18:15:05.556686 70624 iso.go:125] acquiring lock: {Name:mk1b12d9597d526423aa9e018b261917a87c343d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0422 18:15:05.558672 70624 out.go:177] * Starting "old-k8s-version-367072" primary control-plane node in "old-k8s-version-367072" cluster
I0422 18:15:05.560008 70624 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0422 18:15:05.560056 70624 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18706-11572/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0422 18:15:05.560063 70624 cache.go:56] Caching tarball of preloaded images
I0422 18:15:05.560160 70624 preload.go:173] Found /home/jenkins/minikube-integration/18706-11572/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0422 18:15:05.560177 70624 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0422 18:15:05.560293 70624 profile.go:143] Saving config to /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/config.json ...
I0422 18:15:05.560315 70624 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/config.json: {Name:mk657450927ff58f96fa3de4d1e9eca2a32e43f1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0422 18:15:05.560447 70624 start.go:360] acquireMachinesLock for old-k8s-version-367072: {Name:mk64c43b652bcca7a12d3e78dcc142e8b5982f60 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0422 18:15:05.560486 70624 start.go:364] duration metric: took 17.03µs to acquireMachinesLock for "old-k8s-version-367072"
I0422 18:15:05.560504 70624 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-367072 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-367072 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0422 18:15:05.560562 70624 start.go:125] createHost starting for "" (driver="kvm2")
I0422 18:15:05.562333 70624 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0422 18:15:05.562514 70624 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0422 18:15:05.562561 70624 main.go:141] libmachine: Launching plugin server for driver kvm2
I0422 18:15:05.577990 70624 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37139
I0422 18:15:05.578524 70624 main.go:141] libmachine: () Calling .GetVersion
I0422 18:15:05.579098 70624 main.go:141] libmachine: Using API Version 1
I0422 18:15:05.579133 70624 main.go:141] libmachine: () Calling .SetConfigRaw
I0422 18:15:05.579481 70624 main.go:141] libmachine: () Calling .GetMachineName
I0422 18:15:05.579694 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetMachineName
I0422 18:15:05.579864 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .DriverName
I0422 18:15:05.580036 70624 start.go:159] libmachine.API.Create for "old-k8s-version-367072" (driver="kvm2")
I0422 18:15:05.580064 70624 client.go:168] LocalClient.Create starting
I0422 18:15:05.580102 70624 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18706-11572/.minikube/certs/ca.pem
I0422 18:15:05.580153 70624 main.go:141] libmachine: Decoding PEM data...
I0422 18:15:05.580176 70624 main.go:141] libmachine: Parsing certificate...
I0422 18:15:05.580240 70624 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18706-11572/.minikube/certs/cert.pem
I0422 18:15:05.580276 70624 main.go:141] libmachine: Decoding PEM data...
I0422 18:15:05.580292 70624 main.go:141] libmachine: Parsing certificate...
I0422 18:15:05.580313 70624 main.go:141] libmachine: Running pre-create checks...
I0422 18:15:05.580322 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .PreCreateCheck
I0422 18:15:05.580773 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetConfigRaw
I0422 18:15:05.581235 70624 main.go:141] libmachine: Creating machine...
I0422 18:15:05.581255 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .Create
I0422 18:15:05.581419 70624 main.go:141] libmachine: (old-k8s-version-367072) Creating KVM machine...
I0422 18:15:05.582783 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found existing default KVM network
I0422 18:15:05.584287 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:05.584086 70646 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:9d:98:b4} reservation:<nil>}
I0422 18:15:05.585359 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:05.585261 70646 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:e4:a0:9e} reservation:<nil>}
I0422 18:15:05.586380 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:05.586291 70646 network.go:211] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:c5:c0:e9} reservation:<nil>}
I0422 18:15:05.587459 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:05.587367 70646 network.go:206] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000328710}
I0422 18:15:05.587482 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | created network xml:
I0422 18:15:05.587496 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | <network>
I0422 18:15:05.587511 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | <name>mk-old-k8s-version-367072</name>
I0422 18:15:05.587522 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | <dns enable='no'/>
I0422 18:15:05.587532 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG |
I0422 18:15:05.587543 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | <ip address='192.168.72.1' netmask='255.255.255.0'>
I0422 18:15:05.587555 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | <dhcp>
I0422 18:15:05.587567 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | <range start='192.168.72.2' end='192.168.72.253'/>
I0422 18:15:05.587578 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | </dhcp>
I0422 18:15:05.587588 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | </ip>
I0422 18:15:05.587598 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG |
I0422 18:15:05.587610 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | </network>
I0422 18:15:05.587622 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG |
I0422 18:15:05.593120 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | trying to create private KVM network mk-old-k8s-version-367072 192.168.72.0/24...
I0422 18:15:05.680488 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | private KVM network mk-old-k8s-version-367072 192.168.72.0/24 created
I0422 18:15:05.680686 70624 main.go:141] libmachine: (old-k8s-version-367072) Setting up store path in /home/jenkins/minikube-integration/18706-11572/.minikube/machines/old-k8s-version-367072 ...
I0422 18:15:05.680719 70624 main.go:141] libmachine: (old-k8s-version-367072) Building disk image from file:///home/jenkins/minikube-integration/18706-11572/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso
I0422 18:15:05.680751 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:05.680610 70646 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18706-11572/.minikube
I0422 18:15:05.680846 70624 main.go:141] libmachine: (old-k8s-version-367072) Downloading /home/jenkins/minikube-integration/18706-11572/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18706-11572/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...
I0422 18:15:05.916869 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:05.916723 70646 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18706-11572/.minikube/machines/old-k8s-version-367072/id_rsa...
I0422 18:15:06.136026 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:06.135881 70646 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18706-11572/.minikube/machines/old-k8s-version-367072/old-k8s-version-367072.rawdisk...
I0422 18:15:06.136065 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Writing magic tar header
I0422 18:15:06.136084 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Writing SSH key tar header
I0422 18:15:06.136097 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:06.136034 70646 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18706-11572/.minikube/machines/old-k8s-version-367072 ...
I0422 18:15:06.136184 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18706-11572/.minikube/machines/old-k8s-version-367072
I0422 18:15:06.136227 70624 main.go:141] libmachine: (old-k8s-version-367072) Setting executable bit set on /home/jenkins/minikube-integration/18706-11572/.minikube/machines/old-k8s-version-367072 (perms=drwx------)
I0422 18:15:06.136244 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18706-11572/.minikube/machines
I0422 18:15:06.136263 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18706-11572/.minikube
I0422 18:15:06.136275 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18706-11572
I0422 18:15:06.136290 70624 main.go:141] libmachine: (old-k8s-version-367072) Setting executable bit set on /home/jenkins/minikube-integration/18706-11572/.minikube/machines (perms=drwxr-xr-x)
I0422 18:15:06.136304 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0422 18:15:06.136317 70624 main.go:141] libmachine: (old-k8s-version-367072) Setting executable bit set on /home/jenkins/minikube-integration/18706-11572/.minikube (perms=drwxr-xr-x)
I0422 18:15:06.136329 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Checking permissions on dir: /home/jenkins
I0422 18:15:06.136342 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Checking permissions on dir: /home
I0422 18:15:06.136353 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Skipping /home - not owner
I0422 18:15:06.136366 70624 main.go:141] libmachine: (old-k8s-version-367072) Setting executable bit set on /home/jenkins/minikube-integration/18706-11572 (perms=drwxrwxr-x)
I0422 18:15:06.136385 70624 main.go:141] libmachine: (old-k8s-version-367072) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0422 18:15:06.136397 70624 main.go:141] libmachine: (old-k8s-version-367072) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0422 18:15:06.136415 70624 main.go:141] libmachine: (old-k8s-version-367072) Creating domain...
I0422 18:15:06.137555 70624 main.go:141] libmachine: (old-k8s-version-367072) define libvirt domain using xml:
I0422 18:15:06.137585 70624 main.go:141] libmachine: (old-k8s-version-367072) <domain type='kvm'>
I0422 18:15:06.137596 70624 main.go:141] libmachine: (old-k8s-version-367072) <name>old-k8s-version-367072</name>
I0422 18:15:06.137612 70624 main.go:141] libmachine: (old-k8s-version-367072) <memory unit='MiB'>2200</memory>
I0422 18:15:06.137625 70624 main.go:141] libmachine: (old-k8s-version-367072) <vcpu>2</vcpu>
I0422 18:15:06.137634 70624 main.go:141] libmachine: (old-k8s-version-367072) <features>
I0422 18:15:06.137644 70624 main.go:141] libmachine: (old-k8s-version-367072) <acpi/>
I0422 18:15:06.137651 70624 main.go:141] libmachine: (old-k8s-version-367072) <apic/>
I0422 18:15:06.137656 70624 main.go:141] libmachine: (old-k8s-version-367072) <pae/>
I0422 18:15:06.137663 70624 main.go:141] libmachine: (old-k8s-version-367072)
I0422 18:15:06.137668 70624 main.go:141] libmachine: (old-k8s-version-367072) </features>
I0422 18:15:06.137675 70624 main.go:141] libmachine: (old-k8s-version-367072) <cpu mode='host-passthrough'>
I0422 18:15:06.137705 70624 main.go:141] libmachine: (old-k8s-version-367072)
I0422 18:15:06.137729 70624 main.go:141] libmachine: (old-k8s-version-367072) </cpu>
I0422 18:15:06.137743 70624 main.go:141] libmachine: (old-k8s-version-367072) <os>
I0422 18:15:06.137754 70624 main.go:141] libmachine: (old-k8s-version-367072) <type>hvm</type>
I0422 18:15:06.137764 70624 main.go:141] libmachine: (old-k8s-version-367072) <boot dev='cdrom'/>
I0422 18:15:06.137774 70624 main.go:141] libmachine: (old-k8s-version-367072) <boot dev='hd'/>
I0422 18:15:06.137789 70624 main.go:141] libmachine: (old-k8s-version-367072) <bootmenu enable='no'/>
I0422 18:15:06.137800 70624 main.go:141] libmachine: (old-k8s-version-367072) </os>
I0422 18:15:06.137830 70624 main.go:141] libmachine: (old-k8s-version-367072) <devices>
I0422 18:15:06.137845 70624 main.go:141] libmachine: (old-k8s-version-367072) <disk type='file' device='cdrom'>
I0422 18:15:06.137861 70624 main.go:141] libmachine: (old-k8s-version-367072) <source file='/home/jenkins/minikube-integration/18706-11572/.minikube/machines/old-k8s-version-367072/boot2docker.iso'/>
I0422 18:15:06.137874 70624 main.go:141] libmachine: (old-k8s-version-367072) <target dev='hdc' bus='scsi'/>
I0422 18:15:06.137884 70624 main.go:141] libmachine: (old-k8s-version-367072) <readonly/>
I0422 18:15:06.137901 70624 main.go:141] libmachine: (old-k8s-version-367072) </disk>
I0422 18:15:06.137918 70624 main.go:141] libmachine: (old-k8s-version-367072) <disk type='file' device='disk'>
I0422 18:15:06.137934 70624 main.go:141] libmachine: (old-k8s-version-367072) <driver name='qemu' type='raw' cache='default' io='threads' />
I0422 18:15:06.137951 70624 main.go:141] libmachine: (old-k8s-version-367072) <source file='/home/jenkins/minikube-integration/18706-11572/.minikube/machines/old-k8s-version-367072/old-k8s-version-367072.rawdisk'/>
I0422 18:15:06.137965 70624 main.go:141] libmachine: (old-k8s-version-367072) <target dev='hda' bus='virtio'/>
I0422 18:15:06.137971 70624 main.go:141] libmachine: (old-k8s-version-367072) </disk>
I0422 18:15:06.137981 70624 main.go:141] libmachine: (old-k8s-version-367072) <interface type='network'>
I0422 18:15:06.137992 70624 main.go:141] libmachine: (old-k8s-version-367072) <source network='mk-old-k8s-version-367072'/>
I0422 18:15:06.138001 70624 main.go:141] libmachine: (old-k8s-version-367072) <model type='virtio'/>
I0422 18:15:06.138012 70624 main.go:141] libmachine: (old-k8s-version-367072) </interface>
I0422 18:15:06.138040 70624 main.go:141] libmachine: (old-k8s-version-367072) <interface type='network'>
I0422 18:15:06.138061 70624 main.go:141] libmachine: (old-k8s-version-367072) <source network='default'/>
I0422 18:15:06.138071 70624 main.go:141] libmachine: (old-k8s-version-367072) <model type='virtio'/>
I0422 18:15:06.138078 70624 main.go:141] libmachine: (old-k8s-version-367072) </interface>
I0422 18:15:06.138088 70624 main.go:141] libmachine: (old-k8s-version-367072) <serial type='pty'>
I0422 18:15:06.138096 70624 main.go:141] libmachine: (old-k8s-version-367072) <target port='0'/>
I0422 18:15:06.138105 70624 main.go:141] libmachine: (old-k8s-version-367072) </serial>
I0422 18:15:06.138110 70624 main.go:141] libmachine: (old-k8s-version-367072) <console type='pty'>
I0422 18:15:06.138116 70624 main.go:141] libmachine: (old-k8s-version-367072) <target type='serial' port='0'/>
I0422 18:15:06.138122 70624 main.go:141] libmachine: (old-k8s-version-367072) </console>
I0422 18:15:06.138132 70624 main.go:141] libmachine: (old-k8s-version-367072) <rng model='virtio'>
I0422 18:15:06.138146 70624 main.go:141] libmachine: (old-k8s-version-367072) <backend model='random'>/dev/random</backend>
I0422 18:15:06.138166 70624 main.go:141] libmachine: (old-k8s-version-367072) </rng>
I0422 18:15:06.138172 70624 main.go:141] libmachine: (old-k8s-version-367072)
I0422 18:15:06.138180 70624 main.go:141] libmachine: (old-k8s-version-367072)
I0422 18:15:06.138187 70624 main.go:141] libmachine: (old-k8s-version-367072) </devices>
I0422 18:15:06.138195 70624 main.go:141] libmachine: (old-k8s-version-367072) </domain>
I0422 18:15:06.138199 70624 main.go:141] libmachine: (old-k8s-version-367072)
I0422 18:15:06.142592 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:00:dd:8a in network default
I0422 18:15:06.143372 70624 main.go:141] libmachine: (old-k8s-version-367072) Ensuring networks are active...
I0422 18:15:06.143411 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:06.144163 70624 main.go:141] libmachine: (old-k8s-version-367072) Ensuring network default is active
I0422 18:15:06.144516 70624 main.go:141] libmachine: (old-k8s-version-367072) Ensuring network mk-old-k8s-version-367072 is active
I0422 18:15:06.145050 70624 main.go:141] libmachine: (old-k8s-version-367072) Getting domain xml...
I0422 18:15:06.145796 70624 main.go:141] libmachine: (old-k8s-version-367072) Creating domain...
I0422 18:15:07.460551 70624 main.go:141] libmachine: (old-k8s-version-367072) Waiting to get IP...
I0422 18:15:07.461380 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:07.461865 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find current IP address of domain old-k8s-version-367072 in network mk-old-k8s-version-367072
I0422 18:15:07.461885 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:07.461840 70646 retry.go:31] will retry after 300.118483ms: waiting for machine to come up
I0422 18:15:07.763362 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:07.764006 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find current IP address of domain old-k8s-version-367072 in network mk-old-k8s-version-367072
I0422 18:15:07.764034 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:07.763952 70646 retry.go:31] will retry after 318.314093ms: waiting for machine to come up
I0422 18:15:08.084484 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:08.085028 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find current IP address of domain old-k8s-version-367072 in network mk-old-k8s-version-367072
I0422 18:15:08.085058 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:08.084975 70646 retry.go:31] will retry after 334.27639ms: waiting for machine to come up
I0422 18:15:08.421587 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:08.422225 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find current IP address of domain old-k8s-version-367072 in network mk-old-k8s-version-367072
I0422 18:15:08.422259 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:08.422156 70646 retry.go:31] will retry after 446.758979ms: waiting for machine to come up
I0422 18:15:08.870915 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:08.871906 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find current IP address of domain old-k8s-version-367072 in network mk-old-k8s-version-367072
I0422 18:15:08.871929 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:08.871616 70646 retry.go:31] will retry after 544.631271ms: waiting for machine to come up
I0422 18:15:09.419152 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:09.419911 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find current IP address of domain old-k8s-version-367072 in network mk-old-k8s-version-367072
I0422 18:15:09.419935 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:09.419823 70646 retry.go:31] will retry after 886.785954ms: waiting for machine to come up
I0422 18:15:10.308263 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:10.308799 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find current IP address of domain old-k8s-version-367072 in network mk-old-k8s-version-367072
I0422 18:15:10.308827 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:10.308746 70646 retry.go:31] will retry after 841.779806ms: waiting for machine to come up
I0422 18:15:11.152266 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:11.153261 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find current IP address of domain old-k8s-version-367072 in network mk-old-k8s-version-367072
I0422 18:15:11.153293 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:11.153175 70646 retry.go:31] will retry after 1.181330081s: waiting for machine to come up
I0422 18:15:12.336292 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:12.336934 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find current IP address of domain old-k8s-version-367072 in network mk-old-k8s-version-367072
I0422 18:15:12.336964 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:12.336915 70646 retry.go:31] will retry after 1.485855113s: waiting for machine to come up
I0422 18:15:13.824472 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:13.825097 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find current IP address of domain old-k8s-version-367072 in network mk-old-k8s-version-367072
I0422 18:15:13.825126 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:13.825001 70646 retry.go:31] will retry after 2.327106352s: waiting for machine to come up
I0422 18:15:16.153493 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:16.155236 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find current IP address of domain old-k8s-version-367072 in network mk-old-k8s-version-367072
I0422 18:15:16.155261 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:16.155182 70646 retry.go:31] will retry after 2.698896485s: waiting for machine to come up
I0422 18:15:18.857791 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:18.858623 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find current IP address of domain old-k8s-version-367072 in network mk-old-k8s-version-367072
I0422 18:15:18.858643 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:18.858531 70646 retry.go:31] will retry after 2.780670501s: waiting for machine to come up
I0422 18:15:21.641219 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:21.641681 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find current IP address of domain old-k8s-version-367072 in network mk-old-k8s-version-367072
I0422 18:15:21.641710 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:21.641641 70646 retry.go:31] will retry after 3.170110693s: waiting for machine to come up
I0422 18:15:24.814099 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:24.814709 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find current IP address of domain old-k8s-version-367072 in network mk-old-k8s-version-367072
I0422 18:15:24.814755 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | I0422 18:15:24.814682 70646 retry.go:31] will retry after 5.306249298s: waiting for machine to come up
I0422 18:15:30.124190 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:30.124811 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has current primary IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:30.124846 70624 main.go:141] libmachine: (old-k8s-version-367072) Found IP for machine: 192.168.72.149
I0422 18:15:30.124859 70624 main.go:141] libmachine: (old-k8s-version-367072) Reserving static IP address...
I0422 18:15:30.125189 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-367072", mac: "52:54:00:82:9f:b2", ip: "192.168.72.149"} in network mk-old-k8s-version-367072
I0422 18:15:30.207013 70624 main.go:141] libmachine: (old-k8s-version-367072) Reserved static IP address: 192.168.72.149
I0422 18:15:30.207046 70624 main.go:141] libmachine: (old-k8s-version-367072) Waiting for SSH to be available...
I0422 18:15:30.207056 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Getting to WaitForSSH function...
I0422 18:15:30.210183 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:30.210518 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072
I0422 18:15:30.210545 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | unable to find defined IP address of network mk-old-k8s-version-367072 interface with MAC address 52:54:00:82:9f:b2
I0422 18:15:30.210646 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Using SSH client type: external
I0422 18:15:30.210676 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Using SSH private key: /home/jenkins/minikube-integration/18706-11572/.minikube/machines/old-k8s-version-367072/id_rsa (-rw-------)
I0422 18:15:30.210712 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18706-11572/.minikube/machines/old-k8s-version-367072/id_rsa -p 22] /usr/bin/ssh <nil>}
I0422 18:15:30.210743 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | About to run SSH command:
I0422 18:15:30.210757 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | exit 0
I0422 18:15:30.214557 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | SSH cmd err, output: exit status 255:
I0422 18:15:30.214588 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Error getting ssh command 'exit 0' : ssh command error:
I0422 18:15:30.214596 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | command : exit 0
I0422 18:15:30.214607 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | err : exit status 255
I0422 18:15:30.214641 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | output :
I0422 18:15:33.216357 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Getting to WaitForSSH function...
I0422 18:15:33.218985 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:33.219408 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:33.219434 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:33.219574 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Using SSH client type: external
I0422 18:15:33.219587 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Using SSH private key: /home/jenkins/minikube-integration/18706-11572/.minikube/machines/old-k8s-version-367072/id_rsa (-rw-------)
I0422 18:15:33.219608 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.149 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18706-11572/.minikube/machines/old-k8s-version-367072/id_rsa -p 22] /usr/bin/ssh <nil>}
I0422 18:15:33.219617 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | About to run SSH command:
I0422 18:15:33.219625 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | exit 0
I0422 18:15:33.343358 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | SSH cmd err, output: <nil>:
I0422 18:15:33.343647 70624 main.go:141] libmachine: (old-k8s-version-367072) KVM machine creation complete!
I0422 18:15:33.343976 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetConfigRaw
I0422 18:15:33.344446 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .DriverName
I0422 18:15:33.344669 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .DriverName
I0422 18:15:33.344821 70624 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0422 18:15:33.344837 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetState
I0422 18:15:33.346185 70624 main.go:141] libmachine: Detecting operating system of created instance...
I0422 18:15:33.346200 70624 main.go:141] libmachine: Waiting for SSH to be available...
I0422 18:15:33.346206 70624 main.go:141] libmachine: Getting to WaitForSSH function...
I0422 18:15:33.346212 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHHostname
I0422 18:15:33.348726 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:33.349132 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:33.349157 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:33.349326 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHPort
I0422 18:15:33.349481 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHKeyPath
I0422 18:15:33.349645 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHKeyPath
I0422 18:15:33.349749 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHUsername
I0422 18:15:33.349952 70624 main.go:141] libmachine: Using SSH client type: native
I0422 18:15:33.350124 70624 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.72.149 22 <nil> <nil>}
I0422 18:15:33.350135 70624 main.go:141] libmachine: About to run SSH command:
exit 0
I0422 18:15:33.454657 70624 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0422 18:15:33.454697 70624 main.go:141] libmachine: Detecting the provisioner...
I0422 18:15:33.454724 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHHostname
I0422 18:15:33.457720 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:33.458122 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:33.458161 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:33.458260 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHPort
I0422 18:15:33.458476 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHKeyPath
I0422 18:15:33.458681 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHKeyPath
I0422 18:15:33.458854 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHUsername
I0422 18:15:33.459029 70624 main.go:141] libmachine: Using SSH client type: native
I0422 18:15:33.459276 70624 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.72.149 22 <nil> <nil>}
I0422 18:15:33.459291 70624 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0422 18:15:33.568842 70624 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0422 18:15:33.568949 70624 main.go:141] libmachine: found compatible host: buildroot
I0422 18:15:33.568977 70624 main.go:141] libmachine: Provisioning with buildroot...
I0422 18:15:33.568994 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetMachineName
I0422 18:15:33.569256 70624 buildroot.go:166] provisioning hostname "old-k8s-version-367072"
I0422 18:15:33.569315 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetMachineName
I0422 18:15:33.569530 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHHostname
I0422 18:15:33.572055 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:33.572507 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:33.572541 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:33.572661 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHPort
I0422 18:15:33.572886 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHKeyPath
I0422 18:15:33.573051 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHKeyPath
I0422 18:15:33.573278 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHUsername
I0422 18:15:33.573462 70624 main.go:141] libmachine: Using SSH client type: native
I0422 18:15:33.573675 70624 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.72.149 22 <nil> <nil>}
I0422 18:15:33.573694 70624 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-367072 && echo "old-k8s-version-367072" | sudo tee /etc/hostname
I0422 18:15:33.694895 70624 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-367072
I0422 18:15:33.694929 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHHostname
I0422 18:15:33.697661 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:33.698036 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:33.698065 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:33.698256 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHPort
I0422 18:15:33.698444 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHKeyPath
I0422 18:15:33.698630 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHKeyPath
I0422 18:15:33.698781 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHUsername
I0422 18:15:33.698966 70624 main.go:141] libmachine: Using SSH client type: native
I0422 18:15:33.699156 70624 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.72.149 22 <nil> <nil>}
I0422 18:15:33.699181 70624 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-367072' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-367072/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-367072' | sudo tee -a /etc/hosts;
fi
fi
I0422 18:15:33.818813 70624 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0422 18:15:33.818846 70624 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18706-11572/.minikube CaCertPath:/home/jenkins/minikube-integration/18706-11572/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18706-11572/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18706-11572/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18706-11572/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18706-11572/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18706-11572/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18706-11572/.minikube}
I0422 18:15:33.818865 70624 buildroot.go:174] setting up certificates
I0422 18:15:33.818877 70624 provision.go:84] configureAuth start
I0422 18:15:33.818886 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetMachineName
I0422 18:15:33.819194 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetIP
I0422 18:15:33.822143 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:33.822547 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:33.822582 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:33.822680 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHHostname
I0422 18:15:33.825160 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:33.825497 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:33.825530 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:33.825710 70624 provision.go:143] copyHostCerts
I0422 18:15:33.825773 70624 exec_runner.go:144] found /home/jenkins/minikube-integration/18706-11572/.minikube/ca.pem, removing ...
I0422 18:15:33.825783 70624 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18706-11572/.minikube/ca.pem
I0422 18:15:33.825856 70624 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18706-11572/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18706-11572/.minikube/ca.pem (1078 bytes)
I0422 18:15:33.825951 70624 exec_runner.go:144] found /home/jenkins/minikube-integration/18706-11572/.minikube/cert.pem, removing ...
I0422 18:15:33.825958 70624 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18706-11572/.minikube/cert.pem
I0422 18:15:33.825981 70624 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18706-11572/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18706-11572/.minikube/cert.pem (1123 bytes)
I0422 18:15:33.826048 70624 exec_runner.go:144] found /home/jenkins/minikube-integration/18706-11572/.minikube/key.pem, removing ...
I0422 18:15:33.826061 70624 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18706-11572/.minikube/key.pem
I0422 18:15:33.826092 70624 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18706-11572/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18706-11572/.minikube/key.pem (1675 bytes)
I0422 18:15:33.826165 70624 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18706-11572/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18706-11572/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18706-11572/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-367072 san=[127.0.0.1 192.168.72.149 localhost minikube old-k8s-version-367072]
I0422 18:15:33.950766 70624 provision.go:177] copyRemoteCerts
I0422 18:15:33.950819 70624 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0422 18:15:33.950846 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHHostname
I0422 18:15:33.954130 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:33.954500 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:33.954547 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:33.954678 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHPort
I0422 18:15:33.954884 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHKeyPath
I0422 18:15:33.955090 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHUsername
I0422 18:15:33.955260 70624 sshutil.go:53] new ssh client: &{IP:192.168.72.149 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18706-11572/.minikube/machines/old-k8s-version-367072/id_rsa Username:docker}
I0422 18:15:34.039278 70624 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-11572/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0422 18:15:34.067428 70624 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-11572/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0422 18:15:34.098199 70624 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-11572/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0422 18:15:34.128206 70624 provision.go:87] duration metric: took 309.318014ms to configureAuth
I0422 18:15:34.128236 70624 buildroot.go:189] setting minikube options for container-runtime
I0422 18:15:34.128398 70624 config.go:182] Loaded profile config "old-k8s-version-367072": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0422 18:15:34.128460 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHHostname
I0422 18:15:34.130867 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:34.131184 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:34.131216 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:34.131367 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHPort
I0422 18:15:34.131570 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHKeyPath
I0422 18:15:34.131739 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHKeyPath
I0422 18:15:34.131890 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHUsername
I0422 18:15:34.132082 70624 main.go:141] libmachine: Using SSH client type: native
I0422 18:15:34.132244 70624 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.72.149 22 <nil> <nil>}
I0422 18:15:34.132265 70624 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0422 18:15:34.410770 70624 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0422 18:15:34.410805 70624 main.go:141] libmachine: Checking connection to Docker...
I0422 18:15:34.410815 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetURL
I0422 18:15:34.412190 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | Using libvirt version 6000000
I0422 18:15:34.415402 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:34.415786 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:34.415809 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:34.416046 70624 main.go:141] libmachine: Docker is up and running!
I0422 18:15:34.416064 70624 main.go:141] libmachine: Reticulating splines...
I0422 18:15:34.416071 70624 client.go:171] duration metric: took 28.835997512s to LocalClient.Create
I0422 18:15:34.416099 70624 start.go:167] duration metric: took 28.836062466s to libmachine.API.Create "old-k8s-version-367072"
I0422 18:15:34.416112 70624 start.go:293] postStartSetup for "old-k8s-version-367072" (driver="kvm2")
I0422 18:15:34.416125 70624 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0422 18:15:34.416146 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .DriverName
I0422 18:15:34.416402 70624 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0422 18:15:34.416423 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHHostname
I0422 18:15:34.419001 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:34.419410 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:34.419469 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:34.419583 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHPort
I0422 18:15:34.419796 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHKeyPath
I0422 18:15:34.419947 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHUsername
I0422 18:15:34.420096 70624 sshutil.go:53] new ssh client: &{IP:192.168.72.149 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18706-11572/.minikube/machines/old-k8s-version-367072/id_rsa Username:docker}
I0422 18:15:34.502489 70624 ssh_runner.go:195] Run: cat /etc/os-release
I0422 18:15:34.507003 70624 info.go:137] Remote host: Buildroot 2023.02.9
I0422 18:15:34.507039 70624 filesync.go:126] Scanning /home/jenkins/minikube-integration/18706-11572/.minikube/addons for local assets ...
I0422 18:15:34.507100 70624 filesync.go:126] Scanning /home/jenkins/minikube-integration/18706-11572/.minikube/files for local assets ...
I0422 18:15:34.507208 70624 filesync.go:149] local asset: /home/jenkins/minikube-integration/18706-11572/.minikube/files/etc/ssl/certs/188842.pem -> 188842.pem in /etc/ssl/certs
I0422 18:15:34.507332 70624 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0422 18:15:34.518496 70624 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-11572/.minikube/files/etc/ssl/certs/188842.pem --> /etc/ssl/certs/188842.pem (1708 bytes)
I0422 18:15:34.544362 70624 start.go:296] duration metric: took 128.235074ms for postStartSetup
I0422 18:15:34.544416 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetConfigRaw
I0422 18:15:34.545007 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetIP
I0422 18:15:34.547551 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:34.547900 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:34.547944 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:34.548170 70624 profile.go:143] Saving config to /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/config.json ...
I0422 18:15:34.548362 70624 start.go:128] duration metric: took 28.987785707s to createHost
I0422 18:15:34.548387 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHHostname
I0422 18:15:34.550534 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:34.550880 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:34.550903 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:34.551036 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHPort
I0422 18:15:34.551266 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHKeyPath
I0422 18:15:34.551425 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHKeyPath
I0422 18:15:34.551577 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHUsername
I0422 18:15:34.551711 70624 main.go:141] libmachine: Using SSH client type: native
I0422 18:15:34.551896 70624 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil> [] 0s} 192.168.72.149 22 <nil> <nil>}
I0422 18:15:34.551907 70624 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0422 18:15:34.660246 70624 main.go:141] libmachine: SSH cmd err, output: <nil>: 1713809734.646618488
I0422 18:15:34.660270 70624 fix.go:216] guest clock: 1713809734.646618488
I0422 18:15:34.660279 70624 fix.go:229] Guest: 2024-04-22 18:15:34.646618488 +0000 UTC Remote: 2024-04-22 18:15:34.548375764 +0000 UTC m=+29.120172985 (delta=98.242724ms)
I0422 18:15:34.660316 70624 fix.go:200] guest clock delta is within tolerance: 98.242724ms
I0422 18:15:34.660322 70624 start.go:83] releasing machines lock for "old-k8s-version-367072", held for 29.099825936s
I0422 18:15:34.660348 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .DriverName
I0422 18:15:34.660650 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetIP
I0422 18:15:34.663591 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:34.664090 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:34.664126 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:34.664371 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .DriverName
I0422 18:15:34.665022 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .DriverName
I0422 18:15:34.665206 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .DriverName
I0422 18:15:34.665306 70624 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0422 18:15:34.665343 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHHostname
I0422 18:15:34.665423 70624 ssh_runner.go:195] Run: cat /version.json
I0422 18:15:34.665446 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHHostname
I0422 18:15:34.668358 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:34.668486 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:34.668754 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:34.668782 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:34.669041 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHPort
I0422 18:15:34.669045 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:34.669072 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:34.669245 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHKeyPath
I0422 18:15:34.669324 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHPort
I0422 18:15:34.669411 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHUsername
I0422 18:15:34.669482 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHKeyPath
I0422 18:15:34.669555 70624 sshutil.go:53] new ssh client: &{IP:192.168.72.149 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18706-11572/.minikube/machines/old-k8s-version-367072/id_rsa Username:docker}
I0422 18:15:34.669636 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetSSHUsername
I0422 18:15:34.669778 70624 sshutil.go:53] new ssh client: &{IP:192.168.72.149 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18706-11572/.minikube/machines/old-k8s-version-367072/id_rsa Username:docker}
I0422 18:15:34.749166 70624 ssh_runner.go:195] Run: systemctl --version
I0422 18:15:34.787066 70624 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0422 18:15:34.966723 70624 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0422 18:15:34.973495 70624 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0422 18:15:34.973574 70624 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0422 18:15:34.992895 70624 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0422 18:15:34.992927 70624 start.go:494] detecting cgroup driver to use...
I0422 18:15:34.992996 70624 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0422 18:15:35.015683 70624 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0422 18:15:35.033181 70624 docker.go:217] disabling cri-docker service (if available) ...
I0422 18:15:35.033244 70624 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0422 18:15:35.048924 70624 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0422 18:15:35.064903 70624 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0422 18:15:35.198401 70624 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0422 18:15:35.388403 70624 docker.go:233] disabling docker service ...
I0422 18:15:35.388489 70624 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0422 18:15:35.404559 70624 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0422 18:15:35.419767 70624 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0422 18:15:35.541029 70624 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0422 18:15:35.675827 70624 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0422 18:15:35.691611 70624 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0422 18:15:35.711040 70624 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0422 18:15:35.711114 70624 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0422 18:15:35.722274 70624 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0422 18:15:35.722357 70624 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0422 18:15:35.733644 70624 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0422 18:15:35.744363 70624 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0422 18:15:35.755989 70624 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0422 18:15:35.767199 70624 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0422 18:15:35.778267 70624 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0422 18:15:35.778342 70624 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0422 18:15:35.793144 70624 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0422 18:15:35.803815 70624 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0422 18:15:35.942923 70624 ssh_runner.go:195] Run: sudo systemctl restart crio
I0422 18:15:36.415977 70624 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0422 18:15:36.416057 70624 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0422 18:15:36.421817 70624 start.go:562] Will wait 60s for crictl version
I0422 18:15:36.421881 70624 ssh_runner.go:195] Run: which crictl
I0422 18:15:36.426509 70624 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0422 18:15:36.475094 70624 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0422 18:15:36.475224 70624 ssh_runner.go:195] Run: crio --version
I0422 18:15:36.513597 70624 ssh_runner.go:195] Run: crio --version
I0422 18:15:36.615834 70624 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0422 18:15:36.623420 70624 main.go:141] libmachine: (old-k8s-version-367072) Calling .GetIP
I0422 18:15:36.627037 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:36.627569 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:82:9f:b2", ip: ""} in network mk-old-k8s-version-367072: {Iface:virbr4 ExpiryTime:2024-04-22 19:15:22 +0000 UTC Type:0 Mac:52:54:00:82:9f:b2 Iaid: IPaddr:192.168.72.149 Prefix:24 Hostname:old-k8s-version-367072 Clientid:01:52:54:00:82:9f:b2}
I0422 18:15:36.627600 70624 main.go:141] libmachine: (old-k8s-version-367072) DBG | domain old-k8s-version-367072 has defined IP address 192.168.72.149 and MAC address 52:54:00:82:9f:b2 in network mk-old-k8s-version-367072
I0422 18:15:36.627899 70624 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0422 18:15:36.633632 70624 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0422 18:15:36.649577 70624 kubeadm.go:877] updating cluster {Name:old-k8s-version-367072 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersio
n:v1.20.0 ClusterName:old-k8s-version-367072 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.149 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] M
ountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0422 18:15:36.649689 70624 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0422 18:15:36.649743 70624 ssh_runner.go:195] Run: sudo crictl images --output json
I0422 18:15:36.692981 70624 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0422 18:15:36.693075 70624 ssh_runner.go:195] Run: which lz4
I0422 18:15:36.697738 70624 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0422 18:15:36.702634 70624 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0422 18:15:36.702668 70624 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-11572/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0422 18:15:38.687028 70624 crio.go:462] duration metric: took 1.989312901s to copy over tarball
I0422 18:15:38.687099 70624 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0422 18:15:41.882647 70624 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.195525982s)
I0422 18:15:41.882679 70624 crio.go:469] duration metric: took 3.195623705s to extract the tarball
I0422 18:15:41.882688 70624 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0422 18:15:41.928527 70624 ssh_runner.go:195] Run: sudo crictl images --output json
I0422 18:15:41.996186 70624 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0422 18:15:41.996228 70624 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0422 18:15:41.996311 70624 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0422 18:15:41.996356 70624 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0422 18:15:41.996353 70624 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0422 18:15:41.996390 70624 image.go:134] retrieving image: registry.k8s.io/coredns:1.7.0
I0422 18:15:41.996417 70624 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0422 18:15:41.996398 70624 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0422 18:15:41.996502 70624 image.go:134] retrieving image: registry.k8s.io/pause:3.2
I0422 18:15:41.996337 70624 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0422 18:15:41.997904 70624 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0422 18:15:41.997918 70624 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0422 18:15:41.997960 70624 image.go:177] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0422 18:15:41.998003 70624 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0422 18:15:41.998018 70624 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0422 18:15:41.998153 70624 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0422 18:15:41.998348 70624 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0422 18:15:41.998559 70624 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0422 18:15:42.215750 70624 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0422 18:15:42.241733 70624 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0422 18:15:42.245172 70624 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0422 18:15:42.247528 70624 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0422 18:15:42.247819 70624 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0422 18:15:42.252459 70624 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0422 18:15:42.274365 70624 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0422 18:15:42.294622 70624 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0422 18:15:42.294675 70624 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0422 18:15:42.294719 70624 ssh_runner.go:195] Run: which crictl
I0422 18:15:42.412947 70624 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0422 18:15:42.413005 70624 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0422 18:15:42.413069 70624 ssh_runner.go:195] Run: which crictl
I0422 18:15:42.427672 70624 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0422 18:15:42.427724 70624 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0422 18:15:42.427734 70624 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0422 18:15:42.427762 70624 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0422 18:15:42.427800 70624 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0422 18:15:42.427837 70624 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0422 18:15:42.427876 70624 ssh_runner.go:195] Run: which crictl
I0422 18:15:42.427916 70624 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0422 18:15:42.427987 70624 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0422 18:15:42.428024 70624 ssh_runner.go:195] Run: which crictl
I0422 18:15:42.427812 70624 ssh_runner.go:195] Run: which crictl
I0422 18:15:42.428101 70624 ssh_runner.go:195] Run: which crictl
I0422 18:15:42.454879 70624 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0422 18:15:42.454973 70624 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0422 18:15:42.455020 70624 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0422 18:15:42.455025 70624 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0422 18:15:42.455062 70624 ssh_runner.go:195] Run: which crictl
I0422 18:15:42.455120 70624 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0422 18:15:42.455174 70624 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0422 18:15:42.455238 70624 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0422 18:15:42.455257 70624 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0422 18:15:42.598307 70624 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18706-11572/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0422 18:15:42.624213 70624 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18706-11572/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0422 18:15:42.624261 70624 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18706-11572/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0422 18:15:42.624303 70624 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18706-11572/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0422 18:15:42.624390 70624 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18706-11572/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0422 18:15:42.624474 70624 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18706-11572/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0422 18:15:42.624539 70624 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0422 18:15:42.667639 70624 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18706-11572/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0422 18:15:42.818414 70624 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0422 18:15:42.972769 70624 cache_images.go:92] duration metric: took 976.519779ms to LoadCachedImages
W0422 18:15:42.972878 70624 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18706-11572/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18706-11572/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2: no such file or directory
I0422 18:15:42.972895 70624 kubeadm.go:928] updating node { 192.168.72.149 8443 v1.20.0 crio true true} ...
I0422 18:15:42.973035 70624 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-367072 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.149
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-367072 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0422 18:15:42.973121 70624 ssh_runner.go:195] Run: crio config
I0422 18:15:43.030056 70624 cni.go:84] Creating CNI manager for ""
I0422 18:15:43.030085 70624 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0422 18:15:43.030102 70624 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0422 18:15:43.030125 70624 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.149 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-367072 NodeName:old-k8s-version-367072 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.149"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.149 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0422 18:15:43.030301 70624 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.149
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-367072"
kubeletExtraArgs:
node-ip: 192.168.72.149
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.149"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0422 18:15:43.030390 70624 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0422 18:15:43.044882 70624 binaries.go:44] Found k8s binaries, skipping transfer
I0422 18:15:43.044953 70624 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0422 18:15:43.055354 70624 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0422 18:15:43.081236 70624 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0422 18:15:43.103547 70624 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0422 18:15:43.125903 70624 ssh_runner.go:195] Run: grep 192.168.72.149 control-plane.minikube.internal$ /etc/hosts
I0422 18:15:43.130642 70624 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.149 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0422 18:15:43.145098 70624 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0422 18:15:43.292453 70624 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0422 18:15:43.318217 70624 certs.go:68] Setting up /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072 for IP: 192.168.72.149
I0422 18:15:43.318243 70624 certs.go:194] generating shared ca certs ...
I0422 18:15:43.318259 70624 certs.go:226] acquiring lock for ca certs: {Name:mk388d3dc4a0e77f8669c3ec42dbe16768d0150c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0422 18:15:43.318416 70624 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18706-11572/.minikube/ca.key
I0422 18:15:43.318454 70624 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18706-11572/.minikube/proxy-client-ca.key
I0422 18:15:43.318464 70624 certs.go:256] generating profile certs ...
I0422 18:15:43.318520 70624 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/client.key
I0422 18:15:43.318533 70624 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/client.crt with IP's: []
I0422 18:15:43.615741 70624 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/client.crt ...
I0422 18:15:43.615775 70624 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/client.crt: {Name:mk99ee7081b4d820f4f0cdb95ff821b8e5544706 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0422 18:15:43.615979 70624 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/client.key ...
I0422 18:15:43.616010 70624 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/client.key: {Name:mk1ca290a65fe87f287a91cddf38e6d7c69b5336 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0422 18:15:43.616135 70624 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/apiserver.key.653b7478
I0422 18:15:43.616159 70624 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/apiserver.crt.653b7478 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.72.149]
I0422 18:15:43.773496 70624 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/apiserver.crt.653b7478 ...
I0422 18:15:43.773530 70624 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/apiserver.crt.653b7478: {Name:mk2553333cabc06c1483410d4a6d30e69360cd44 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0422 18:15:43.773683 70624 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/apiserver.key.653b7478 ...
I0422 18:15:43.773696 70624 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/apiserver.key.653b7478: {Name:mk622a2847684716bd898ddc54a1fb96e6a8536f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0422 18:15:43.773760 70624 certs.go:381] copying /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/apiserver.crt.653b7478 -> /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/apiserver.crt
I0422 18:15:43.773834 70624 certs.go:385] copying /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/apiserver.key.653b7478 -> /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/apiserver.key
I0422 18:15:43.773885 70624 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/proxy-client.key
I0422 18:15:43.773904 70624 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/proxy-client.crt with IP's: []
I0422 18:15:44.022613 70624 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/proxy-client.crt ...
I0422 18:15:44.022647 70624 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/proxy-client.crt: {Name:mk541f276b69834747468929f0d2b18d409eb2ec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0422 18:15:44.022809 70624 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/proxy-client.key ...
I0422 18:15:44.022824 70624 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/proxy-client.key: {Name:mkd95020b5acd83d6df34da962b44cc339ee9930 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0422 18:15:44.022984 70624 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-11572/.minikube/certs/18884.pem (1338 bytes)
W0422 18:15:44.023023 70624 certs.go:480] ignoring /home/jenkins/minikube-integration/18706-11572/.minikube/certs/18884_empty.pem, impossibly tiny 0 bytes
I0422 18:15:44.023031 70624 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-11572/.minikube/certs/ca-key.pem (1675 bytes)
I0422 18:15:44.023050 70624 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-11572/.minikube/certs/ca.pem (1078 bytes)
I0422 18:15:44.023073 70624 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-11572/.minikube/certs/cert.pem (1123 bytes)
I0422 18:15:44.023094 70624 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-11572/.minikube/certs/key.pem (1675 bytes)
I0422 18:15:44.023159 70624 certs.go:484] found cert: /home/jenkins/minikube-integration/18706-11572/.minikube/files/etc/ssl/certs/188842.pem (1708 bytes)
I0422 18:15:44.023756 70624 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-11572/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0422 18:15:44.053586 70624 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-11572/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0422 18:15:44.080718 70624 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-11572/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0422 18:15:44.108613 70624 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-11572/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0422 18:15:44.135643 70624 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0422 18:15:44.165370 70624 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0422 18:15:44.194224 70624 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0422 18:15:44.225602 70624 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-11572/.minikube/profiles/old-k8s-version-367072/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0422 18:15:44.262236 70624 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-11572/.minikube/files/etc/ssl/certs/188842.pem --> /usr/share/ca-certificates/188842.pem (1708 bytes)
I0422 18:15:44.290339 70624 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-11572/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0422 18:15:44.320407 70624 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18706-11572/.minikube/certs/18884.pem --> /usr/share/ca-certificates/18884.pem (1338 bytes)
I0422 18:15:44.349276 70624 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0422 18:15:44.369402 70624 ssh_runner.go:195] Run: openssl version
I0422 18:15:44.375984 70624 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0422 18:15:44.389513 70624 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0422 18:15:44.394885 70624 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 22 16:58 /usr/share/ca-certificates/minikubeCA.pem
I0422 18:15:44.394950 70624 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0422 18:15:44.401035 70624 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0422 18:15:44.413494 70624 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/18884.pem && ln -fs /usr/share/ca-certificates/18884.pem /etc/ssl/certs/18884.pem"
I0422 18:15:44.426027 70624 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/18884.pem
I0422 18:15:44.431050 70624 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 22 17:08 /usr/share/ca-certificates/18884.pem
I0422 18:15:44.431111 70624 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/18884.pem
I0422 18:15:44.437763 70624 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/18884.pem /etc/ssl/certs/51391683.0"
I0422 18:15:44.453112 70624 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/188842.pem && ln -fs /usr/share/ca-certificates/188842.pem /etc/ssl/certs/188842.pem"
I0422 18:15:44.467577 70624 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/188842.pem
I0422 18:15:44.473342 70624 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 22 17:08 /usr/share/ca-certificates/188842.pem
I0422 18:15:44.473408 70624 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/188842.pem
I0422 18:15:44.480089 70624 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/188842.pem /etc/ssl/certs/3ec20f2e.0"
I0422 18:15:44.493058 70624 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0422 18:15:44.498095 70624 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0422 18:15:44.498159 70624 kubeadm.go:391] StartCluster: {Name:old-k8s-version-367072 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v
1.20.0 ClusterName:old-k8s-version-367072 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.72.149 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0422 18:15:44.498262 70624 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0422 18:15:44.498319 70624 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0422 18:15:44.546845 70624 cri.go:89] found id: ""
I0422 18:15:44.546937 70624 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0422 18:15:44.560184 70624 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0422 18:15:44.572400 70624 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0422 18:15:44.584636 70624 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0422 18:15:44.584659 70624 kubeadm.go:156] found existing configuration files:
I0422 18:15:44.584730 70624 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0422 18:15:44.597464 70624 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0422 18:15:44.597521 70624 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0422 18:15:44.610920 70624 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0422 18:15:44.623779 70624 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0422 18:15:44.623843 70624 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0422 18:15:44.637004 70624 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0422 18:15:44.649635 70624 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0422 18:15:44.649690 70624 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0422 18:15:44.663096 70624 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0422 18:15:44.673756 70624 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0422 18:15:44.673825 70624 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0422 18:15:44.684762 70624 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0422 18:15:44.796889 70624 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0422 18:15:44.796976 70624 kubeadm.go:309] [preflight] Running pre-flight checks
I0422 18:15:44.973954 70624 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0422 18:15:44.974095 70624 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0422 18:15:44.974215 70624 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0422 18:15:45.195780 70624 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0422 18:15:45.198959 70624 out.go:204] - Generating certificates and keys ...
I0422 18:15:45.199099 70624 kubeadm.go:309] [certs] Using existing ca certificate authority
I0422 18:15:45.199243 70624 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0422 18:15:45.395359 70624 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key
I0422 18:15:45.715373 70624 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key
I0422 18:15:46.071552 70624 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key
I0422 18:15:46.237015 70624 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key
I0422 18:15:46.409703 70624 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key
I0422 18:15:46.410096 70624 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-367072] and IPs [192.168.72.149 127.0.0.1 ::1]
I0422 18:15:46.473964 70624 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key
I0422 18:15:46.474380 70624 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-367072] and IPs [192.168.72.149 127.0.0.1 ::1]
I0422 18:15:46.745438 70624 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key
I0422 18:15:46.940071 70624 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key
I0422 18:15:47.133613 70624 kubeadm.go:309] [certs] Generating "sa" key and public key
I0422 18:15:47.133734 70624 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0422 18:15:47.357516 70624 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0422 18:15:47.522905 70624 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0422 18:15:47.701690 70624 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0422 18:15:47.856441 70624 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0422 18:15:47.883573 70624 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0422 18:15:47.883697 70624 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0422 18:15:47.883749 70624 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0422 18:15:48.030990 70624 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0422 18:15:48.033018 70624 out.go:204] - Booting up control plane ...
I0422 18:15:48.033190 70624 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0422 18:15:48.045307 70624 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0422 18:15:48.048173 70624 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0422 18:15:48.049583 70624 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0422 18:15:48.058800 70624 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0422 18:16:28.057582 70624 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0422 18:16:28.058331 70624 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0422 18:16:28.058527 70624 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0422 18:16:33.060144 70624 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0422 18:16:33.060631 70624 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0422 18:16:43.061592 70624 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0422 18:16:43.061856 70624 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0422 18:17:03.062798 70624 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0422 18:17:03.063070 70624 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0422 18:17:43.062805 70624 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0422 18:17:43.063135 70624 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0422 18:17:43.063159 70624 kubeadm.go:309]
I0422 18:17:43.063233 70624 kubeadm.go:309] Unfortunately, an error has occurred:
I0422 18:17:43.063293 70624 kubeadm.go:309] timed out waiting for the condition
I0422 18:17:43.063303 70624 kubeadm.go:309]
I0422 18:17:43.063356 70624 kubeadm.go:309] This error is likely caused by:
I0422 18:17:43.063404 70624 kubeadm.go:309] - The kubelet is not running
I0422 18:17:43.063504 70624 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0422 18:17:43.063512 70624 kubeadm.go:309]
I0422 18:17:43.063602 70624 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0422 18:17:43.063632 70624 kubeadm.go:309] - 'systemctl status kubelet'
I0422 18:17:43.063661 70624 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0422 18:17:43.063667 70624 kubeadm.go:309]
I0422 18:17:43.063777 70624 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0422 18:17:43.063874 70624 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0422 18:17:43.063883 70624 kubeadm.go:309]
I0422 18:17:43.063967 70624 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0422 18:17:43.064075 70624 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0422 18:17:43.064157 70624 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0422 18:17:43.064223 70624 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0422 18:17:43.064231 70624 kubeadm.go:309]
I0422 18:17:43.065085 70624 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0422 18:17:43.065200 70624 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0422 18:17:43.065277 70624 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0422 18:17:43.065425 70624 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-367072] and IPs [192.168.72.149 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-367072] and IPs [192.168.72.149 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-367072] and IPs [192.168.72.149 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-367072] and IPs [192.168.72.149 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0422 18:17:43.065485 70624 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0422 18:17:45.698580 70624 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force": (2.633068038s)
I0422 18:17:45.698656 70624 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0422 18:17:45.714299 70624 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0422 18:17:45.724718 70624 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0422 18:17:45.724742 70624 kubeadm.go:156] found existing configuration files:
I0422 18:17:45.724785 70624 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0422 18:17:45.735052 70624 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0422 18:17:45.735106 70624 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0422 18:17:45.745692 70624 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0422 18:17:45.755319 70624 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0422 18:17:45.755380 70624 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0422 18:17:45.766445 70624 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0422 18:17:45.776642 70624 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0422 18:17:45.776723 70624 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0422 18:17:45.787549 70624 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0422 18:17:45.797945 70624 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0422 18:17:45.798015 70624 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0422 18:17:45.811767 70624 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0422 18:17:46.038208 70624 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0422 18:19:41.956404 70624 kubeadm.go:309] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0422 18:19:41.956537 70624 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0422 18:19:41.957571 70624 kubeadm.go:309] [init] Using Kubernetes version: v1.20.0
I0422 18:19:41.957618 70624 kubeadm.go:309] [preflight] Running pre-flight checks
I0422 18:19:41.957717 70624 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster
I0422 18:19:41.957850 70624 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0422 18:19:41.957965 70624 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0422 18:19:41.958058 70624 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0422 18:19:41.959771 70624 out.go:204] - Generating certificates and keys ...
I0422 18:19:41.959866 70624 kubeadm.go:309] [certs] Using existing ca certificate authority
I0422 18:19:41.959942 70624 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk
I0422 18:19:41.960036 70624 kubeadm.go:309] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0422 18:19:41.960158 70624 kubeadm.go:309] [certs] Using existing front-proxy-ca certificate authority
I0422 18:19:41.960260 70624 kubeadm.go:309] [certs] Using existing front-proxy-client certificate and key on disk
I0422 18:19:41.960337 70624 kubeadm.go:309] [certs] Using existing etcd/ca certificate authority
I0422 18:19:41.960429 70624 kubeadm.go:309] [certs] Using existing etcd/server certificate and key on disk
I0422 18:19:41.960519 70624 kubeadm.go:309] [certs] Using existing etcd/peer certificate and key on disk
I0422 18:19:41.960615 70624 kubeadm.go:309] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0422 18:19:41.960734 70624 kubeadm.go:309] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0422 18:19:41.960793 70624 kubeadm.go:309] [certs] Using the existing "sa" key
I0422 18:19:41.960875 70624 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0422 18:19:41.960973 70624 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file
I0422 18:19:41.961051 70624 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0422 18:19:41.961143 70624 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0422 18:19:41.961223 70624 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0422 18:19:41.961355 70624 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0422 18:19:41.961472 70624 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0422 18:19:41.961532 70624 kubeadm.go:309] [kubelet-start] Starting the kubelet
I0422 18:19:41.961624 70624 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0422 18:19:41.963396 70624 out.go:204] - Booting up control plane ...
I0422 18:19:41.963504 70624 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0422 18:19:41.963596 70624 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0422 18:19:41.963674 70624 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0422 18:19:41.963753 70624 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0422 18:19:41.963919 70624 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0422 18:19:41.964007 70624 kubeadm.go:309] [kubelet-check] Initial timeout of 40s passed.
I0422 18:19:41.964114 70624 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0422 18:19:41.964312 70624 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0422 18:19:41.964413 70624 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0422 18:19:41.964618 70624 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0422 18:19:41.964689 70624 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0422 18:19:41.964854 70624 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0422 18:19:41.964921 70624 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0422 18:19:41.965090 70624 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0422 18:19:41.965191 70624 kubeadm.go:309] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0422 18:19:41.965361 70624 kubeadm.go:309] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0422 18:19:41.965372 70624 kubeadm.go:309]
I0422 18:19:41.965409 70624 kubeadm.go:309] Unfortunately, an error has occurred:
I0422 18:19:41.965444 70624 kubeadm.go:309] timed out waiting for the condition
I0422 18:19:41.965450 70624 kubeadm.go:309]
I0422 18:19:41.965481 70624 kubeadm.go:309] This error is likely caused by:
I0422 18:19:41.965510 70624 kubeadm.go:309] - The kubelet is not running
I0422 18:19:41.965600 70624 kubeadm.go:309] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0422 18:19:41.965610 70624 kubeadm.go:309]
I0422 18:19:41.965695 70624 kubeadm.go:309] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0422 18:19:41.965724 70624 kubeadm.go:309] - 'systemctl status kubelet'
I0422 18:19:41.965753 70624 kubeadm.go:309] - 'journalctl -xeu kubelet'
I0422 18:19:41.965759 70624 kubeadm.go:309]
I0422 18:19:41.965851 70624 kubeadm.go:309] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0422 18:19:41.965972 70624 kubeadm.go:309] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0422 18:19:41.965984 70624 kubeadm.go:309]
I0422 18:19:41.966134 70624 kubeadm.go:309] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0422 18:19:41.966231 70624 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0422 18:19:41.966300 70624 kubeadm.go:309] Once you have found the failing container, you can inspect its logs with:
I0422 18:19:41.966379 70624 kubeadm.go:309] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0422 18:19:41.966443 70624 kubeadm.go:309]
I0422 18:19:41.966502 70624 kubeadm.go:393] duration metric: took 3m57.468347007s to StartCluster
I0422 18:19:41.966548 70624 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0422 18:19:41.966608 70624 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0422 18:19:42.009948 70624 cri.go:89] found id: ""
I0422 18:19:42.009973 70624 logs.go:276] 0 containers: []
W0422 18:19:42.009983 70624 logs.go:278] No container was found matching "kube-apiserver"
I0422 18:19:42.009991 70624 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0422 18:19:42.010058 70624 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0422 18:19:42.045878 70624 cri.go:89] found id: ""
I0422 18:19:42.045904 70624 logs.go:276] 0 containers: []
W0422 18:19:42.045912 70624 logs.go:278] No container was found matching "etcd"
I0422 18:19:42.045917 70624 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0422 18:19:42.045997 70624 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0422 18:19:42.084522 70624 cri.go:89] found id: ""
I0422 18:19:42.084552 70624 logs.go:276] 0 containers: []
W0422 18:19:42.084559 70624 logs.go:278] No container was found matching "coredns"
I0422 18:19:42.084564 70624 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0422 18:19:42.084608 70624 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0422 18:19:42.120870 70624 cri.go:89] found id: ""
I0422 18:19:42.120899 70624 logs.go:276] 0 containers: []
W0422 18:19:42.120906 70624 logs.go:278] No container was found matching "kube-scheduler"
I0422 18:19:42.120912 70624 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0422 18:19:42.120970 70624 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0422 18:19:42.156636 70624 cri.go:89] found id: ""
I0422 18:19:42.156665 70624 logs.go:276] 0 containers: []
W0422 18:19:42.156677 70624 logs.go:278] No container was found matching "kube-proxy"
I0422 18:19:42.156685 70624 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0422 18:19:42.156746 70624 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0422 18:19:42.193621 70624 cri.go:89] found id: ""
I0422 18:19:42.193647 70624 logs.go:276] 0 containers: []
W0422 18:19:42.193660 70624 logs.go:278] No container was found matching "kube-controller-manager"
I0422 18:19:42.193668 70624 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0422 18:19:42.193724 70624 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0422 18:19:42.230231 70624 cri.go:89] found id: ""
I0422 18:19:42.230256 70624 logs.go:276] 0 containers: []
W0422 18:19:42.230264 70624 logs.go:278] No container was found matching "kindnet"
I0422 18:19:42.230273 70624 logs.go:123] Gathering logs for kubelet ...
I0422 18:19:42.230284 70624 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0422 18:19:42.279375 70624 logs.go:123] Gathering logs for dmesg ...
I0422 18:19:42.279405 70624 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0422 18:19:42.293656 70624 logs.go:123] Gathering logs for describe nodes ...
I0422 18:19:42.293687 70624 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0422 18:19:42.410945 70624 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0422 18:19:42.410977 70624 logs.go:123] Gathering logs for CRI-O ...
I0422 18:19:42.410993 70624 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0422 18:19:42.514595 70624 logs.go:123] Gathering logs for container status ...
I0422 18:19:42.514632 70624 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0422 18:19:42.570579 70624 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0422 18:19:42.570624 70624 out.go:239] *
*
W0422 18:19:42.570682 70624 out.go:239] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0422 18:19:42.570709 70624 out.go:239] *
*
W0422 18:19:42.571586 70624 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0422 18:19:42.575548 70624 out.go:177]
W0422 18:19:42.576992 70624 out.go:239] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0422 18:19:42.577051 70624 out.go:239] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0422 18:19:42.577073 70624 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0422 18:19:42.578824 70624 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-367072 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-367072 -n old-k8s-version-367072
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-367072 -n old-k8s-version-367072: exit status 6 (234.336742ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0422 18:19:42.859036 77442 status.go:417] kubeconfig endpoint: get endpoint: "old-k8s-version-367072" does not appear in /home/jenkins/minikube-integration/18706-11572/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-367072" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (277.45s)