=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-456130 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-456130 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m34.56136829s)
-- stdout --
* [old-k8s-version-456130] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20327
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20327-555419/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20327-555419/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-456130" primary control-plane node in "old-k8s-version-456130" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0127 14:07:08.366778 601373 out.go:345] Setting OutFile to fd 1 ...
I0127 14:07:08.366884 601373 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 14:07:08.366892 601373 out.go:358] Setting ErrFile to fd 2...
I0127 14:07:08.366897 601373 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0127 14:07:08.367066 601373 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20327-555419/.minikube/bin
I0127 14:07:08.367619 601373 out.go:352] Setting JSON to false
I0127 14:07:08.368564 601373 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":17373,"bootTime":1737969455,"procs":214,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1074-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0127 14:07:08.368664 601373 start.go:139] virtualization: kvm guest
I0127 14:07:08.370601 601373 out.go:177] * [old-k8s-version-456130] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0127 14:07:08.371819 601373 out.go:177] - MINIKUBE_LOCATION=20327
I0127 14:07:08.371835 601373 notify.go:220] Checking for updates...
I0127 14:07:08.373936 601373 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0127 14:07:08.374975 601373 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20327-555419/kubeconfig
I0127 14:07:08.376042 601373 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20327-555419/.minikube
I0127 14:07:08.377161 601373 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0127 14:07:08.378332 601373 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0127 14:07:08.379763 601373 config.go:182] Loaded profile config "cert-expiration-335486": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0127 14:07:08.379849 601373 config.go:182] Loaded profile config "kubernetes-upgrade-225004": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0127 14:07:08.379934 601373 config.go:182] Loaded profile config "pause-966446": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.1
I0127 14:07:08.380012 601373 driver.go:394] Setting default libvirt URI to qemu:///system
I0127 14:07:08.413721 601373 out.go:177] * Using the kvm2 driver based on user configuration
I0127 14:07:08.414722 601373 start.go:297] selected driver: kvm2
I0127 14:07:08.414739 601373 start.go:901] validating driver "kvm2" against <nil>
I0127 14:07:08.414753 601373 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0127 14:07:08.415804 601373 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0127 14:07:08.415883 601373 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20327-555419/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0127 14:07:08.430334 601373 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.35.0
I0127 14:07:08.430382 601373 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0127 14:07:08.430632 601373 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0127 14:07:08.430667 601373 cni.go:84] Creating CNI manager for ""
I0127 14:07:08.430711 601373 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0127 14:07:08.430724 601373 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0127 14:07:08.430769 601373 start.go:340] cluster config:
{Name:old-k8s-version-456130 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-456130 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:
0 GPUs: AutoPauseInterval:1m0s}
I0127 14:07:08.430868 601373 iso.go:125] acquiring lock: {Name:mk0b06c73eff2439d8011e2d265689c91f6582e9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0127 14:07:08.432318 601373 out.go:177] * Starting "old-k8s-version-456130" primary control-plane node in "old-k8s-version-456130" cluster
I0127 14:07:08.433435 601373 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0127 14:07:08.433467 601373 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20327-555419/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0127 14:07:08.433474 601373 cache.go:56] Caching tarball of preloaded images
I0127 14:07:08.433575 601373 preload.go:172] Found /home/jenkins/minikube-integration/20327-555419/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0127 14:07:08.433604 601373 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0127 14:07:08.433692 601373 profile.go:143] Saving config to /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/config.json ...
I0127 14:07:08.433714 601373 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/config.json: {Name:mk7e37e7227c826f68b97ca62c90173b8ea88022 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 14:07:08.433874 601373 start.go:360] acquireMachinesLock for old-k8s-version-456130: {Name:mk6d38fa09fa24cd3c414dc7ae5daeed893565a4 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0127 14:07:14.245971 601373 start.go:364] duration metric: took 5.812042353s to acquireMachinesLock for "old-k8s-version-456130"
I0127 14:07:14.246038 601373 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-456130 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-versi
on-456130 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0127 14:07:14.246168 601373 start.go:125] createHost starting for "" (driver="kvm2")
I0127 14:07:14.247788 601373 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0127 14:07:14.247969 601373 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0127 14:07:14.248025 601373 main.go:141] libmachine: Launching plugin server for driver kvm2
I0127 14:07:14.264869 601373 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39767
I0127 14:07:14.265274 601373 main.go:141] libmachine: () Calling .GetVersion
I0127 14:07:14.265832 601373 main.go:141] libmachine: Using API Version 1
I0127 14:07:14.265856 601373 main.go:141] libmachine: () Calling .SetConfigRaw
I0127 14:07:14.266195 601373 main.go:141] libmachine: () Calling .GetMachineName
I0127 14:07:14.266413 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetMachineName
I0127 14:07:14.266564 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .DriverName
I0127 14:07:14.266728 601373 start.go:159] libmachine.API.Create for "old-k8s-version-456130" (driver="kvm2")
I0127 14:07:14.266758 601373 client.go:168] LocalClient.Create starting
I0127 14:07:14.266793 601373 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20327-555419/.minikube/certs/ca.pem
I0127 14:07:14.266851 601373 main.go:141] libmachine: Decoding PEM data...
I0127 14:07:14.266874 601373 main.go:141] libmachine: Parsing certificate...
I0127 14:07:14.266948 601373 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20327-555419/.minikube/certs/cert.pem
I0127 14:07:14.266976 601373 main.go:141] libmachine: Decoding PEM data...
I0127 14:07:14.266995 601373 main.go:141] libmachine: Parsing certificate...
I0127 14:07:14.267024 601373 main.go:141] libmachine: Running pre-create checks...
I0127 14:07:14.267037 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .PreCreateCheck
I0127 14:07:14.267370 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetConfigRaw
I0127 14:07:14.267852 601373 main.go:141] libmachine: Creating machine...
I0127 14:07:14.267871 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .Create
I0127 14:07:14.268010 601373 main.go:141] libmachine: (old-k8s-version-456130) creating KVM machine...
I0127 14:07:14.268033 601373 main.go:141] libmachine: (old-k8s-version-456130) creating network...
I0127 14:07:14.269232 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found existing default KVM network
I0127 14:07:14.270830 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:14.270677 601428 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000264180}
I0127 14:07:14.270859 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | created network xml:
I0127 14:07:14.270871 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | <network>
I0127 14:07:14.270879 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | <name>mk-old-k8s-version-456130</name>
I0127 14:07:14.270915 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | <dns enable='no'/>
I0127 14:07:14.270940 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG |
I0127 14:07:14.270979 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | <ip address='192.168.39.1' netmask='255.255.255.0'>
I0127 14:07:14.270999 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | <dhcp>
I0127 14:07:14.271006 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | <range start='192.168.39.2' end='192.168.39.253'/>
I0127 14:07:14.271014 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | </dhcp>
I0127 14:07:14.271036 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | </ip>
I0127 14:07:14.271048 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG |
I0127 14:07:14.271061 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | </network>
I0127 14:07:14.271071 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG |
I0127 14:07:14.275782 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | trying to create private KVM network mk-old-k8s-version-456130 192.168.39.0/24...
I0127 14:07:14.344710 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | private KVM network mk-old-k8s-version-456130 192.168.39.0/24 created
I0127 14:07:14.344763 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:14.344677 601428 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20327-555419/.minikube
I0127 14:07:14.344826 601373 main.go:141] libmachine: (old-k8s-version-456130) setting up store path in /home/jenkins/minikube-integration/20327-555419/.minikube/machines/old-k8s-version-456130 ...
I0127 14:07:14.344854 601373 main.go:141] libmachine: (old-k8s-version-456130) building disk image from file:///home/jenkins/minikube-integration/20327-555419/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0127 14:07:14.344929 601373 main.go:141] libmachine: (old-k8s-version-456130) Downloading /home/jenkins/minikube-integration/20327-555419/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20327-555419/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0127 14:07:14.639945 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:14.639762 601428 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20327-555419/.minikube/machines/old-k8s-version-456130/id_rsa...
I0127 14:07:14.728358 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:14.728257 601428 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20327-555419/.minikube/machines/old-k8s-version-456130/old-k8s-version-456130.rawdisk...
I0127 14:07:14.728394 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | Writing magic tar header
I0127 14:07:14.728416 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | Writing SSH key tar header
I0127 14:07:14.728436 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:14.728373 601428 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20327-555419/.minikube/machines/old-k8s-version-456130 ...
I0127 14:07:14.728507 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20327-555419/.minikube/machines/old-k8s-version-456130
I0127 14:07:14.728538 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20327-555419/.minikube/machines
I0127 14:07:14.728556 601373 main.go:141] libmachine: (old-k8s-version-456130) setting executable bit set on /home/jenkins/minikube-integration/20327-555419/.minikube/machines/old-k8s-version-456130 (perms=drwx------)
I0127 14:07:14.728571 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20327-555419/.minikube
I0127 14:07:14.728592 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20327-555419
I0127 14:07:14.728623 601373 main.go:141] libmachine: (old-k8s-version-456130) setting executable bit set on /home/jenkins/minikube-integration/20327-555419/.minikube/machines (perms=drwxr-xr-x)
I0127 14:07:14.728641 601373 main.go:141] libmachine: (old-k8s-version-456130) setting executable bit set on /home/jenkins/minikube-integration/20327-555419/.minikube (perms=drwxr-xr-x)
I0127 14:07:14.728653 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0127 14:07:14.728667 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | checking permissions on dir: /home/jenkins
I0127 14:07:14.728683 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | checking permissions on dir: /home
I0127 14:07:14.728698 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | skipping /home - not owner
I0127 14:07:14.728720 601373 main.go:141] libmachine: (old-k8s-version-456130) setting executable bit set on /home/jenkins/minikube-integration/20327-555419 (perms=drwxrwxr-x)
I0127 14:07:14.728736 601373 main.go:141] libmachine: (old-k8s-version-456130) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0127 14:07:14.728754 601373 main.go:141] libmachine: (old-k8s-version-456130) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0127 14:07:14.728768 601373 main.go:141] libmachine: (old-k8s-version-456130) creating domain...
I0127 14:07:14.729849 601373 main.go:141] libmachine: (old-k8s-version-456130) define libvirt domain using xml:
I0127 14:07:14.729873 601373 main.go:141] libmachine: (old-k8s-version-456130) <domain type='kvm'>
I0127 14:07:14.729883 601373 main.go:141] libmachine: (old-k8s-version-456130) <name>old-k8s-version-456130</name>
I0127 14:07:14.729891 601373 main.go:141] libmachine: (old-k8s-version-456130) <memory unit='MiB'>2200</memory>
I0127 14:07:14.729900 601373 main.go:141] libmachine: (old-k8s-version-456130) <vcpu>2</vcpu>
I0127 14:07:14.729910 601373 main.go:141] libmachine: (old-k8s-version-456130) <features>
I0127 14:07:14.729919 601373 main.go:141] libmachine: (old-k8s-version-456130) <acpi/>
I0127 14:07:14.729929 601373 main.go:141] libmachine: (old-k8s-version-456130) <apic/>
I0127 14:07:14.729945 601373 main.go:141] libmachine: (old-k8s-version-456130) <pae/>
I0127 14:07:14.729957 601373 main.go:141] libmachine: (old-k8s-version-456130)
I0127 14:07:14.729966 601373 main.go:141] libmachine: (old-k8s-version-456130) </features>
I0127 14:07:14.729982 601373 main.go:141] libmachine: (old-k8s-version-456130) <cpu mode='host-passthrough'>
I0127 14:07:14.729992 601373 main.go:141] libmachine: (old-k8s-version-456130)
I0127 14:07:14.729998 601373 main.go:141] libmachine: (old-k8s-version-456130) </cpu>
I0127 14:07:14.730008 601373 main.go:141] libmachine: (old-k8s-version-456130) <os>
I0127 14:07:14.730019 601373 main.go:141] libmachine: (old-k8s-version-456130) <type>hvm</type>
I0127 14:07:14.730027 601373 main.go:141] libmachine: (old-k8s-version-456130) <boot dev='cdrom'/>
I0127 14:07:14.730035 601373 main.go:141] libmachine: (old-k8s-version-456130) <boot dev='hd'/>
I0127 14:07:14.730044 601373 main.go:141] libmachine: (old-k8s-version-456130) <bootmenu enable='no'/>
I0127 14:07:14.730053 601373 main.go:141] libmachine: (old-k8s-version-456130) </os>
I0127 14:07:14.730085 601373 main.go:141] libmachine: (old-k8s-version-456130) <devices>
I0127 14:07:14.730109 601373 main.go:141] libmachine: (old-k8s-version-456130) <disk type='file' device='cdrom'>
I0127 14:07:14.730130 601373 main.go:141] libmachine: (old-k8s-version-456130) <source file='/home/jenkins/minikube-integration/20327-555419/.minikube/machines/old-k8s-version-456130/boot2docker.iso'/>
I0127 14:07:14.730142 601373 main.go:141] libmachine: (old-k8s-version-456130) <target dev='hdc' bus='scsi'/>
I0127 14:07:14.730160 601373 main.go:141] libmachine: (old-k8s-version-456130) <readonly/>
I0127 14:07:14.730171 601373 main.go:141] libmachine: (old-k8s-version-456130) </disk>
I0127 14:07:14.730270 601373 main.go:141] libmachine: (old-k8s-version-456130) <disk type='file' device='disk'>
I0127 14:07:14.730335 601373 main.go:141] libmachine: (old-k8s-version-456130) <driver name='qemu' type='raw' cache='default' io='threads' />
I0127 14:07:14.730365 601373 main.go:141] libmachine: (old-k8s-version-456130) <source file='/home/jenkins/minikube-integration/20327-555419/.minikube/machines/old-k8s-version-456130/old-k8s-version-456130.rawdisk'/>
I0127 14:07:14.730381 601373 main.go:141] libmachine: (old-k8s-version-456130) <target dev='hda' bus='virtio'/>
I0127 14:07:14.730406 601373 main.go:141] libmachine: (old-k8s-version-456130) </disk>
I0127 14:07:14.730413 601373 main.go:141] libmachine: (old-k8s-version-456130) <interface type='network'>
I0127 14:07:14.730419 601373 main.go:141] libmachine: (old-k8s-version-456130) <source network='mk-old-k8s-version-456130'/>
I0127 14:07:14.730426 601373 main.go:141] libmachine: (old-k8s-version-456130) <model type='virtio'/>
I0127 14:07:14.730431 601373 main.go:141] libmachine: (old-k8s-version-456130) </interface>
I0127 14:07:14.730435 601373 main.go:141] libmachine: (old-k8s-version-456130) <interface type='network'>
I0127 14:07:14.730443 601373 main.go:141] libmachine: (old-k8s-version-456130) <source network='default'/>
I0127 14:07:14.730447 601373 main.go:141] libmachine: (old-k8s-version-456130) <model type='virtio'/>
I0127 14:07:14.730457 601373 main.go:141] libmachine: (old-k8s-version-456130) </interface>
I0127 14:07:14.730461 601373 main.go:141] libmachine: (old-k8s-version-456130) <serial type='pty'>
I0127 14:07:14.730467 601373 main.go:141] libmachine: (old-k8s-version-456130) <target port='0'/>
I0127 14:07:14.730471 601373 main.go:141] libmachine: (old-k8s-version-456130) </serial>
I0127 14:07:14.730475 601373 main.go:141] libmachine: (old-k8s-version-456130) <console type='pty'>
I0127 14:07:14.730482 601373 main.go:141] libmachine: (old-k8s-version-456130) <target type='serial' port='0'/>
I0127 14:07:14.730486 601373 main.go:141] libmachine: (old-k8s-version-456130) </console>
I0127 14:07:14.730491 601373 main.go:141] libmachine: (old-k8s-version-456130) <rng model='virtio'>
I0127 14:07:14.730497 601373 main.go:141] libmachine: (old-k8s-version-456130) <backend model='random'>/dev/random</backend>
I0127 14:07:14.730503 601373 main.go:141] libmachine: (old-k8s-version-456130) </rng>
I0127 14:07:14.730508 601373 main.go:141] libmachine: (old-k8s-version-456130)
I0127 14:07:14.730514 601373 main.go:141] libmachine: (old-k8s-version-456130)
I0127 14:07:14.730519 601373 main.go:141] libmachine: (old-k8s-version-456130) </devices>
I0127 14:07:14.730523 601373 main.go:141] libmachine: (old-k8s-version-456130) </domain>
I0127 14:07:14.730543 601373 main.go:141] libmachine: (old-k8s-version-456130)
I0127 14:07:14.734700 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:95:18:c7 in network default
I0127 14:07:14.735324 601373 main.go:141] libmachine: (old-k8s-version-456130) starting domain...
I0127 14:07:14.735345 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:14.735354 601373 main.go:141] libmachine: (old-k8s-version-456130) ensuring networks are active...
I0127 14:07:14.736078 601373 main.go:141] libmachine: (old-k8s-version-456130) Ensuring network default is active
I0127 14:07:14.736546 601373 main.go:141] libmachine: (old-k8s-version-456130) Ensuring network mk-old-k8s-version-456130 is active
I0127 14:07:14.737229 601373 main.go:141] libmachine: (old-k8s-version-456130) getting domain XML...
I0127 14:07:14.738114 601373 main.go:141] libmachine: (old-k8s-version-456130) creating domain...
I0127 14:07:15.087513 601373 main.go:141] libmachine: (old-k8s-version-456130) waiting for IP...
I0127 14:07:15.088394 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:15.088892 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | unable to find current IP address of domain old-k8s-version-456130 in network mk-old-k8s-version-456130
I0127 14:07:15.088956 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:15.088862 601428 retry.go:31] will retry after 201.21015ms: waiting for domain to come up
I0127 14:07:15.291315 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:15.291898 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | unable to find current IP address of domain old-k8s-version-456130 in network mk-old-k8s-version-456130
I0127 14:07:15.291928 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:15.291865 601428 retry.go:31] will retry after 364.577717ms: waiting for domain to come up
I0127 14:07:15.658669 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:15.659190 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | unable to find current IP address of domain old-k8s-version-456130 in network mk-old-k8s-version-456130
I0127 14:07:15.659228 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:15.659157 601428 retry.go:31] will retry after 404.191369ms: waiting for domain to come up
I0127 14:07:16.064871 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:16.065379 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | unable to find current IP address of domain old-k8s-version-456130 in network mk-old-k8s-version-456130
I0127 14:07:16.065404 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:16.065360 601428 retry.go:31] will retry after 381.976708ms: waiting for domain to come up
I0127 14:07:16.449201 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:16.449936 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | unable to find current IP address of domain old-k8s-version-456130 in network mk-old-k8s-version-456130
I0127 14:07:16.449972 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:16.449880 601428 retry.go:31] will retry after 721.819339ms: waiting for domain to come up
I0127 14:07:17.173987 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:17.174609 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | unable to find current IP address of domain old-k8s-version-456130 in network mk-old-k8s-version-456130
I0127 14:07:17.174767 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:17.174677 601428 retry.go:31] will retry after 772.050716ms: waiting for domain to come up
I0127 14:07:17.948225 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:17.948829 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | unable to find current IP address of domain old-k8s-version-456130 in network mk-old-k8s-version-456130
I0127 14:07:17.948864 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:17.948796 601428 retry.go:31] will retry after 1.177964657s: waiting for domain to come up
I0127 14:07:19.128849 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:19.129408 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | unable to find current IP address of domain old-k8s-version-456130 in network mk-old-k8s-version-456130
I0127 14:07:19.129462 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:19.129393 601428 retry.go:31] will retry after 1.350853517s: waiting for domain to come up
I0127 14:07:20.481419 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:20.482014 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | unable to find current IP address of domain old-k8s-version-456130 in network mk-old-k8s-version-456130
I0127 14:07:20.482047 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:20.481986 601428 retry.go:31] will retry after 1.638043789s: waiting for domain to come up
I0127 14:07:22.122901 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:22.123420 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | unable to find current IP address of domain old-k8s-version-456130 in network mk-old-k8s-version-456130
I0127 14:07:22.123453 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:22.123394 601428 retry.go:31] will retry after 1.931533143s: waiting for domain to come up
I0127 14:07:24.056550 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:24.057018 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | unable to find current IP address of domain old-k8s-version-456130 in network mk-old-k8s-version-456130
I0127 14:07:24.057055 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:24.056972 601428 retry.go:31] will retry after 2.631367173s: waiting for domain to come up
I0127 14:07:26.690994 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:26.691454 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | unable to find current IP address of domain old-k8s-version-456130 in network mk-old-k8s-version-456130
I0127 14:07:26.691483 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:26.691426 601428 retry.go:31] will retry after 2.87215572s: waiting for domain to come up
I0127 14:07:29.565695 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:29.566562 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | unable to find current IP address of domain old-k8s-version-456130 in network mk-old-k8s-version-456130
I0127 14:07:29.566623 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:29.566524 601428 retry.go:31] will retry after 3.604112007s: waiting for domain to come up
I0127 14:07:33.172403 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:33.172849 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | unable to find current IP address of domain old-k8s-version-456130 in network mk-old-k8s-version-456130
I0127 14:07:33.172876 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | I0127 14:07:33.172812 601428 retry.go:31] will retry after 4.68333271s: waiting for domain to come up
I0127 14:07:37.858679 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:37.859268 601373 main.go:141] libmachine: (old-k8s-version-456130) found domain IP: 192.168.39.11
I0127 14:07:37.859297 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has current primary IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:37.859306 601373 main.go:141] libmachine: (old-k8s-version-456130) reserving static IP address...
I0127 14:07:37.859773 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-456130", mac: "52:54:00:7a:98:59", ip: "192.168.39.11"} in network mk-old-k8s-version-456130
I0127 14:07:37.936631 601373 main.go:141] libmachine: (old-k8s-version-456130) reserved static IP address 192.168.39.11 for domain old-k8s-version-456130
I0127 14:07:37.936653 601373 main.go:141] libmachine: (old-k8s-version-456130) waiting for SSH...
I0127 14:07:37.936672 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | Getting to WaitForSSH function...
I0127 14:07:37.939856 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:37.940315 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:minikube Clientid:01:52:54:00:7a:98:59}
I0127 14:07:37.940348 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:37.940513 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | Using SSH client type: external
I0127 14:07:37.940543 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | Using SSH private key: /home/jenkins/minikube-integration/20327-555419/.minikube/machines/old-k8s-version-456130/id_rsa (-rw-------)
I0127 14:07:37.940587 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.11 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20327-555419/.minikube/machines/old-k8s-version-456130/id_rsa -p 22] /usr/bin/ssh <nil>}
I0127 14:07:37.940600 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | About to run SSH command:
I0127 14:07:37.940617 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | exit 0
I0127 14:07:38.073351 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | SSH cmd err, output: <nil>:
I0127 14:07:38.073659 601373 main.go:141] libmachine: (old-k8s-version-456130) KVM machine creation complete
I0127 14:07:38.074038 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetConfigRaw
I0127 14:07:38.074586 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .DriverName
I0127 14:07:38.074794 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .DriverName
I0127 14:07:38.074968 601373 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0127 14:07:38.074986 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetState
I0127 14:07:38.076416 601373 main.go:141] libmachine: Detecting operating system of created instance...
I0127 14:07:38.076432 601373 main.go:141] libmachine: Waiting for SSH to be available...
I0127 14:07:38.076437 601373 main.go:141] libmachine: Getting to WaitForSSH function...
I0127 14:07:38.076443 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHHostname
I0127 14:07:38.078903 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:38.079276 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:old-k8s-version-456130 Clientid:01:52:54:00:7a:98:59}
I0127 14:07:38.079301 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:38.079448 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHPort
I0127 14:07:38.079611 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHKeyPath
I0127 14:07:38.079767 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHKeyPath
I0127 14:07:38.079869 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHUsername
I0127 14:07:38.080054 601373 main.go:141] libmachine: Using SSH client type: native
I0127 14:07:38.080290 601373 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.11 22 <nil> <nil>}
I0127 14:07:38.080303 601373 main.go:141] libmachine: About to run SSH command:
exit 0
I0127 14:07:38.192900 601373 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0127 14:07:38.192925 601373 main.go:141] libmachine: Detecting the provisioner...
I0127 14:07:38.192936 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHHostname
I0127 14:07:38.196189 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:38.196679 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:old-k8s-version-456130 Clientid:01:52:54:00:7a:98:59}
I0127 14:07:38.196715 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:38.196922 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHPort
I0127 14:07:38.197138 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHKeyPath
I0127 14:07:38.197349 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHKeyPath
I0127 14:07:38.197518 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHUsername
I0127 14:07:38.197752 601373 main.go:141] libmachine: Using SSH client type: native
I0127 14:07:38.197988 601373 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.11 22 <nil> <nil>}
I0127 14:07:38.198002 601373 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0127 14:07:38.314425 601373 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0127 14:07:38.314531 601373 main.go:141] libmachine: found compatible host: buildroot
I0127 14:07:38.314544 601373 main.go:141] libmachine: Provisioning with buildroot...
I0127 14:07:38.314556 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetMachineName
I0127 14:07:38.314848 601373 buildroot.go:166] provisioning hostname "old-k8s-version-456130"
I0127 14:07:38.314881 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetMachineName
I0127 14:07:38.315107 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHHostname
I0127 14:07:38.318691 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:38.319182 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:old-k8s-version-456130 Clientid:01:52:54:00:7a:98:59}
I0127 14:07:38.319216 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:38.319400 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHPort
I0127 14:07:38.319640 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHKeyPath
I0127 14:07:38.319829 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHKeyPath
I0127 14:07:38.320042 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHUsername
I0127 14:07:38.320258 601373 main.go:141] libmachine: Using SSH client type: native
I0127 14:07:38.320476 601373 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.11 22 <nil> <nil>}
I0127 14:07:38.320491 601373 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-456130 && echo "old-k8s-version-456130" | sudo tee /etc/hostname
I0127 14:07:38.454864 601373 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-456130
I0127 14:07:38.454932 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHHostname
I0127 14:07:38.457742 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:38.458173 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:old-k8s-version-456130 Clientid:01:52:54:00:7a:98:59}
I0127 14:07:38.458207 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:38.458350 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHPort
I0127 14:07:38.458587 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHKeyPath
I0127 14:07:38.458762 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHKeyPath
I0127 14:07:38.458927 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHUsername
I0127 14:07:38.459102 601373 main.go:141] libmachine: Using SSH client type: native
I0127 14:07:38.459311 601373 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.11 22 <nil> <nil>}
I0127 14:07:38.459349 601373 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-456130' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-456130/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-456130' | sudo tee -a /etc/hosts;
fi
fi
I0127 14:07:38.585645 601373 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0127 14:07:38.585683 601373 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20327-555419/.minikube CaCertPath:/home/jenkins/minikube-integration/20327-555419/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20327-555419/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20327-555419/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20327-555419/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20327-555419/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20327-555419/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20327-555419/.minikube}
I0127 14:07:38.585741 601373 buildroot.go:174] setting up certificates
I0127 14:07:38.585755 601373 provision.go:84] configureAuth start
I0127 14:07:38.585772 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetMachineName
I0127 14:07:38.586102 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetIP
I0127 14:07:38.589345 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:38.589793 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:old-k8s-version-456130 Clientid:01:52:54:00:7a:98:59}
I0127 14:07:38.589823 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:38.589991 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHHostname
I0127 14:07:38.592421 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:38.592828 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:old-k8s-version-456130 Clientid:01:52:54:00:7a:98:59}
I0127 14:07:38.592860 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:38.593007 601373 provision.go:143] copyHostCerts
I0127 14:07:38.593064 601373 exec_runner.go:144] found /home/jenkins/minikube-integration/20327-555419/.minikube/key.pem, removing ...
I0127 14:07:38.593091 601373 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20327-555419/.minikube/key.pem
I0127 14:07:38.593170 601373 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20327-555419/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20327-555419/.minikube/key.pem (1675 bytes)
I0127 14:07:38.593347 601373 exec_runner.go:144] found /home/jenkins/minikube-integration/20327-555419/.minikube/ca.pem, removing ...
I0127 14:07:38.593362 601373 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20327-555419/.minikube/ca.pem
I0127 14:07:38.593392 601373 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20327-555419/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20327-555419/.minikube/ca.pem (1078 bytes)
I0127 14:07:38.593472 601373 exec_runner.go:144] found /home/jenkins/minikube-integration/20327-555419/.minikube/cert.pem, removing ...
I0127 14:07:38.593481 601373 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20327-555419/.minikube/cert.pem
I0127 14:07:38.593503 601373 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20327-555419/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20327-555419/.minikube/cert.pem (1123 bytes)
I0127 14:07:38.593570 601373 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20327-555419/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20327-555419/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20327-555419/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-456130 san=[127.0.0.1 192.168.39.11 localhost minikube old-k8s-version-456130]
I0127 14:07:38.768898 601373 provision.go:177] copyRemoteCerts
I0127 14:07:38.768964 601373 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0127 14:07:38.768999 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHHostname
I0127 14:07:38.771730 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:38.772083 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:old-k8s-version-456130 Clientid:01:52:54:00:7a:98:59}
I0127 14:07:38.772124 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:38.772282 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHPort
I0127 14:07:38.772477 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHKeyPath
I0127 14:07:38.772635 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHUsername
I0127 14:07:38.772784 601373 sshutil.go:53] new ssh client: &{IP:192.168.39.11 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20327-555419/.minikube/machines/old-k8s-version-456130/id_rsa Username:docker}
I0127 14:07:38.859870 601373 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20327-555419/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0127 14:07:38.885052 601373 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20327-555419/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0127 14:07:38.911635 601373 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20327-555419/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0127 14:07:38.935458 601373 provision.go:87] duration metric: took 349.687848ms to configureAuth
I0127 14:07:38.935490 601373 buildroot.go:189] setting minikube options for container-runtime
I0127 14:07:38.935724 601373 config.go:182] Loaded profile config "old-k8s-version-456130": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0127 14:07:38.935827 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHHostname
I0127 14:07:38.939100 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:38.939413 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:old-k8s-version-456130 Clientid:01:52:54:00:7a:98:59}
I0127 14:07:38.939445 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:38.939604 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHPort
I0127 14:07:38.939827 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHKeyPath
I0127 14:07:38.940036 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHKeyPath
I0127 14:07:38.940197 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHUsername
I0127 14:07:38.940380 601373 main.go:141] libmachine: Using SSH client type: native
I0127 14:07:38.940629 601373 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.11 22 <nil> <nil>}
I0127 14:07:38.940652 601373 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0127 14:07:39.198836 601373 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0127 14:07:39.198866 601373 main.go:141] libmachine: Checking connection to Docker...
I0127 14:07:39.198874 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetURL
I0127 14:07:39.200067 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | using libvirt version 6000000
I0127 14:07:39.203833 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:39.204766 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:old-k8s-version-456130 Clientid:01:52:54:00:7a:98:59}
I0127 14:07:39.204793 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:39.205007 601373 main.go:141] libmachine: Docker is up and running!
I0127 14:07:39.205024 601373 main.go:141] libmachine: Reticulating splines...
I0127 14:07:39.205031 601373 client.go:171] duration metric: took 24.938263372s to LocalClient.Create
I0127 14:07:39.205058 601373 start.go:167] duration metric: took 24.938330128s to libmachine.API.Create "old-k8s-version-456130"
I0127 14:07:39.205072 601373 start.go:293] postStartSetup for "old-k8s-version-456130" (driver="kvm2")
I0127 14:07:39.205093 601373 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0127 14:07:39.205118 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .DriverName
I0127 14:07:39.205374 601373 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0127 14:07:39.205407 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHHostname
I0127 14:07:39.210121 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:39.212293 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:old-k8s-version-456130 Clientid:01:52:54:00:7a:98:59}
I0127 14:07:39.212324 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:39.212592 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHPort
I0127 14:07:39.212757 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHKeyPath
I0127 14:07:39.212942 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHUsername
I0127 14:07:39.213088 601373 sshutil.go:53] new ssh client: &{IP:192.168.39.11 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20327-555419/.minikube/machines/old-k8s-version-456130/id_rsa Username:docker}
I0127 14:07:39.300676 601373 ssh_runner.go:195] Run: cat /etc/os-release
I0127 14:07:39.305063 601373 info.go:137] Remote host: Buildroot 2023.02.9
I0127 14:07:39.305089 601373 filesync.go:126] Scanning /home/jenkins/minikube-integration/20327-555419/.minikube/addons for local assets ...
I0127 14:07:39.305171 601373 filesync.go:126] Scanning /home/jenkins/minikube-integration/20327-555419/.minikube/files for local assets ...
I0127 14:07:39.305268 601373 filesync.go:149] local asset: /home/jenkins/minikube-integration/20327-555419/.minikube/files/etc/ssl/certs/5626362.pem -> 5626362.pem in /etc/ssl/certs
I0127 14:07:39.305392 601373 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0127 14:07:39.316817 601373 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20327-555419/.minikube/files/etc/ssl/certs/5626362.pem --> /etc/ssl/certs/5626362.pem (1708 bytes)
I0127 14:07:39.342960 601373 start.go:296] duration metric: took 137.875244ms for postStartSetup
I0127 14:07:39.343015 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetConfigRaw
I0127 14:07:39.343611 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetIP
I0127 14:07:39.753533 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:39.753907 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:old-k8s-version-456130 Clientid:01:52:54:00:7a:98:59}
I0127 14:07:39.753930 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:39.754271 601373 profile.go:143] Saving config to /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/config.json ...
I0127 14:07:39.754483 601373 start.go:128] duration metric: took 25.508299796s to createHost
I0127 14:07:39.754518 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHHostname
I0127 14:07:39.756915 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:39.757237 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:old-k8s-version-456130 Clientid:01:52:54:00:7a:98:59}
I0127 14:07:39.757272 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:39.757400 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHPort
I0127 14:07:39.757611 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHKeyPath
I0127 14:07:39.757779 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHKeyPath
I0127 14:07:39.757926 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHUsername
I0127 14:07:39.758089 601373 main.go:141] libmachine: Using SSH client type: native
I0127 14:07:39.758248 601373 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x8641c0] 0x866ea0 <nil> [] 0s} 192.168.39.11 22 <nil> <nil>}
I0127 14:07:39.758258 601373 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0127 14:07:39.879057 601373 main.go:141] libmachine: SSH cmd err, output: <nil>: 1737986859.855229643
I0127 14:07:39.879079 601373 fix.go:216] guest clock: 1737986859.855229643
I0127 14:07:39.879088 601373 fix.go:229] Guest: 2025-01-27 14:07:39.855229643 +0000 UTC Remote: 2025-01-27 14:07:39.75450005 +0000 UTC m=+31.428265457 (delta=100.729593ms)
I0127 14:07:39.879122 601373 fix.go:200] guest clock delta is within tolerance: 100.729593ms
I0127 14:07:39.879129 601373 start.go:83] releasing machines lock for "old-k8s-version-456130", held for 25.633123341s
I0127 14:07:39.879156 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .DriverName
I0127 14:07:39.879419 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetIP
I0127 14:07:39.882266 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:39.882753 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:old-k8s-version-456130 Clientid:01:52:54:00:7a:98:59}
I0127 14:07:39.882778 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:39.882967 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .DriverName
I0127 14:07:39.883551 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .DriverName
I0127 14:07:39.883743 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .DriverName
I0127 14:07:39.883842 601373 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0127 14:07:39.883882 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHHostname
I0127 14:07:39.884110 601373 ssh_runner.go:195] Run: cat /version.json
I0127 14:07:39.884136 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHHostname
I0127 14:07:39.886654 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:39.887060 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:old-k8s-version-456130 Clientid:01:52:54:00:7a:98:59}
I0127 14:07:39.887121 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:39.887145 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:39.887321 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHPort
I0127 14:07:39.887480 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHKeyPath
I0127 14:07:39.887648 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:old-k8s-version-456130 Clientid:01:52:54:00:7a:98:59}
I0127 14:07:39.887663 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHUsername
I0127 14:07:39.887669 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:39.887828 601373 sshutil.go:53] new ssh client: &{IP:192.168.39.11 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20327-555419/.minikube/machines/old-k8s-version-456130/id_rsa Username:docker}
I0127 14:07:39.887853 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHPort
I0127 14:07:39.888019 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHKeyPath
I0127 14:07:39.888172 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetSSHUsername
I0127 14:07:39.888306 601373 sshutil.go:53] new ssh client: &{IP:192.168.39.11 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20327-555419/.minikube/machines/old-k8s-version-456130/id_rsa Username:docker}
I0127 14:07:39.974593 601373 ssh_runner.go:195] Run: systemctl --version
I0127 14:07:39.998185 601373 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0127 14:07:40.159948 601373 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0127 14:07:40.166159 601373 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0127 14:07:40.166229 601373 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0127 14:07:40.185635 601373 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0127 14:07:40.185657 601373 start.go:495] detecting cgroup driver to use...
I0127 14:07:40.185727 601373 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0127 14:07:40.204886 601373 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0127 14:07:40.218758 601373 docker.go:217] disabling cri-docker service (if available) ...
I0127 14:07:40.218813 601373 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0127 14:07:40.234338 601373 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0127 14:07:40.249194 601373 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0127 14:07:40.405723 601373 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0127 14:07:40.561717 601373 docker.go:233] disabling docker service ...
I0127 14:07:40.561787 601373 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0127 14:07:40.577711 601373 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0127 14:07:40.593087 601373 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0127 14:07:40.765539 601373 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0127 14:07:40.900954 601373 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0127 14:07:40.915793 601373 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0127 14:07:40.935250 601373 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0127 14:07:40.935316 601373 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0127 14:07:40.945849 601373 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0127 14:07:40.945907 601373 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0127 14:07:40.955796 601373 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0127 14:07:40.965535 601373 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0127 14:07:40.975655 601373 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0127 14:07:40.985983 601373 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0127 14:07:40.995087 601373 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0127 14:07:40.995142 601373 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0127 14:07:41.007442 601373 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0127 14:07:41.018580 601373 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 14:07:41.150827 601373 ssh_runner.go:195] Run: sudo systemctl restart crio
I0127 14:07:41.235346 601373 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0127 14:07:41.235426 601373 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0127 14:07:41.239989 601373 start.go:563] Will wait 60s for crictl version
I0127 14:07:41.240037 601373 ssh_runner.go:195] Run: which crictl
I0127 14:07:41.243750 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0127 14:07:41.280633 601373 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0127 14:07:41.280709 601373 ssh_runner.go:195] Run: crio --version
I0127 14:07:41.312743 601373 ssh_runner.go:195] Run: crio --version
I0127 14:07:41.342444 601373 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0127 14:07:41.343595 601373 main.go:141] libmachine: (old-k8s-version-456130) Calling .GetIP
I0127 14:07:41.346163 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:41.346587 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:7a:98:59", ip: ""} in network mk-old-k8s-version-456130: {Iface:virbr2 ExpiryTime:2025-01-27 15:07:28 +0000 UTC Type:0 Mac:52:54:00:7a:98:59 Iaid: IPaddr:192.168.39.11 Prefix:24 Hostname:old-k8s-version-456130 Clientid:01:52:54:00:7a:98:59}
I0127 14:07:41.346619 601373 main.go:141] libmachine: (old-k8s-version-456130) DBG | domain old-k8s-version-456130 has defined IP address 192.168.39.11 and MAC address 52:54:00:7a:98:59 in network mk-old-k8s-version-456130
I0127 14:07:41.346796 601373 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0127 14:07:41.351141 601373 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 14:07:41.363722 601373 kubeadm.go:883] updating cluster {Name:old-k8s-version-456130 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-456130 Namespace
:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.11 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: D
isableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0127 14:07:41.363830 601373 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0127 14:07:41.363893 601373 ssh_runner.go:195] Run: sudo crictl images --output json
I0127 14:07:41.394760 601373 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0127 14:07:41.394820 601373 ssh_runner.go:195] Run: which lz4
I0127 14:07:41.398404 601373 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0127 14:07:41.402316 601373 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0127 14:07:41.402348 601373 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20327-555419/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0127 14:07:43.199494 601373 crio.go:462] duration metric: took 1.801104328s to copy over tarball
I0127 14:07:43.199572 601373 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0127 14:07:45.681236 601373 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.481625055s)
I0127 14:07:45.681272 601373 crio.go:469] duration metric: took 2.481746403s to extract the tarball
I0127 14:07:45.681283 601373 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0127 14:07:45.723404 601373 ssh_runner.go:195] Run: sudo crictl images --output json
I0127 14:07:45.766291 601373 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0127 14:07:45.766315 601373 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0127 14:07:45.766388 601373 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0127 14:07:45.766433 601373 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0127 14:07:45.766461 601373 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 14:07:45.766492 601373 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 14:07:45.766533 601373 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0127 14:07:45.766531 601373 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0127 14:07:45.766468 601373 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 14:07:45.766411 601373 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0127 14:07:45.767945 601373 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0127 14:07:45.767945 601373 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 14:07:45.767990 601373 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0127 14:07:45.767960 601373 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0127 14:07:45.768071 601373 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0127 14:07:45.767958 601373 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 14:07:45.767963 601373 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 14:07:45.767961 601373 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0127 14:07:45.921712 601373 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0127 14:07:45.928344 601373 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0127 14:07:45.928604 601373 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0127 14:07:45.933554 601373 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0127 14:07:45.933934 601373 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0127 14:07:45.938018 601373 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0127 14:07:45.983763 601373 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0127 14:07:46.033999 601373 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0127 14:07:46.034053 601373 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0127 14:07:46.034110 601373 ssh_runner.go:195] Run: which crictl
I0127 14:07:46.068009 601373 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0127 14:07:46.068059 601373 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0127 14:07:46.068054 601373 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0127 14:07:46.068098 601373 ssh_runner.go:195] Run: which crictl
I0127 14:07:46.068110 601373 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0127 14:07:46.068153 601373 ssh_runner.go:195] Run: which crictl
I0127 14:07:46.104861 601373 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0127 14:07:46.104892 601373 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0127 14:07:46.104913 601373 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0127 14:07:46.104924 601373 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0127 14:07:46.104953 601373 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0127 14:07:46.104964 601373 ssh_runner.go:195] Run: which crictl
I0127 14:07:46.104980 601373 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0127 14:07:46.105007 601373 ssh_runner.go:195] Run: which crictl
I0127 14:07:46.104962 601373 ssh_runner.go:195] Run: which crictl
I0127 14:07:46.110692 601373 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0127 14:07:46.110724 601373 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0127 14:07:46.110749 601373 ssh_runner.go:195] Run: which crictl
I0127 14:07:46.110774 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 14:07:46.110698 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 14:07:46.110853 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 14:07:46.118171 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 14:07:46.118213 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 14:07:46.118271 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 14:07:46.133826 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 14:07:46.248375 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 14:07:46.248407 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 14:07:46.259675 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 14:07:46.259775 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 14:07:46.285086 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 14:07:46.285190 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 14:07:46.297983 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 14:07:46.375150 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0127 14:07:46.406972 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0127 14:07:46.407097 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0127 14:07:46.407118 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0127 14:07:46.429281 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0127 14:07:46.441476 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0127 14:07:46.441554 601373 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0127 14:07:46.519114 601373 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20327-555419/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0127 14:07:46.566524 601373 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20327-555419/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0127 14:07:46.566546 601373 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20327-555419/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0127 14:07:46.566643 601373 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20327-555419/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0127 14:07:46.584390 601373 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20327-555419/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0127 14:07:46.585274 601373 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20327-555419/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0127 14:07:46.585389 601373 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20327-555419/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0127 14:07:46.674534 601373 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0127 14:07:46.815091 601373 cache_images.go:92] duration metric: took 1.048759178s to LoadCachedImages
W0127 14:07:46.815206 601373 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20327-555419/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20327-555419/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0: no such file or directory
I0127 14:07:46.815228 601373 kubeadm.go:934] updating node { 192.168.39.11 8443 v1.20.0 crio true true} ...
I0127 14:07:46.815358 601373 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-456130 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.39.11
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-456130 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0127 14:07:46.815423 601373 ssh_runner.go:195] Run: crio config
I0127 14:07:46.874094 601373 cni.go:84] Creating CNI manager for ""
I0127 14:07:46.874116 601373 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0127 14:07:46.874125 601373 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0127 14:07:46.874148 601373 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.11 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-456130 NodeName:old-k8s-version-456130 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.11"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.11 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt Stati
cPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0127 14:07:46.874318 601373 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.11
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-456130"
kubeletExtraArgs:
node-ip: 192.168.39.11
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.11"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0127 14:07:46.874398 601373 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0127 14:07:46.884483 601373 binaries.go:44] Found k8s binaries, skipping transfer
I0127 14:07:46.884548 601373 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0127 14:07:46.893923 601373 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (429 bytes)
I0127 14:07:46.910086 601373 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0127 14:07:46.926183 601373 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2120 bytes)
I0127 14:07:46.942181 601373 ssh_runner.go:195] Run: grep 192.168.39.11 control-plane.minikube.internal$ /etc/hosts
I0127 14:07:46.945997 601373 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.11 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0127 14:07:46.957628 601373 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0127 14:07:47.083251 601373 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0127 14:07:47.099548 601373 certs.go:68] Setting up /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130 for IP: 192.168.39.11
I0127 14:07:47.099571 601373 certs.go:194] generating shared ca certs ...
I0127 14:07:47.099620 601373 certs.go:226] acquiring lock for ca certs: {Name:mk51b28ee386f676931205574822c74a9ffc3062 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 14:07:47.099825 601373 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20327-555419/.minikube/ca.key
I0127 14:07:47.099872 601373 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20327-555419/.minikube/proxy-client-ca.key
I0127 14:07:47.099883 601373 certs.go:256] generating profile certs ...
I0127 14:07:47.099941 601373 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/client.key
I0127 14:07:47.099966 601373 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/client.crt with IP's: []
I0127 14:07:47.231224 601373 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/client.crt ...
I0127 14:07:47.231255 601373 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/client.crt: {Name:mk2195be2553687d06225303e1e64a924b7177d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 14:07:47.231412 601373 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/client.key ...
I0127 14:07:47.231425 601373 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/client.key: {Name:mk5eae8d9e14b45dbe6c6e0f3c3649d5f4445d5f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 14:07:47.261333 601373 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/apiserver.key.294f913a
I0127 14:07:47.261392 601373 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/apiserver.crt.294f913a with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.11]
I0127 14:07:47.431351 601373 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/apiserver.crt.294f913a ...
I0127 14:07:47.431380 601373 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/apiserver.crt.294f913a: {Name:mkcee3647454c013eeabdf2b71abfeb33a090099 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 14:07:47.436354 601373 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/apiserver.key.294f913a ...
I0127 14:07:47.436381 601373 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/apiserver.key.294f913a: {Name:mk7ade60d44a5e93338e4cd40c9a2ac34565f282 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 14:07:47.436491 601373 certs.go:381] copying /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/apiserver.crt.294f913a -> /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/apiserver.crt
I0127 14:07:47.436583 601373 certs.go:385] copying /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/apiserver.key.294f913a -> /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/apiserver.key
I0127 14:07:47.436654 601373 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/proxy-client.key
I0127 14:07:47.436674 601373 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/proxy-client.crt with IP's: []
I0127 14:07:47.602017 601373 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/proxy-client.crt ...
I0127 14:07:47.602048 601373 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/proxy-client.crt: {Name:mkdc8c889c4adb19570ac53e2a3880c16e79ab20 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 14:07:47.602204 601373 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/proxy-client.key ...
I0127 14:07:47.602217 601373 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/proxy-client.key: {Name:mk1e4f6a3159570dde8e09b032b2a9e14d0b7aaf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0127 14:07:47.602383 601373 certs.go:484] found cert: /home/jenkins/minikube-integration/20327-555419/.minikube/certs/562636.pem (1338 bytes)
W0127 14:07:47.602419 601373 certs.go:480] ignoring /home/jenkins/minikube-integration/20327-555419/.minikube/certs/562636_empty.pem, impossibly tiny 0 bytes
I0127 14:07:47.602429 601373 certs.go:484] found cert: /home/jenkins/minikube-integration/20327-555419/.minikube/certs/ca-key.pem (1675 bytes)
I0127 14:07:47.602450 601373 certs.go:484] found cert: /home/jenkins/minikube-integration/20327-555419/.minikube/certs/ca.pem (1078 bytes)
I0127 14:07:47.602472 601373 certs.go:484] found cert: /home/jenkins/minikube-integration/20327-555419/.minikube/certs/cert.pem (1123 bytes)
I0127 14:07:47.602492 601373 certs.go:484] found cert: /home/jenkins/minikube-integration/20327-555419/.minikube/certs/key.pem (1675 bytes)
I0127 14:07:47.602527 601373 certs.go:484] found cert: /home/jenkins/minikube-integration/20327-555419/.minikube/files/etc/ssl/certs/5626362.pem (1708 bytes)
I0127 14:07:47.603059 601373 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20327-555419/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0127 14:07:47.629391 601373 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20327-555419/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0127 14:07:47.653289 601373 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20327-555419/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0127 14:07:47.676831 601373 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20327-555419/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0127 14:07:47.700476 601373 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0127 14:07:47.730298 601373 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0127 14:07:47.756643 601373 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0127 14:07:47.780594 601373 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20327-555419/.minikube/profiles/old-k8s-version-456130/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0127 14:07:47.804880 601373 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20327-555419/.minikube/files/etc/ssl/certs/5626362.pem --> /usr/share/ca-certificates/5626362.pem (1708 bytes)
I0127 14:07:47.827867 601373 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20327-555419/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0127 14:07:47.851041 601373 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20327-555419/.minikube/certs/562636.pem --> /usr/share/ca-certificates/562636.pem (1338 bytes)
I0127 14:07:47.875254 601373 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0127 14:07:47.891763 601373 ssh_runner.go:195] Run: openssl version
I0127 14:07:47.897606 601373 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/562636.pem && ln -fs /usr/share/ca-certificates/562636.pem /etc/ssl/certs/562636.pem"
I0127 14:07:47.908349 601373 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/562636.pem
I0127 14:07:47.912980 601373 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jan 27 13:11 /usr/share/ca-certificates/562636.pem
I0127 14:07:47.913025 601373 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/562636.pem
I0127 14:07:47.919121 601373 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/562636.pem /etc/ssl/certs/51391683.0"
I0127 14:07:47.929695 601373 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/5626362.pem && ln -fs /usr/share/ca-certificates/5626362.pem /etc/ssl/certs/5626362.pem"
I0127 14:07:47.943397 601373 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/5626362.pem
I0127 14:07:47.948357 601373 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jan 27 13:11 /usr/share/ca-certificates/5626362.pem
I0127 14:07:47.948408 601373 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/5626362.pem
I0127 14:07:47.954207 601373 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/5626362.pem /etc/ssl/certs/3ec20f2e.0"
I0127 14:07:47.966803 601373 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0127 14:07:47.979856 601373 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0127 14:07:47.984586 601373 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jan 27 13:03 /usr/share/ca-certificates/minikubeCA.pem
I0127 14:07:47.984628 601373 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0127 14:07:47.994192 601373 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0127 14:07:48.014136 601373 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0127 14:07:48.021745 601373 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0127 14:07:48.021812 601373 kubeadm.go:392] StartCluster: {Name:old-k8s-version-456130 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.46@sha256:fd2d445ddcc33ebc5c6b68a17e6219ea207ce63c005095ea1525296da2d1a279 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-456130 Namespace:de
fault APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.11 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disa
bleOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0127 14:07:48.021934 601373 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0127 14:07:48.021983 601373 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0127 14:07:48.068726 601373 cri.go:89] found id: ""
I0127 14:07:48.068811 601373 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0127 14:07:48.079370 601373 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0127 14:07:48.092372 601373 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0127 14:07:48.105607 601373 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0127 14:07:48.105625 601373 kubeadm.go:157] found existing configuration files:
I0127 14:07:48.105664 601373 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0127 14:07:48.118318 601373 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0127 14:07:48.118379 601373 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0127 14:07:48.128022 601373 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0127 14:07:48.137623 601373 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0127 14:07:48.137689 601373 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0127 14:07:48.149172 601373 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0127 14:07:48.161255 601373 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0127 14:07:48.161297 601373 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0127 14:07:48.176810 601373 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0127 14:07:48.185831 601373 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0127 14:07:48.185885 601373 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0127 14:07:48.195275 601373 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0127 14:07:48.482045 601373 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0127 14:09:45.518482 601373 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0127 14:09:45.518597 601373 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0127 14:09:45.520473 601373 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0127 14:09:45.520526 601373 kubeadm.go:310] [preflight] Running pre-flight checks
I0127 14:09:45.520649 601373 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0127 14:09:45.520791 601373 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0127 14:09:45.520909 601373 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0127 14:09:45.520997 601373 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0127 14:09:45.522588 601373 out.go:235] - Generating certificates and keys ...
I0127 14:09:45.522688 601373 kubeadm.go:310] [certs] Using existing ca certificate authority
I0127 14:09:45.522771 601373 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0127 14:09:45.522856 601373 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0127 14:09:45.522951 601373 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0127 14:09:45.523036 601373 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0127 14:09:45.523105 601373 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0127 14:09:45.523177 601373 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0127 14:09:45.523372 601373 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-456130] and IPs [192.168.39.11 127.0.0.1 ::1]
I0127 14:09:45.523453 601373 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0127 14:09:45.523659 601373 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-456130] and IPs [192.168.39.11 127.0.0.1 ::1]
I0127 14:09:45.523773 601373 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0127 14:09:45.523884 601373 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0127 14:09:45.523951 601373 kubeadm.go:310] [certs] Generating "sa" key and public key
I0127 14:09:45.524033 601373 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0127 14:09:45.524121 601373 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0127 14:09:45.524202 601373 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0127 14:09:45.524302 601373 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0127 14:09:45.524390 601373 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0127 14:09:45.524510 601373 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0127 14:09:45.524615 601373 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0127 14:09:45.524676 601373 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0127 14:09:45.524767 601373 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0127 14:09:45.525979 601373 out.go:235] - Booting up control plane ...
I0127 14:09:45.526078 601373 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0127 14:09:45.526177 601373 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0127 14:09:45.526271 601373 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0127 14:09:45.526373 601373 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0127 14:09:45.526568 601373 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0127 14:09:45.526623 601373 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0127 14:09:45.526716 601373 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 14:09:45.526951 601373 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 14:09:45.527054 601373 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 14:09:45.527325 601373 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 14:09:45.527444 601373 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 14:09:45.527637 601373 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 14:09:45.527696 601373 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 14:09:45.527864 601373 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 14:09:45.527966 601373 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 14:09:45.528174 601373 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 14:09:45.528190 601373 kubeadm.go:310]
I0127 14:09:45.528244 601373 kubeadm.go:310] Unfortunately, an error has occurred:
I0127 14:09:45.528299 601373 kubeadm.go:310] timed out waiting for the condition
I0127 14:09:45.528307 601373 kubeadm.go:310]
I0127 14:09:45.528363 601373 kubeadm.go:310] This error is likely caused by:
I0127 14:09:45.528405 601373 kubeadm.go:310] - The kubelet is not running
I0127 14:09:45.528488 601373 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0127 14:09:45.528494 601373 kubeadm.go:310]
I0127 14:09:45.528580 601373 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0127 14:09:45.528608 601373 kubeadm.go:310] - 'systemctl status kubelet'
I0127 14:09:45.528636 601373 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0127 14:09:45.528643 601373 kubeadm.go:310]
I0127 14:09:45.528733 601373 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0127 14:09:45.528802 601373 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0127 14:09:45.528808 601373 kubeadm.go:310]
I0127 14:09:45.528886 601373 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0127 14:09:45.528957 601373 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0127 14:09:45.529020 601373 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0127 14:09:45.529077 601373 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0127 14:09:45.529162 601373 kubeadm.go:310]
W0127 14:09:45.529212 601373 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-456130] and IPs [192.168.39.11 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-456130] and IPs [192.168.39.11 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-456130] and IPs [192.168.39.11 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-456130] and IPs [192.168.39.11 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0127 14:09:45.529251 601373 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0127 14:09:46.005965 601373 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0127 14:09:46.020432 601373 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0127 14:09:46.030201 601373 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0127 14:09:46.030228 601373 kubeadm.go:157] found existing configuration files:
I0127 14:09:46.030284 601373 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0127 14:09:46.039436 601373 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0127 14:09:46.039500 601373 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0127 14:09:46.048696 601373 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0127 14:09:46.057538 601373 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0127 14:09:46.057617 601373 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0127 14:09:46.066931 601373 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0127 14:09:46.076232 601373 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0127 14:09:46.076275 601373 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0127 14:09:46.085799 601373 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0127 14:09:46.094774 601373 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0127 14:09:46.094823 601373 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0127 14:09:46.103843 601373 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0127 14:09:46.172160 601373 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0127 14:09:46.172260 601373 kubeadm.go:310] [preflight] Running pre-flight checks
I0127 14:09:46.313710 601373 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0127 14:09:46.313844 601373 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0127 14:09:46.313981 601373 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0127 14:09:46.522457 601373 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0127 14:09:46.524018 601373 out.go:235] - Generating certificates and keys ...
I0127 14:09:46.524141 601373 kubeadm.go:310] [certs] Using existing ca certificate authority
I0127 14:09:46.524228 601373 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0127 14:09:46.524341 601373 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0127 14:09:46.524428 601373 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0127 14:09:46.524699 601373 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0127 14:09:46.525006 601373 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0127 14:09:46.525493 601373 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0127 14:09:46.525994 601373 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0127 14:09:46.526516 601373 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0127 14:09:46.527035 601373 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0127 14:09:46.527227 601373 kubeadm.go:310] [certs] Using the existing "sa" key
I0127 14:09:46.527335 601373 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0127 14:09:46.611876 601373 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0127 14:09:46.736374 601373 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0127 14:09:46.822373 601373 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0127 14:09:47.045466 601373 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0127 14:09:47.065839 601373 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0127 14:09:47.066782 601373 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0127 14:09:47.066869 601373 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0127 14:09:47.195929 601373 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0127 14:09:47.197401 601373 out.go:235] - Booting up control plane ...
I0127 14:09:47.197530 601373 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0127 14:09:47.204918 601373 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0127 14:09:47.205024 601373 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0127 14:09:47.205865 601373 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0127 14:09:47.207778 601373 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0127 14:10:27.210483 601373 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0127 14:10:27.210693 601373 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 14:10:27.210946 601373 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 14:10:32.211360 601373 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 14:10:32.211614 601373 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 14:10:42.212371 601373 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 14:10:42.212681 601373 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 14:11:02.211592 601373 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 14:11:02.211810 601373 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 14:11:42.211019 601373 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0127 14:11:42.211257 601373 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0127 14:11:42.211650 601373 kubeadm.go:310]
I0127 14:11:42.211690 601373 kubeadm.go:310] Unfortunately, an error has occurred:
I0127 14:11:42.211730 601373 kubeadm.go:310] timed out waiting for the condition
I0127 14:11:42.211737 601373 kubeadm.go:310]
I0127 14:11:42.211772 601373 kubeadm.go:310] This error is likely caused by:
I0127 14:11:42.211803 601373 kubeadm.go:310] - The kubelet is not running
I0127 14:11:42.211896 601373 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0127 14:11:42.211903 601373 kubeadm.go:310]
I0127 14:11:42.212017 601373 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0127 14:11:42.212072 601373 kubeadm.go:310] - 'systemctl status kubelet'
I0127 14:11:42.212118 601373 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0127 14:11:42.212128 601373 kubeadm.go:310]
I0127 14:11:42.212287 601373 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0127 14:11:42.212403 601373 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0127 14:11:42.212417 601373 kubeadm.go:310]
I0127 14:11:42.212559 601373 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0127 14:11:42.212660 601373 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0127 14:11:42.212727 601373 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0127 14:11:42.212816 601373 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0127 14:11:42.212828 601373 kubeadm.go:310]
I0127 14:11:42.213738 601373 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0127 14:11:42.213852 601373 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0127 14:11:42.213954 601373 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0127 14:11:42.214050 601373 kubeadm.go:394] duration metric: took 3m54.192244016s to StartCluster
I0127 14:11:42.214105 601373 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0127 14:11:42.214175 601373 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0127 14:11:42.266826 601373 cri.go:89] found id: ""
I0127 14:11:42.266856 601373 logs.go:282] 0 containers: []
W0127 14:11:42.266866 601373 logs.go:284] No container was found matching "kube-apiserver"
I0127 14:11:42.266875 601373 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0127 14:11:42.266954 601373 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0127 14:11:42.304300 601373 cri.go:89] found id: ""
I0127 14:11:42.304327 601373 logs.go:282] 0 containers: []
W0127 14:11:42.304334 601373 logs.go:284] No container was found matching "etcd"
I0127 14:11:42.304340 601373 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0127 14:11:42.304401 601373 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0127 14:11:42.348434 601373 cri.go:89] found id: ""
I0127 14:11:42.348463 601373 logs.go:282] 0 containers: []
W0127 14:11:42.348472 601373 logs.go:284] No container was found matching "coredns"
I0127 14:11:42.348481 601373 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0127 14:11:42.348547 601373 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0127 14:11:42.385818 601373 cri.go:89] found id: ""
I0127 14:11:42.385848 601373 logs.go:282] 0 containers: []
W0127 14:11:42.385858 601373 logs.go:284] No container was found matching "kube-scheduler"
I0127 14:11:42.385867 601373 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0127 14:11:42.385938 601373 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0127 14:11:42.430408 601373 cri.go:89] found id: ""
I0127 14:11:42.430435 601373 logs.go:282] 0 containers: []
W0127 14:11:42.430442 601373 logs.go:284] No container was found matching "kube-proxy"
I0127 14:11:42.430449 601373 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0127 14:11:42.430510 601373 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0127 14:11:42.485359 601373 cri.go:89] found id: ""
I0127 14:11:42.485390 601373 logs.go:282] 0 containers: []
W0127 14:11:42.485397 601373 logs.go:284] No container was found matching "kube-controller-manager"
I0127 14:11:42.485403 601373 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0127 14:11:42.485455 601373 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0127 14:11:42.526076 601373 cri.go:89] found id: ""
I0127 14:11:42.526103 601373 logs.go:282] 0 containers: []
W0127 14:11:42.526110 601373 logs.go:284] No container was found matching "kindnet"
I0127 14:11:42.526126 601373 logs.go:123] Gathering logs for CRI-O ...
I0127 14:11:42.526138 601373 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0127 14:11:42.632836 601373 logs.go:123] Gathering logs for container status ...
I0127 14:11:42.632865 601373 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0127 14:11:42.675550 601373 logs.go:123] Gathering logs for kubelet ...
I0127 14:11:42.675578 601373 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0127 14:11:42.726326 601373 logs.go:123] Gathering logs for dmesg ...
I0127 14:11:42.726359 601373 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0127 14:11:42.740009 601373 logs.go:123] Gathering logs for describe nodes ...
I0127 14:11:42.740033 601373 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0127 14:11:42.868780 601373 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
W0127 14:11:42.868808 601373 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 14:11:42.868853 601373 out.go:270] *
*
W0127 14:11:42.868914 601373 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 14:11:42.868933 601373 out.go:270] *
*
W0127 14:11:42.870135 601373 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0127 14:11:42.873633 601373 out.go:201]
W0127 14:11:42.874962 601373 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0127 14:11:42.875016 601373 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0127 14:11:42.875044 601373 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0127 14:11:42.876554 601373 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-456130 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-456130 -n old-k8s-version-456130
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-456130 -n old-k8s-version-456130: exit status 6 (290.206679ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0127 14:11:43.206416 604141 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-456130" does not appear in /home/jenkins/minikube-integration/20327-555419/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-456130" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (274.91s)