=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-471019 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0
E0403 19:19:09.255611 21552 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/functional-789300/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-471019 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0: exit status 109 (4m47.050402034s)
-- stdout --
* [old-k8s-version-471019] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20591
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20591-14371/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20591-14371/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting "old-k8s-version-471019" primary control-plane node in "old-k8s-version-471019" cluster
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0403 19:18:54.258625 62736 out.go:345] Setting OutFile to fd 1 ...
I0403 19:18:54.258726 62736 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0403 19:18:54.258737 62736 out.go:358] Setting ErrFile to fd 2...
I0403 19:18:54.258741 62736 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0403 19:18:54.258973 62736 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20591-14371/.minikube/bin
I0403 19:18:54.259550 62736 out.go:352] Setting JSON to false
I0403 19:18:54.260489 62736 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":7279,"bootTime":1743700655,"procs":209,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1078-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0403 19:18:54.260596 62736 start.go:139] virtualization: kvm guest
I0403 19:18:54.262332 62736 out.go:177] * [old-k8s-version-471019] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0403 19:18:54.263394 62736 notify.go:220] Checking for updates...
I0403 19:18:54.263409 62736 out.go:177] - MINIKUBE_LOCATION=20591
I0403 19:18:54.264392 62736 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0403 19:18:54.265494 62736 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20591-14371/kubeconfig
I0403 19:18:54.266446 62736 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20591-14371/.minikube
I0403 19:18:54.267435 62736 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0403 19:18:54.268485 62736 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0403 19:18:54.269850 62736 config.go:182] Loaded profile config "cert-expiration-954352": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0403 19:18:54.269977 62736 config.go:182] Loaded profile config "cert-options-528707": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0403 19:18:54.270077 62736 config.go:182] Loaded profile config "kubernetes-upgrade-523797": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0403 19:18:54.270190 62736 driver.go:394] Setting default libvirt URI to qemu:///system
I0403 19:18:54.304778 62736 out.go:177] * Using the kvm2 driver based on user configuration
I0403 19:18:54.305732 62736 start.go:297] selected driver: kvm2
I0403 19:18:54.305745 62736 start.go:901] validating driver "kvm2" against <nil>
I0403 19:18:54.305756 62736 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0403 19:18:54.306440 62736 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0403 19:18:54.306512 62736 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/20591-14371/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0403 19:18:54.323479 62736 install.go:137] /home/jenkins/minikube-integration/20591-14371/.minikube/bin/docker-machine-driver-kvm2 version is 1.35.0
I0403 19:18:54.323524 62736 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0403 19:18:54.323747 62736 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0403 19:18:54.323776 62736 cni.go:84] Creating CNI manager for ""
I0403 19:18:54.323814 62736 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0403 19:18:54.323822 62736 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0403 19:18:54.323868 62736 start.go:340] cluster config:
{Name:old-k8s-version-471019 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1743675393-20591@sha256:8de8167e280414c9d16e4c3da59bc85bc7c9cc24228af995863fc7bcabfcf727 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-471019 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0403 19:18:54.323974 62736 iso.go:125] acquiring lock: {Name:mkf6f50c7ede9611c6490e7e32606ab15d31c93b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0403 19:18:54.326102 62736 out.go:177] * Starting "old-k8s-version-471019" primary control-plane node in "old-k8s-version-471019" cluster
I0403 19:18:54.327093 62736 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0403 19:18:54.327133 62736 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20591-14371/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0403 19:18:54.327143 62736 cache.go:56] Caching tarball of preloaded images
I0403 19:18:54.327231 62736 preload.go:172] Found /home/jenkins/minikube-integration/20591-14371/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0403 19:18:54.327246 62736 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0403 19:18:54.327350 62736 profile.go:143] Saving config to /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/config.json ...
I0403 19:18:54.327369 62736 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/config.json: {Name:mk0eeced6959f2a235aacee4e625c59116f4b72c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0403 19:18:54.327516 62736 start.go:360] acquireMachinesLock for old-k8s-version-471019: {Name:mk8972215f0ab94ca7966bf5adf18262e19bccd0 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0403 19:19:12.587659 62736 start.go:364] duration metric: took 18.260092887s to acquireMachinesLock for "old-k8s-version-471019"
I0403 19:19:12.587754 62736 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-471019 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1743675393-20591@sha256:8de8167e280414c9d16e4c3da59bc85bc7c9cc24228af995863fc7bcabfcf727 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 C
lusterName:old-k8s-version-471019 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p M
ountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0403 19:19:12.587903 62736 start.go:125] createHost starting for "" (driver="kvm2")
I0403 19:19:12.589348 62736 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0403 19:19:12.589559 62736 main.go:141] libmachine: Found binary path at /home/jenkins/minikube-integration/20591-14371/.minikube/bin/docker-machine-driver-kvm2
I0403 19:19:12.589624 62736 main.go:141] libmachine: Launching plugin server for driver kvm2
I0403 19:19:12.607183 62736 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42683
I0403 19:19:12.607549 62736 main.go:141] libmachine: () Calling .GetVersion
I0403 19:19:12.608140 62736 main.go:141] libmachine: Using API Version 1
I0403 19:19:12.608169 62736 main.go:141] libmachine: () Calling .SetConfigRaw
I0403 19:19:12.608471 62736 main.go:141] libmachine: () Calling .GetMachineName
I0403 19:19:12.608658 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetMachineName
I0403 19:19:12.608796 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .DriverName
I0403 19:19:12.608945 62736 start.go:159] libmachine.API.Create for "old-k8s-version-471019" (driver="kvm2")
I0403 19:19:12.608976 62736 client.go:168] LocalClient.Create starting
I0403 19:19:12.609008 62736 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20591-14371/.minikube/certs/ca.pem
I0403 19:19:12.609049 62736 main.go:141] libmachine: Decoding PEM data...
I0403 19:19:12.609073 62736 main.go:141] libmachine: Parsing certificate...
I0403 19:19:12.609157 62736 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20591-14371/.minikube/certs/cert.pem
I0403 19:19:12.609198 62736 main.go:141] libmachine: Decoding PEM data...
I0403 19:19:12.609220 62736 main.go:141] libmachine: Parsing certificate...
I0403 19:19:12.609246 62736 main.go:141] libmachine: Running pre-create checks...
I0403 19:19:12.609259 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .PreCreateCheck
I0403 19:19:12.609537 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetConfigRaw
I0403 19:19:12.609969 62736 main.go:141] libmachine: Creating machine...
I0403 19:19:12.609984 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .Create
I0403 19:19:12.610092 62736 main.go:141] libmachine: (old-k8s-version-471019) creating KVM machine...
I0403 19:19:12.610110 62736 main.go:141] libmachine: (old-k8s-version-471019) creating network...
I0403 19:19:12.611371 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found existing default KVM network
I0403 19:19:12.612770 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:12.612600 62860 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:65:f1:53} reservation:<nil>}
I0403 19:19:12.613912 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:12.613811 62860 network.go:211] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:df:83:7a} reservation:<nil>}
I0403 19:19:12.615311 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:12.615214 62860 network.go:206] using free private subnet 192.168.61.0/24: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002811b0}
I0403 19:19:12.615347 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | created network xml:
I0403 19:19:12.615359 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | <network>
I0403 19:19:12.615370 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | <name>mk-old-k8s-version-471019</name>
I0403 19:19:12.615378 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | <dns enable='no'/>
I0403 19:19:12.615385 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG |
I0403 19:19:12.615402 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | <ip address='192.168.61.1' netmask='255.255.255.0'>
I0403 19:19:12.615410 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | <dhcp>
I0403 19:19:12.615420 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | <range start='192.168.61.2' end='192.168.61.253'/>
I0403 19:19:12.615427 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | </dhcp>
I0403 19:19:12.615435 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | </ip>
I0403 19:19:12.615441 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG |
I0403 19:19:12.615449 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | </network>
I0403 19:19:12.615455 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG |
I0403 19:19:12.620292 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | trying to create private KVM network mk-old-k8s-version-471019 192.168.61.0/24...
I0403 19:19:12.704480 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | private KVM network mk-old-k8s-version-471019 192.168.61.0/24 created
I0403 19:19:12.704514 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:12.704448 62860 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/20591-14371/.minikube
I0403 19:19:12.704538 62736 main.go:141] libmachine: (old-k8s-version-471019) setting up store path in /home/jenkins/minikube-integration/20591-14371/.minikube/machines/old-k8s-version-471019 ...
I0403 19:19:12.704553 62736 main.go:141] libmachine: (old-k8s-version-471019) building disk image from file:///home/jenkins/minikube-integration/20591-14371/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso
I0403 19:19:12.704641 62736 main.go:141] libmachine: (old-k8s-version-471019) Downloading /home/jenkins/minikube-integration/20591-14371/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/20591-14371/.minikube/cache/iso/amd64/minikube-v1.35.0-amd64.iso...
I0403 19:19:12.999564 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:12.999411 62860 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/20591-14371/.minikube/machines/old-k8s-version-471019/id_rsa...
I0403 19:19:13.106693 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:13.106549 62860 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/20591-14371/.minikube/machines/old-k8s-version-471019/old-k8s-version-471019.rawdisk...
I0403 19:19:13.106742 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | Writing magic tar header
I0403 19:19:13.106761 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | Writing SSH key tar header
I0403 19:19:13.106775 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:13.106654 62860 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/20591-14371/.minikube/machines/old-k8s-version-471019 ...
I0403 19:19:13.106790 62736 main.go:141] libmachine: (old-k8s-version-471019) setting executable bit set on /home/jenkins/minikube-integration/20591-14371/.minikube/machines/old-k8s-version-471019 (perms=drwx------)
I0403 19:19:13.106807 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20591-14371/.minikube/machines/old-k8s-version-471019
I0403 19:19:13.106832 62736 main.go:141] libmachine: (old-k8s-version-471019) setting executable bit set on /home/jenkins/minikube-integration/20591-14371/.minikube/machines (perms=drwxr-xr-x)
I0403 19:19:13.106849 62736 main.go:141] libmachine: (old-k8s-version-471019) setting executable bit set on /home/jenkins/minikube-integration/20591-14371/.minikube (perms=drwxr-xr-x)
I0403 19:19:13.106871 62736 main.go:141] libmachine: (old-k8s-version-471019) setting executable bit set on /home/jenkins/minikube-integration/20591-14371 (perms=drwxrwxr-x)
I0403 19:19:13.106894 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20591-14371/.minikube/machines
I0403 19:19:13.106908 62736 main.go:141] libmachine: (old-k8s-version-471019) setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0403 19:19:13.106947 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20591-14371/.minikube
I0403 19:19:13.106969 62736 main.go:141] libmachine: (old-k8s-version-471019) setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0403 19:19:13.106978 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | checking permissions on dir: /home/jenkins/minikube-integration/20591-14371
I0403 19:19:13.106992 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | checking permissions on dir: /home/jenkins/minikube-integration
I0403 19:19:13.107001 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | checking permissions on dir: /home/jenkins
I0403 19:19:13.107010 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | checking permissions on dir: /home
I0403 19:19:13.107020 62736 main.go:141] libmachine: (old-k8s-version-471019) creating domain...
I0403 19:19:13.107027 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | skipping /home - not owner
I0403 19:19:13.108312 62736 main.go:141] libmachine: (old-k8s-version-471019) define libvirt domain using xml:
I0403 19:19:13.108337 62736 main.go:141] libmachine: (old-k8s-version-471019) <domain type='kvm'>
I0403 19:19:13.108363 62736 main.go:141] libmachine: (old-k8s-version-471019) <name>old-k8s-version-471019</name>
I0403 19:19:13.108377 62736 main.go:141] libmachine: (old-k8s-version-471019) <memory unit='MiB'>2200</memory>
I0403 19:19:13.108387 62736 main.go:141] libmachine: (old-k8s-version-471019) <vcpu>2</vcpu>
I0403 19:19:13.108395 62736 main.go:141] libmachine: (old-k8s-version-471019) <features>
I0403 19:19:13.108405 62736 main.go:141] libmachine: (old-k8s-version-471019) <acpi/>
I0403 19:19:13.108418 62736 main.go:141] libmachine: (old-k8s-version-471019) <apic/>
I0403 19:19:13.108428 62736 main.go:141] libmachine: (old-k8s-version-471019) <pae/>
I0403 19:19:13.108436 62736 main.go:141] libmachine: (old-k8s-version-471019)
I0403 19:19:13.108450 62736 main.go:141] libmachine: (old-k8s-version-471019) </features>
I0403 19:19:13.108459 62736 main.go:141] libmachine: (old-k8s-version-471019) <cpu mode='host-passthrough'>
I0403 19:19:13.108471 62736 main.go:141] libmachine: (old-k8s-version-471019)
I0403 19:19:13.108479 62736 main.go:141] libmachine: (old-k8s-version-471019) </cpu>
I0403 19:19:13.108489 62736 main.go:141] libmachine: (old-k8s-version-471019) <os>
I0403 19:19:13.108508 62736 main.go:141] libmachine: (old-k8s-version-471019) <type>hvm</type>
I0403 19:19:13.108517 62736 main.go:141] libmachine: (old-k8s-version-471019) <boot dev='cdrom'/>
I0403 19:19:13.108525 62736 main.go:141] libmachine: (old-k8s-version-471019) <boot dev='hd'/>
I0403 19:19:13.108535 62736 main.go:141] libmachine: (old-k8s-version-471019) <bootmenu enable='no'/>
I0403 19:19:13.108543 62736 main.go:141] libmachine: (old-k8s-version-471019) </os>
I0403 19:19:13.108552 62736 main.go:141] libmachine: (old-k8s-version-471019) <devices>
I0403 19:19:13.108561 62736 main.go:141] libmachine: (old-k8s-version-471019) <disk type='file' device='cdrom'>
I0403 19:19:13.108575 62736 main.go:141] libmachine: (old-k8s-version-471019) <source file='/home/jenkins/minikube-integration/20591-14371/.minikube/machines/old-k8s-version-471019/boot2docker.iso'/>
I0403 19:19:13.108594 62736 main.go:141] libmachine: (old-k8s-version-471019) <target dev='hdc' bus='scsi'/>
I0403 19:19:13.108603 62736 main.go:141] libmachine: (old-k8s-version-471019) <readonly/>
I0403 19:19:13.108611 62736 main.go:141] libmachine: (old-k8s-version-471019) </disk>
I0403 19:19:13.108620 62736 main.go:141] libmachine: (old-k8s-version-471019) <disk type='file' device='disk'>
I0403 19:19:13.108630 62736 main.go:141] libmachine: (old-k8s-version-471019) <driver name='qemu' type='raw' cache='default' io='threads' />
I0403 19:19:13.108644 62736 main.go:141] libmachine: (old-k8s-version-471019) <source file='/home/jenkins/minikube-integration/20591-14371/.minikube/machines/old-k8s-version-471019/old-k8s-version-471019.rawdisk'/>
I0403 19:19:13.108658 62736 main.go:141] libmachine: (old-k8s-version-471019) <target dev='hda' bus='virtio'/>
I0403 19:19:13.108668 62736 main.go:141] libmachine: (old-k8s-version-471019) </disk>
I0403 19:19:13.108686 62736 main.go:141] libmachine: (old-k8s-version-471019) <interface type='network'>
I0403 19:19:13.108698 62736 main.go:141] libmachine: (old-k8s-version-471019) <source network='mk-old-k8s-version-471019'/>
I0403 19:19:13.108706 62736 main.go:141] libmachine: (old-k8s-version-471019) <model type='virtio'/>
I0403 19:19:13.108722 62736 main.go:141] libmachine: (old-k8s-version-471019) </interface>
I0403 19:19:13.108736 62736 main.go:141] libmachine: (old-k8s-version-471019) <interface type='network'>
I0403 19:19:13.108746 62736 main.go:141] libmachine: (old-k8s-version-471019) <source network='default'/>
I0403 19:19:13.108754 62736 main.go:141] libmachine: (old-k8s-version-471019) <model type='virtio'/>
I0403 19:19:13.108762 62736 main.go:141] libmachine: (old-k8s-version-471019) </interface>
I0403 19:19:13.108770 62736 main.go:141] libmachine: (old-k8s-version-471019) <serial type='pty'>
I0403 19:19:13.108779 62736 main.go:141] libmachine: (old-k8s-version-471019) <target port='0'/>
I0403 19:19:13.108786 62736 main.go:141] libmachine: (old-k8s-version-471019) </serial>
I0403 19:19:13.108796 62736 main.go:141] libmachine: (old-k8s-version-471019) <console type='pty'>
I0403 19:19:13.108810 62736 main.go:141] libmachine: (old-k8s-version-471019) <target type='serial' port='0'/>
I0403 19:19:13.108819 62736 main.go:141] libmachine: (old-k8s-version-471019) </console>
I0403 19:19:13.108827 62736 main.go:141] libmachine: (old-k8s-version-471019) <rng model='virtio'>
I0403 19:19:13.108840 62736 main.go:141] libmachine: (old-k8s-version-471019) <backend model='random'>/dev/random</backend>
I0403 19:19:13.108848 62736 main.go:141] libmachine: (old-k8s-version-471019) </rng>
I0403 19:19:13.108857 62736 main.go:141] libmachine: (old-k8s-version-471019)
I0403 19:19:13.108864 62736 main.go:141] libmachine: (old-k8s-version-471019)
I0403 19:19:13.108897 62736 main.go:141] libmachine: (old-k8s-version-471019) </devices>
I0403 19:19:13.108919 62736 main.go:141] libmachine: (old-k8s-version-471019) </domain>
I0403 19:19:13.108936 62736 main.go:141] libmachine: (old-k8s-version-471019)
I0403 19:19:13.113704 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:2a:32:f5 in network default
I0403 19:19:13.115408 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:13.115439 62736 main.go:141] libmachine: (old-k8s-version-471019) starting domain...
I0403 19:19:13.115453 62736 main.go:141] libmachine: (old-k8s-version-471019) ensuring networks are active...
I0403 19:19:13.116321 62736 main.go:141] libmachine: (old-k8s-version-471019) Ensuring network default is active
I0403 19:19:13.116697 62736 main.go:141] libmachine: (old-k8s-version-471019) Ensuring network mk-old-k8s-version-471019 is active
I0403 19:19:13.117336 62736 main.go:141] libmachine: (old-k8s-version-471019) getting domain XML...
I0403 19:19:13.118355 62736 main.go:141] libmachine: (old-k8s-version-471019) creating domain...
I0403 19:19:14.691520 62736 main.go:141] libmachine: (old-k8s-version-471019) waiting for IP...
I0403 19:19:14.692369 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:14.692903 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | unable to find current IP address of domain old-k8s-version-471019 in network mk-old-k8s-version-471019
I0403 19:19:14.692955 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:14.692879 62860 retry.go:31] will retry after 261.722569ms: waiting for domain to come up
I0403 19:19:14.956727 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:14.957323 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | unable to find current IP address of domain old-k8s-version-471019 in network mk-old-k8s-version-471019
I0403 19:19:14.957406 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:14.957330 62860 retry.go:31] will retry after 295.135269ms: waiting for domain to come up
I0403 19:19:15.254079 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:15.254696 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | unable to find current IP address of domain old-k8s-version-471019 in network mk-old-k8s-version-471019
I0403 19:19:15.254725 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:15.254673 62860 retry.go:31] will retry after 460.278639ms: waiting for domain to come up
I0403 19:19:15.716056 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:15.716587 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | unable to find current IP address of domain old-k8s-version-471019 in network mk-old-k8s-version-471019
I0403 19:19:15.716608 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:15.716566 62860 retry.go:31] will retry after 371.218267ms: waiting for domain to come up
I0403 19:19:16.088949 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:16.089515 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | unable to find current IP address of domain old-k8s-version-471019 in network mk-old-k8s-version-471019
I0403 19:19:16.089542 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:16.089477 62860 retry.go:31] will retry after 635.705018ms: waiting for domain to come up
I0403 19:19:16.727580 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:16.728158 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | unable to find current IP address of domain old-k8s-version-471019 in network mk-old-k8s-version-471019
I0403 19:19:16.728195 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:16.728124 62860 retry.go:31] will retry after 602.471996ms: waiting for domain to come up
I0403 19:19:17.331945 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:17.332510 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | unable to find current IP address of domain old-k8s-version-471019 in network mk-old-k8s-version-471019
I0403 19:19:17.332539 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:17.332492 62860 retry.go:31] will retry after 761.071912ms: waiting for domain to come up
I0403 19:19:18.095667 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:18.096132 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | unable to find current IP address of domain old-k8s-version-471019 in network mk-old-k8s-version-471019
I0403 19:19:18.096157 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:18.096110 62860 retry.go:31] will retry after 1.423959912s: waiting for domain to come up
I0403 19:19:19.521892 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:19.522362 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | unable to find current IP address of domain old-k8s-version-471019 in network mk-old-k8s-version-471019
I0403 19:19:19.522417 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:19.522357 62860 retry.go:31] will retry after 1.840778021s: waiting for domain to come up
I0403 19:19:21.365048 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:21.365536 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | unable to find current IP address of domain old-k8s-version-471019 in network mk-old-k8s-version-471019
I0403 19:19:21.365564 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:21.365509 62860 retry.go:31] will retry after 1.397058601s: waiting for domain to come up
I0403 19:19:22.764782 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:22.765369 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | unable to find current IP address of domain old-k8s-version-471019 in network mk-old-k8s-version-471019
I0403 19:19:22.765395 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:22.765333 62860 retry.go:31] will retry after 2.43355181s: waiting for domain to come up
I0403 19:19:25.200901 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:25.201310 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | unable to find current IP address of domain old-k8s-version-471019 in network mk-old-k8s-version-471019
I0403 19:19:25.201375 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:25.201278 62860 retry.go:31] will retry after 3.423338921s: waiting for domain to come up
I0403 19:19:28.626779 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:28.627352 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | unable to find current IP address of domain old-k8s-version-471019 in network mk-old-k8s-version-471019
I0403 19:19:28.627379 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:28.627316 62860 retry.go:31] will retry after 3.071967317s: waiting for domain to come up
I0403 19:19:31.702571 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:31.703040 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | unable to find current IP address of domain old-k8s-version-471019 in network mk-old-k8s-version-471019
I0403 19:19:31.703069 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | I0403 19:19:31.703011 62860 retry.go:31] will retry after 4.304834953s: waiting for domain to come up
I0403 19:19:36.011699 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.012197 62736 main.go:141] libmachine: (old-k8s-version-471019) found domain IP: 192.168.61.209
I0403 19:19:36.012218 62736 main.go:141] libmachine: (old-k8s-version-471019) reserving static IP address...
I0403 19:19:36.012246 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has current primary IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.012616 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-471019", mac: "52:54:00:0f:96:04", ip: "192.168.61.209"} in network mk-old-k8s-version-471019
I0403 19:19:36.088380 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | Getting to WaitForSSH function...
I0403 19:19:36.088411 62736 main.go:141] libmachine: (old-k8s-version-471019) reserved static IP address 192.168.61.209 for domain old-k8s-version-471019
I0403 19:19:36.088426 62736 main.go:141] libmachine: (old-k8s-version-471019) waiting for SSH...
I0403 19:19:36.091598 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.092004 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:minikube Clientid:01:52:54:00:0f:96:04}
I0403 19:19:36.092033 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.092155 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | Using SSH client type: external
I0403 19:19:36.092197 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | Using SSH private key: /home/jenkins/minikube-integration/20591-14371/.minikube/machines/old-k8s-version-471019/id_rsa (-rw-------)
I0403 19:19:36.092253 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.61.209 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/20591-14371/.minikube/machines/old-k8s-version-471019/id_rsa -p 22] /usr/bin/ssh <nil>}
I0403 19:19:36.092279 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | About to run SSH command:
I0403 19:19:36.092296 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | exit 0
I0403 19:19:36.222605 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | SSH cmd err, output: <nil>:
I0403 19:19:36.222985 62736 main.go:141] libmachine: (old-k8s-version-471019) KVM machine creation complete
I0403 19:19:36.223277 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetConfigRaw
I0403 19:19:36.223792 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .DriverName
I0403 19:19:36.223961 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .DriverName
I0403 19:19:36.224103 62736 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0403 19:19:36.224118 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetState
I0403 19:19:36.225384 62736 main.go:141] libmachine: Detecting operating system of created instance...
I0403 19:19:36.225398 62736 main.go:141] libmachine: Waiting for SSH to be available...
I0403 19:19:36.225403 62736 main.go:141] libmachine: Getting to WaitForSSH function...
I0403 19:19:36.225408 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHHostname
I0403 19:19:36.227671 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.228101 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:old-k8s-version-471019 Clientid:01:52:54:00:0f:96:04}
I0403 19:19:36.228133 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.228294 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHPort
I0403 19:19:36.228441 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHKeyPath
I0403 19:19:36.228558 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHKeyPath
I0403 19:19:36.228689 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHUsername
I0403 19:19:36.228813 62736 main.go:141] libmachine: Using SSH client type: native
I0403 19:19:36.229016 62736 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.209 22 <nil> <nil>}
I0403 19:19:36.229026 62736 main.go:141] libmachine: About to run SSH command:
exit 0
I0403 19:19:36.338066 62736 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0403 19:19:36.338096 62736 main.go:141] libmachine: Detecting the provisioner...
I0403 19:19:36.338107 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHHostname
I0403 19:19:36.341195 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.341619 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:old-k8s-version-471019 Clientid:01:52:54:00:0f:96:04}
I0403 19:19:36.341648 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.341817 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHPort
I0403 19:19:36.342026 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHKeyPath
I0403 19:19:36.342195 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHKeyPath
I0403 19:19:36.342330 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHUsername
I0403 19:19:36.342510 62736 main.go:141] libmachine: Using SSH client type: native
I0403 19:19:36.342799 62736 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.209 22 <nil> <nil>}
I0403 19:19:36.342817 62736 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0403 19:19:36.459126 62736 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I0403 19:19:36.459248 62736 main.go:141] libmachine: found compatible host: buildroot
I0403 19:19:36.459264 62736 main.go:141] libmachine: Provisioning with buildroot...
I0403 19:19:36.459274 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetMachineName
I0403 19:19:36.459496 62736 buildroot.go:166] provisioning hostname "old-k8s-version-471019"
I0403 19:19:36.459515 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetMachineName
I0403 19:19:36.459768 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHHostname
I0403 19:19:36.462249 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.462569 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:old-k8s-version-471019 Clientid:01:52:54:00:0f:96:04}
I0403 19:19:36.462615 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.462701 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHPort
I0403 19:19:36.462885 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHKeyPath
I0403 19:19:36.463025 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHKeyPath
I0403 19:19:36.463178 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHUsername
I0403 19:19:36.463368 62736 main.go:141] libmachine: Using SSH client type: native
I0403 19:19:36.463620 62736 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.209 22 <nil> <nil>}
I0403 19:19:36.463637 62736 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-471019 && echo "old-k8s-version-471019" | sudo tee /etc/hostname
I0403 19:19:36.594624 62736 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-471019
I0403 19:19:36.594650 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHHostname
I0403 19:19:36.597591 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.598001 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:old-k8s-version-471019 Clientid:01:52:54:00:0f:96:04}
I0403 19:19:36.598030 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.598251 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHPort
I0403 19:19:36.598403 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHKeyPath
I0403 19:19:36.598517 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHKeyPath
I0403 19:19:36.598623 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHUsername
I0403 19:19:36.598878 62736 main.go:141] libmachine: Using SSH client type: native
I0403 19:19:36.599131 62736 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.209 22 <nil> <nil>}
I0403 19:19:36.599149 62736 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-471019' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-471019/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-471019' | sudo tee -a /etc/hosts;
fi
fi
I0403 19:19:36.727043 62736 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0403 19:19:36.727071 62736 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/20591-14371/.minikube CaCertPath:/home/jenkins/minikube-integration/20591-14371/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20591-14371/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20591-14371/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20591-14371/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20591-14371/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20591-14371/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20591-14371/.minikube}
I0403 19:19:36.727092 62736 buildroot.go:174] setting up certificates
I0403 19:19:36.727104 62736 provision.go:84] configureAuth start
I0403 19:19:36.727116 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetMachineName
I0403 19:19:36.727383 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetIP
I0403 19:19:36.730221 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.730625 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:old-k8s-version-471019 Clientid:01:52:54:00:0f:96:04}
I0403 19:19:36.730667 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.730949 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHHostname
I0403 19:19:36.733877 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.734338 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:old-k8s-version-471019 Clientid:01:52:54:00:0f:96:04}
I0403 19:19:36.734383 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.734542 62736 provision.go:143] copyHostCerts
I0403 19:19:36.734608 62736 exec_runner.go:144] found /home/jenkins/minikube-integration/20591-14371/.minikube/ca.pem, removing ...
I0403 19:19:36.734629 62736 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20591-14371/.minikube/ca.pem
I0403 19:19:36.734692 62736 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20591-14371/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20591-14371/.minikube/ca.pem (1082 bytes)
I0403 19:19:36.734849 62736 exec_runner.go:144] found /home/jenkins/minikube-integration/20591-14371/.minikube/cert.pem, removing ...
I0403 19:19:36.734862 62736 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20591-14371/.minikube/cert.pem
I0403 19:19:36.734898 62736 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20591-14371/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20591-14371/.minikube/cert.pem (1123 bytes)
I0403 19:19:36.735003 62736 exec_runner.go:144] found /home/jenkins/minikube-integration/20591-14371/.minikube/key.pem, removing ...
I0403 19:19:36.735015 62736 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20591-14371/.minikube/key.pem
I0403 19:19:36.735042 62736 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20591-14371/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20591-14371/.minikube/key.pem (1675 bytes)
I0403 19:19:36.735133 62736 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20591-14371/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20591-14371/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20591-14371/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-471019 san=[127.0.0.1 192.168.61.209 localhost minikube old-k8s-version-471019]
I0403 19:19:36.872444 62736 provision.go:177] copyRemoteCerts
I0403 19:19:36.872497 62736 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0403 19:19:36.872519 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHHostname
I0403 19:19:36.875432 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.875813 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:old-k8s-version-471019 Clientid:01:52:54:00:0f:96:04}
I0403 19:19:36.875852 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:36.876027 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHPort
I0403 19:19:36.876228 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHKeyPath
I0403 19:19:36.876395 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHUsername
I0403 19:19:36.876549 62736 sshutil.go:53] new ssh client: &{IP:192.168.61.209 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20591-14371/.minikube/machines/old-k8s-version-471019/id_rsa Username:docker}
I0403 19:19:36.961154 62736 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20591-14371/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0403 19:19:36.984335 62736 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20591-14371/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0403 19:19:37.007310 62736 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20591-14371/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0403 19:19:37.033403 62736 provision.go:87] duration metric: took 306.284004ms to configureAuth
I0403 19:19:37.033437 62736 buildroot.go:189] setting minikube options for container-runtime
I0403 19:19:37.033657 62736 config.go:182] Loaded profile config "old-k8s-version-471019": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0403 19:19:37.033749 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHHostname
I0403 19:19:37.037112 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:37.037522 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:old-k8s-version-471019 Clientid:01:52:54:00:0f:96:04}
I0403 19:19:37.037556 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:37.037788 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHPort
I0403 19:19:37.038004 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHKeyPath
I0403 19:19:37.038165 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHKeyPath
I0403 19:19:37.038343 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHUsername
I0403 19:19:37.038552 62736 main.go:141] libmachine: Using SSH client type: native
I0403 19:19:37.038842 62736 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.209 22 <nil> <nil>}
I0403 19:19:37.038864 62736 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0403 19:19:37.284046 62736 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0403 19:19:37.284074 62736 main.go:141] libmachine: Checking connection to Docker...
I0403 19:19:37.284101 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetURL
I0403 19:19:37.285445 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | using libvirt version 6000000
I0403 19:19:37.288566 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:37.288981 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:old-k8s-version-471019 Clientid:01:52:54:00:0f:96:04}
I0403 19:19:37.289029 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:37.289164 62736 main.go:141] libmachine: Docker is up and running!
I0403 19:19:37.289178 62736 main.go:141] libmachine: Reticulating splines...
I0403 19:19:37.289186 62736 client.go:171] duration metric: took 24.680201956s to LocalClient.Create
I0403 19:19:37.289207 62736 start.go:167] duration metric: took 24.680266539s to libmachine.API.Create "old-k8s-version-471019"
I0403 19:19:37.289222 62736 start.go:293] postStartSetup for "old-k8s-version-471019" (driver="kvm2")
I0403 19:19:37.289246 62736 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0403 19:19:37.289262 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .DriverName
I0403 19:19:37.289507 62736 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0403 19:19:37.289537 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHHostname
I0403 19:19:37.291892 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:37.292243 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:old-k8s-version-471019 Clientid:01:52:54:00:0f:96:04}
I0403 19:19:37.292273 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:37.292486 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHPort
I0403 19:19:37.292642 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHKeyPath
I0403 19:19:37.292782 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHUsername
I0403 19:19:37.292891 62736 sshutil.go:53] new ssh client: &{IP:192.168.61.209 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20591-14371/.minikube/machines/old-k8s-version-471019/id_rsa Username:docker}
I0403 19:19:37.377604 62736 ssh_runner.go:195] Run: cat /etc/os-release
I0403 19:19:37.381468 62736 info.go:137] Remote host: Buildroot 2023.02.9
I0403 19:19:37.381491 62736 filesync.go:126] Scanning /home/jenkins/minikube-integration/20591-14371/.minikube/addons for local assets ...
I0403 19:19:37.381554 62736 filesync.go:126] Scanning /home/jenkins/minikube-integration/20591-14371/.minikube/files for local assets ...
I0403 19:19:37.381667 62736 filesync.go:149] local asset: /home/jenkins/minikube-integration/20591-14371/.minikube/files/etc/ssl/certs/215522.pem -> 215522.pem in /etc/ssl/certs
I0403 19:19:37.381788 62736 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0403 19:19:37.391117 62736 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20591-14371/.minikube/files/etc/ssl/certs/215522.pem --> /etc/ssl/certs/215522.pem (1708 bytes)
I0403 19:19:37.413946 62736 start.go:296] duration metric: took 124.702106ms for postStartSetup
I0403 19:19:37.414000 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetConfigRaw
I0403 19:19:37.414689 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetIP
I0403 19:19:37.417377 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:37.417723 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:old-k8s-version-471019 Clientid:01:52:54:00:0f:96:04}
I0403 19:19:37.417761 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:37.417934 62736 profile.go:143] Saving config to /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/config.json ...
I0403 19:19:37.418114 62736 start.go:128] duration metric: took 24.830198479s to createHost
I0403 19:19:37.418136 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHHostname
I0403 19:19:37.420313 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:37.420717 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:old-k8s-version-471019 Clientid:01:52:54:00:0f:96:04}
I0403 19:19:37.420753 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:37.420861 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHPort
I0403 19:19:37.421046 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHKeyPath
I0403 19:19:37.421224 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHKeyPath
I0403 19:19:37.421411 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHUsername
I0403 19:19:37.421620 62736 main.go:141] libmachine: Using SSH client type: native
I0403 19:19:37.421815 62736 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 192.168.61.209 22 <nil> <nil>}
I0403 19:19:37.421829 62736 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0403 19:19:37.535141 62736 main.go:141] libmachine: SSH cmd err, output: <nil>: 1743707977.509463372
I0403 19:19:37.535166 62736 fix.go:216] guest clock: 1743707977.509463372
I0403 19:19:37.535175 62736 fix.go:229] Guest: 2025-04-03 19:19:37.509463372 +0000 UTC Remote: 2025-04-03 19:19:37.418125203 +0000 UTC m=+43.194831141 (delta=91.338169ms)
I0403 19:19:37.535224 62736 fix.go:200] guest clock delta is within tolerance: 91.338169ms
I0403 19:19:37.535235 62736 start.go:83] releasing machines lock for "old-k8s-version-471019", held for 24.947526927s
I0403 19:19:37.535269 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .DriverName
I0403 19:19:37.535508 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetIP
I0403 19:19:37.538604 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:37.538931 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:old-k8s-version-471019 Clientid:01:52:54:00:0f:96:04}
I0403 19:19:37.538961 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:37.539096 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .DriverName
I0403 19:19:37.539588 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .DriverName
I0403 19:19:37.539751 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .DriverName
I0403 19:19:37.539835 62736 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0403 19:19:37.539874 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHHostname
I0403 19:19:37.539926 62736 ssh_runner.go:195] Run: cat /version.json
I0403 19:19:37.539946 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHHostname
I0403 19:19:37.542902 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:37.542953 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:37.543212 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:old-k8s-version-471019 Clientid:01:52:54:00:0f:96:04}
I0403 19:19:37.543239 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:37.543449 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHPort
I0403 19:19:37.543480 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:old-k8s-version-471019 Clientid:01:52:54:00:0f:96:04}
I0403 19:19:37.543504 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:37.543668 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHKeyPath
I0403 19:19:37.543761 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHPort
I0403 19:19:37.543833 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHUsername
I0403 19:19:37.543911 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHKeyPath
I0403 19:19:37.543987 62736 sshutil.go:53] new ssh client: &{IP:192.168.61.209 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20591-14371/.minikube/machines/old-k8s-version-471019/id_rsa Username:docker}
I0403 19:19:37.544029 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetSSHUsername
I0403 19:19:37.544176 62736 sshutil.go:53] new ssh client: &{IP:192.168.61.209 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/20591-14371/.minikube/machines/old-k8s-version-471019/id_rsa Username:docker}
I0403 19:19:37.663260 62736 ssh_runner.go:195] Run: systemctl --version
I0403 19:19:37.671337 62736 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0403 19:19:37.853243 62736 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0403 19:19:37.858700 62736 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0403 19:19:37.858764 62736 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0403 19:19:37.873805 62736 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0403 19:19:37.873825 62736 start.go:495] detecting cgroup driver to use...
I0403 19:19:37.873891 62736 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0403 19:19:37.891518 62736 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0403 19:19:37.905942 62736 docker.go:217] disabling cri-docker service (if available) ...
I0403 19:19:37.906019 62736 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0403 19:19:37.921994 62736 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0403 19:19:37.936310 62736 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0403 19:19:38.111896 62736 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0403 19:19:38.330608 62736 docker.go:233] disabling docker service ...
I0403 19:19:38.330683 62736 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0403 19:19:38.354970 62736 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0403 19:19:38.366959 62736 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0403 19:19:38.492145 62736 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0403 19:19:38.616615 62736 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0403 19:19:38.630049 62736 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0403 19:19:38.646986 62736 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0403 19:19:38.647049 62736 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0403 19:19:38.656393 62736 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0403 19:19:38.656442 62736 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0403 19:19:38.665571 62736 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0403 19:19:38.675039 62736 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0403 19:19:38.684392 62736 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0403 19:19:38.693658 62736 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0403 19:19:38.701937 62736 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0403 19:19:38.701986 62736 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0403 19:19:38.713128 62736 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0403 19:19:38.721844 62736 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0403 19:19:38.840163 62736 ssh_runner.go:195] Run: sudo systemctl restart crio
I0403 19:19:38.940722 62736 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0403 19:19:38.940780 62736 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0403 19:19:38.945677 62736 start.go:563] Will wait 60s for crictl version
I0403 19:19:38.945723 62736 ssh_runner.go:195] Run: which crictl
I0403 19:19:38.949359 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0403 19:19:38.993178 62736 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0403 19:19:38.993280 62736 ssh_runner.go:195] Run: crio --version
I0403 19:19:39.022496 62736 ssh_runner.go:195] Run: crio --version
I0403 19:19:39.051437 62736 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.29.1 ...
I0403 19:19:39.052384 62736 main.go:141] libmachine: (old-k8s-version-471019) Calling .GetIP
I0403 19:19:39.055524 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:39.055889 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0f:96:04", ip: ""} in network mk-old-k8s-version-471019: {Iface:virbr3 ExpiryTime:2025-04-03 20:19:27 +0000 UTC Type:0 Mac:52:54:00:0f:96:04 Iaid: IPaddr:192.168.61.209 Prefix:24 Hostname:old-k8s-version-471019 Clientid:01:52:54:00:0f:96:04}
I0403 19:19:39.055924 62736 main.go:141] libmachine: (old-k8s-version-471019) DBG | domain old-k8s-version-471019 has defined IP address 192.168.61.209 and MAC address 52:54:00:0f:96:04 in network mk-old-k8s-version-471019
I0403 19:19:39.056165 62736 ssh_runner.go:195] Run: grep 192.168.61.1 host.minikube.internal$ /etc/hosts
I0403 19:19:39.059965 62736 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.61.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0403 19:19:39.072756 62736 kubeadm.go:883] updating cluster {Name:old-k8s-version-471019 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1743675393-20591@sha256:8de8167e280414c9d16e4c3da59bc85bc7c9cc24228af995863fc7bcabfcf727 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-
version-471019 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.209 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountU
ID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0403 19:19:39.072846 62736 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0403 19:19:39.072917 62736 ssh_runner.go:195] Run: sudo crictl images --output json
I0403 19:19:39.107514 62736 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0403 19:19:39.107587 62736 ssh_runner.go:195] Run: which lz4
I0403 19:19:39.113196 62736 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0403 19:19:39.117257 62736 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0403 19:19:39.117288 62736 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20591-14371/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0403 19:19:40.539940 62736 crio.go:462] duration metric: took 1.426780883s to copy over tarball
I0403 19:19:40.540009 62736 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0403 19:19:43.281012 62736 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.74096932s)
I0403 19:19:43.281043 62736 crio.go:469] duration metric: took 2.741081716s to extract the tarball
I0403 19:19:43.281050 62736 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0403 19:19:43.322869 62736 ssh_runner.go:195] Run: sudo crictl images --output json
I0403 19:19:43.371355 62736 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0403 19:19:43.371378 62736 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0403 19:19:43.371447 62736 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0403 19:19:43.371456 62736 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0403 19:19:43.371486 62736 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0403 19:19:43.371549 62736 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0403 19:19:43.371607 62736 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0403 19:19:43.371701 62736 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0403 19:19:43.371706 62736 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0403 19:19:43.371554 62736 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0403 19:19:43.372813 62736 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0403 19:19:43.372828 62736 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0403 19:19:43.372842 62736 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0403 19:19:43.372847 62736 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0403 19:19:43.372820 62736 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0403 19:19:43.372877 62736 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0403 19:19:43.372869 62736 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0403 19:19:43.373015 62736 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0403 19:19:43.548491 62736 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0403 19:19:43.574594 62736 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0403 19:19:43.588305 62736 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0403 19:19:43.588343 62736 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0403 19:19:43.588380 62736 ssh_runner.go:195] Run: which crictl
I0403 19:19:43.605273 62736 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0403 19:19:43.630770 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0403 19:19:43.630867 62736 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0403 19:19:43.630929 62736 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0403 19:19:43.630979 62736 ssh_runner.go:195] Run: which crictl
I0403 19:19:43.634168 62736 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0403 19:19:43.643421 62736 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0403 19:19:43.663089 62736 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0403 19:19:43.666374 62736 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0403 19:19:43.674163 62736 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0403 19:19:43.674210 62736 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0403 19:19:43.674256 62736 ssh_runner.go:195] Run: which crictl
I0403 19:19:43.705351 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0403 19:19:43.705411 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0403 19:19:43.749726 62736 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0403 19:19:43.749773 62736 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0403 19:19:43.749820 62736 ssh_runner.go:195] Run: which crictl
I0403 19:19:43.772880 62736 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0403 19:19:43.772923 62736 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0403 19:19:43.772969 62736 ssh_runner.go:195] Run: which crictl
I0403 19:19:43.787839 62736 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0403 19:19:43.787900 62736 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0403 19:19:43.787950 62736 ssh_runner.go:195] Run: which crictl
I0403 19:19:43.818966 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0403 19:19:43.819015 62736 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0403 19:19:43.819046 62736 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0403 19:19:43.819047 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0403 19:19:43.819088 62736 ssh_runner.go:195] Run: which crictl
I0403 19:19:43.822409 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0403 19:19:43.822472 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0403 19:19:43.822504 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0403 19:19:43.822506 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0403 19:19:43.940908 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0403 19:19:43.940978 62736 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20591-14371/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0403 19:19:43.941043 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0403 19:19:43.954515 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0403 19:19:43.965374 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0403 19:19:43.965428 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0403 19:19:43.965515 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0403 19:19:44.064778 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0403 19:19:44.064825 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0403 19:19:44.064855 62736 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20591-14371/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0403 19:19:44.087976 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0403 19:19:44.087977 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0403 19:19:44.088035 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0403 19:19:44.175391 62736 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0403 19:19:44.175434 62736 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20591-14371/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0403 19:19:44.202391 62736 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20591-14371/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0403 19:19:44.202469 62736 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20591-14371/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0403 19:19:44.202469 62736 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20591-14371/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0403 19:19:44.225388 62736 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20591-14371/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0403 19:19:44.620062 62736 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0403 19:19:44.765012 62736 cache_images.go:92] duration metric: took 1.393617146s to LoadCachedImages
W0403 19:19:44.765136 62736 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20591-14371/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20591-14371/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0: no such file or directory
I0403 19:19:44.765158 62736 kubeadm.go:934] updating node { 192.168.61.209 8443 v1.20.0 crio true true} ...
I0403 19:19:44.765268 62736 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-471019 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.61.209
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-471019 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0403 19:19:44.765348 62736 ssh_runner.go:195] Run: crio config
I0403 19:19:44.819937 62736 cni.go:84] Creating CNI manager for ""
I0403 19:19:44.819960 62736 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0403 19:19:44.819974 62736 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0403 19:19:44.820000 62736 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.61.209 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-471019 NodeName:old-k8s-version-471019 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.61.209"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.61.209 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0403 19:19:44.820138 62736 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.61.209
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-471019"
kubeletExtraArgs:
node-ip: 192.168.61.209
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.61.209"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0403 19:19:44.820196 62736 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0403 19:19:44.829938 62736 binaries.go:44] Found k8s binaries, skipping transfer
I0403 19:19:44.830007 62736 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0403 19:19:44.839514 62736 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0403 19:19:44.857180 62736 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0403 19:19:44.872722 62736 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
I0403 19:19:44.888219 62736 ssh_runner.go:195] Run: grep 192.168.61.209 control-plane.minikube.internal$ /etc/hosts
I0403 19:19:44.891696 62736 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.61.209 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0403 19:19:44.902916 62736 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0403 19:19:45.023907 62736 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0403 19:19:45.040547 62736 certs.go:68] Setting up /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019 for IP: 192.168.61.209
I0403 19:19:45.040570 62736 certs.go:194] generating shared ca certs ...
I0403 19:19:45.040591 62736 certs.go:226] acquiring lock for ca certs: {Name:mk34f09724355b828d31eb1ee97771fd3b4645c0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0403 19:19:45.040754 62736 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20591-14371/.minikube/ca.key
I0403 19:19:45.040820 62736 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20591-14371/.minikube/proxy-client-ca.key
I0403 19:19:45.040835 62736 certs.go:256] generating profile certs ...
I0403 19:19:45.040906 62736 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/client.key
I0403 19:19:45.040946 62736 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/client.crt with IP's: []
I0403 19:19:45.140861 62736 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/client.crt ...
I0403 19:19:45.140892 62736 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/client.crt: {Name:mke3f109960399f05c6c31997b5fa78b28e53105 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0403 19:19:45.141070 62736 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/client.key ...
I0403 19:19:45.141086 62736 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/client.key: {Name:mk4f8976e9dc26f00150b9613022298b7a16423f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0403 19:19:45.141191 62736 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/apiserver.key.6f94e3bf
I0403 19:19:45.141213 62736 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/apiserver.crt.6f94e3bf with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.61.209]
I0403 19:19:45.311019 62736 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/apiserver.crt.6f94e3bf ...
I0403 19:19:45.311054 62736 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/apiserver.crt.6f94e3bf: {Name:mk998f06e06a3a2bb010058aae0d91a1d90b7bb0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0403 19:19:45.311269 62736 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/apiserver.key.6f94e3bf ...
I0403 19:19:45.311291 62736 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/apiserver.key.6f94e3bf: {Name:mk9ea176363b6be5859042bbe52c3f4a8a862054 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0403 19:19:45.311421 62736 certs.go:381] copying /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/apiserver.crt.6f94e3bf -> /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/apiserver.crt
I0403 19:19:45.311540 62736 certs.go:385] copying /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/apiserver.key.6f94e3bf -> /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/apiserver.key
I0403 19:19:45.311637 62736 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/proxy-client.key
I0403 19:19:45.311663 62736 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/proxy-client.crt with IP's: []
I0403 19:19:45.331685 62736 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/proxy-client.crt ...
I0403 19:19:45.331715 62736 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/proxy-client.crt: {Name:mk7ac42060222355800a4c4a1aacbc04aacae32f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0403 19:19:45.331880 62736 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/proxy-client.key ...
I0403 19:19:45.331898 62736 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/proxy-client.key: {Name:mk434ff38f3ed84bbcbb1e531743c98d95c5bbdc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0403 19:19:45.332090 62736 certs.go:484] found cert: /home/jenkins/minikube-integration/20591-14371/.minikube/certs/21552.pem (1338 bytes)
W0403 19:19:45.332139 62736 certs.go:480] ignoring /home/jenkins/minikube-integration/20591-14371/.minikube/certs/21552_empty.pem, impossibly tiny 0 bytes
I0403 19:19:45.332155 62736 certs.go:484] found cert: /home/jenkins/minikube-integration/20591-14371/.minikube/certs/ca-key.pem (1675 bytes)
I0403 19:19:45.332194 62736 certs.go:484] found cert: /home/jenkins/minikube-integration/20591-14371/.minikube/certs/ca.pem (1082 bytes)
I0403 19:19:45.332227 62736 certs.go:484] found cert: /home/jenkins/minikube-integration/20591-14371/.minikube/certs/cert.pem (1123 bytes)
I0403 19:19:45.332261 62736 certs.go:484] found cert: /home/jenkins/minikube-integration/20591-14371/.minikube/certs/key.pem (1675 bytes)
I0403 19:19:45.332315 62736 certs.go:484] found cert: /home/jenkins/minikube-integration/20591-14371/.minikube/files/etc/ssl/certs/215522.pem (1708 bytes)
I0403 19:19:45.332839 62736 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20591-14371/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0403 19:19:45.360309 62736 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20591-14371/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0403 19:19:45.385185 62736 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20591-14371/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0403 19:19:45.408356 62736 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20591-14371/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0403 19:19:45.433211 62736 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0403 19:19:45.458296 62736 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0403 19:19:45.483154 62736 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0403 19:19:45.506360 62736 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20591-14371/.minikube/profiles/old-k8s-version-471019/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0403 19:19:45.527791 62736 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20591-14371/.minikube/certs/21552.pem --> /usr/share/ca-certificates/21552.pem (1338 bytes)
I0403 19:19:45.549031 62736 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20591-14371/.minikube/files/etc/ssl/certs/215522.pem --> /usr/share/ca-certificates/215522.pem (1708 bytes)
I0403 19:19:45.571792 62736 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20591-14371/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0403 19:19:45.593887 62736 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0403 19:19:45.609188 62736 ssh_runner.go:195] Run: openssl version
I0403 19:19:45.614670 62736 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/21552.pem && ln -fs /usr/share/ca-certificates/21552.pem /etc/ssl/certs/21552.pem"
I0403 19:19:45.624351 62736 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/21552.pem
I0403 19:19:45.628589 62736 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 3 18:20 /usr/share/ca-certificates/21552.pem
I0403 19:19:45.628651 62736 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/21552.pem
I0403 19:19:45.636036 62736 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/21552.pem /etc/ssl/certs/51391683.0"
I0403 19:19:45.646416 62736 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/215522.pem && ln -fs /usr/share/ca-certificates/215522.pem /etc/ssl/certs/215522.pem"
I0403 19:19:45.656256 62736 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/215522.pem
I0403 19:19:45.660682 62736 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 3 18:20 /usr/share/ca-certificates/215522.pem
I0403 19:19:45.660745 62736 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/215522.pem
I0403 19:19:45.666027 62736 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/215522.pem /etc/ssl/certs/3ec20f2e.0"
I0403 19:19:45.675985 62736 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0403 19:19:45.686145 62736 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0403 19:19:45.690336 62736 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 3 18:12 /usr/share/ca-certificates/minikubeCA.pem
I0403 19:19:45.690393 62736 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0403 19:19:45.695799 62736 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0403 19:19:45.710983 62736 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0403 19:19:45.716089 62736 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0403 19:19:45.716137 62736 kubeadm.go:392] StartCluster: {Name:old-k8s-version-471019 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.35.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1743675393-20591@sha256:8de8167e280414c9d16e4c3da59bc85bc7c9cc24228af995863fc7bcabfcf727 Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-ver
sion-471019 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.61.209 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:
docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0403 19:19:45.716200 62736 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0403 19:19:45.716240 62736 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0403 19:19:45.758160 62736 cri.go:89] found id: ""
I0403 19:19:45.758230 62736 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0403 19:19:45.768282 62736 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0403 19:19:45.778376 62736 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0403 19:19:45.787231 62736 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0403 19:19:45.787254 62736 kubeadm.go:157] found existing configuration files:
I0403 19:19:45.787304 62736 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0403 19:19:45.795613 62736 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0403 19:19:45.795690 62736 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0403 19:19:45.804555 62736 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0403 19:19:45.813111 62736 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0403 19:19:45.813159 62736 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0403 19:19:45.823998 62736 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0403 19:19:45.837975 62736 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0403 19:19:45.838035 62736 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0403 19:19:45.851743 62736 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0403 19:19:45.863408 62736 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0403 19:19:45.863505 62736 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0403 19:19:45.875774 62736 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0403 19:19:46.160151 62736 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0403 19:21:43.795497 62736 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0403 19:21:43.795657 62736 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0403 19:21:43.797410 62736 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0403 19:21:43.797522 62736 kubeadm.go:310] [preflight] Running pre-flight checks
I0403 19:21:43.797709 62736 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0403 19:21:43.798069 62736 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0403 19:21:43.798315 62736 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0403 19:21:43.798598 62736 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0403 19:21:43.800594 62736 out.go:235] - Generating certificates and keys ...
I0403 19:21:43.800673 62736 kubeadm.go:310] [certs] Using existing ca certificate authority
I0403 19:21:43.800731 62736 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0403 19:21:43.800832 62736 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0403 19:21:43.800924 62736 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0403 19:21:43.801001 62736 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0403 19:21:43.801076 62736 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0403 19:21:43.801134 62736 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0403 19:21:43.801296 62736 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-471019] and IPs [192.168.61.209 127.0.0.1 ::1]
I0403 19:21:43.801367 62736 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0403 19:21:43.801495 62736 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-471019] and IPs [192.168.61.209 127.0.0.1 ::1]
I0403 19:21:43.801584 62736 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0403 19:21:43.801661 62736 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0403 19:21:43.801727 62736 kubeadm.go:310] [certs] Generating "sa" key and public key
I0403 19:21:43.801806 62736 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0403 19:21:43.801875 62736 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0403 19:21:43.801976 62736 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0403 19:21:43.802031 62736 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0403 19:21:43.802078 62736 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0403 19:21:43.802164 62736 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0403 19:21:43.802265 62736 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0403 19:21:43.802310 62736 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0403 19:21:43.802373 62736 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0403 19:21:43.803630 62736 out.go:235] - Booting up control plane ...
I0403 19:21:43.803700 62736 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0403 19:21:43.803764 62736 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0403 19:21:43.803823 62736 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0403 19:21:43.803917 62736 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0403 19:21:43.804079 62736 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0403 19:21:43.804150 62736 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0403 19:21:43.804227 62736 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0403 19:21:43.804462 62736 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0403 19:21:43.804564 62736 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0403 19:21:43.804790 62736 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0403 19:21:43.804887 62736 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0403 19:21:43.805088 62736 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0403 19:21:43.805149 62736 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0403 19:21:43.805329 62736 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0403 19:21:43.805396 62736 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0403 19:21:43.805556 62736 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0403 19:21:43.805563 62736 kubeadm.go:310]
I0403 19:21:43.805598 62736 kubeadm.go:310] Unfortunately, an error has occurred:
I0403 19:21:43.805631 62736 kubeadm.go:310] timed out waiting for the condition
I0403 19:21:43.805637 62736 kubeadm.go:310]
I0403 19:21:43.805666 62736 kubeadm.go:310] This error is likely caused by:
I0403 19:21:43.805693 62736 kubeadm.go:310] - The kubelet is not running
I0403 19:21:43.805797 62736 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0403 19:21:43.805814 62736 kubeadm.go:310]
I0403 19:21:43.805952 62736 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0403 19:21:43.805988 62736 kubeadm.go:310] - 'systemctl status kubelet'
I0403 19:21:43.806017 62736 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0403 19:21:43.806022 62736 kubeadm.go:310]
I0403 19:21:43.806115 62736 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0403 19:21:43.806186 62736 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0403 19:21:43.806192 62736 kubeadm.go:310]
I0403 19:21:43.806277 62736 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0403 19:21:43.806355 62736 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0403 19:21:43.806427 62736 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0403 19:21:43.806492 62736 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0403 19:21:43.806567 62736 kubeadm.go:310]
W0403 19:21:43.806622 62736 out.go:270] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-471019] and IPs [192.168.61.209 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-471019] and IPs [192.168.61.209 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-471019] and IPs [192.168.61.209 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-471019] and IPs [192.168.61.209 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
I0403 19:21:43.806651 62736 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm reset --cri-socket /var/run/crio/crio.sock --force"
I0403 19:21:44.262385 62736 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0403 19:21:44.276629 62736 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0403 19:21:44.285640 62736 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0403 19:21:44.285661 62736 kubeadm.go:157] found existing configuration files:
I0403 19:21:44.285707 62736 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0403 19:21:44.294502 62736 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0403 19:21:44.294558 62736 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0403 19:21:44.303081 62736 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0403 19:21:44.311282 62736 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0403 19:21:44.311330 62736 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0403 19:21:44.319962 62736 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0403 19:21:44.328031 62736 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0403 19:21:44.328078 62736 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0403 19:21:44.336507 62736 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0403 19:21:44.344472 62736 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0403 19:21:44.344522 62736 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0403 19:21:44.354674 62736 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I0403 19:21:44.417351 62736 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0403 19:21:44.417418 62736 kubeadm.go:310] [preflight] Running pre-flight checks
I0403 19:21:44.549245 62736 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0403 19:21:44.549422 62736 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0403 19:21:44.549536 62736 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0403 19:21:44.709191 62736 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0403 19:21:44.711707 62736 out.go:235] - Generating certificates and keys ...
I0403 19:21:44.711811 62736 kubeadm.go:310] [certs] Using existing ca certificate authority
I0403 19:21:44.711897 62736 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0403 19:21:44.712011 62736 kubeadm.go:310] [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0403 19:21:44.712108 62736 kubeadm.go:310] [certs] Using existing front-proxy-ca certificate authority
I0403 19:21:44.712214 62736 kubeadm.go:310] [certs] Using existing front-proxy-client certificate and key on disk
I0403 19:21:44.712294 62736 kubeadm.go:310] [certs] Using existing etcd/ca certificate authority
I0403 19:21:44.712390 62736 kubeadm.go:310] [certs] Using existing etcd/server certificate and key on disk
I0403 19:21:44.712477 62736 kubeadm.go:310] [certs] Using existing etcd/peer certificate and key on disk
I0403 19:21:44.712582 62736 kubeadm.go:310] [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0403 19:21:44.712707 62736 kubeadm.go:310] [certs] Using existing apiserver-etcd-client certificate and key on disk
I0403 19:21:44.712771 62736 kubeadm.go:310] [certs] Using the existing "sa" key
I0403 19:21:44.712847 62736 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0403 19:21:44.979714 62736 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0403 19:21:45.129581 62736 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0403 19:21:45.361486 62736 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0403 19:21:45.452688 62736 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0403 19:21:45.470833 62736 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0403 19:21:45.474051 62736 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0403 19:21:45.474122 62736 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0403 19:21:45.615577 62736 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0403 19:21:45.619032 62736 out.go:235] - Booting up control plane ...
I0403 19:21:45.619157 62736 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0403 19:21:45.626663 62736 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0403 19:21:45.629215 62736 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0403 19:21:45.630813 62736 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0403 19:21:45.633018 62736 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0403 19:22:25.636208 62736 kubeadm.go:310] [kubelet-check] Initial timeout of 40s passed.
I0403 19:22:25.636681 62736 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0403 19:22:25.636917 62736 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0403 19:22:30.637610 62736 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0403 19:22:30.637941 62736 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0403 19:22:40.638338 62736 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0403 19:22:40.638536 62736 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0403 19:23:00.637255 62736 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0403 19:23:00.637509 62736 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0403 19:23:40.636829 62736 kubeadm.go:310] [kubelet-check] It seems like the kubelet isn't running or healthy.
I0403 19:23:40.637110 62736 kubeadm.go:310] [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
I0403 19:23:40.637127 62736 kubeadm.go:310]
I0403 19:23:40.637184 62736 kubeadm.go:310] Unfortunately, an error has occurred:
I0403 19:23:40.637479 62736 kubeadm.go:310] timed out waiting for the condition
I0403 19:23:40.637503 62736 kubeadm.go:310]
I0403 19:23:40.637561 62736 kubeadm.go:310] This error is likely caused by:
I0403 19:23:40.637614 62736 kubeadm.go:310] - The kubelet is not running
I0403 19:23:40.637767 62736 kubeadm.go:310] - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
I0403 19:23:40.637786 62736 kubeadm.go:310]
I0403 19:23:40.637939 62736 kubeadm.go:310] If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
I0403 19:23:40.637991 62736 kubeadm.go:310] - 'systemctl status kubelet'
I0403 19:23:40.638039 62736 kubeadm.go:310] - 'journalctl -xeu kubelet'
I0403 19:23:40.638049 62736 kubeadm.go:310]
I0403 19:23:40.638183 62736 kubeadm.go:310] Additionally, a control plane component may have crashed or exited when started by the container runtime.
I0403 19:23:40.638312 62736 kubeadm.go:310] To troubleshoot, list all containers using your preferred container runtimes CLI.
I0403 19:23:40.638328 62736 kubeadm.go:310]
I0403 19:23:40.638459 62736 kubeadm.go:310] Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
I0403 19:23:40.638585 62736 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
I0403 19:23:40.638697 62736 kubeadm.go:310] Once you have found the failing container, you can inspect its logs with:
I0403 19:23:40.638803 62736 kubeadm.go:310] - 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
I0403 19:23:40.638877 62736 kubeadm.go:310]
I0403 19:23:40.640270 62736 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0403 19:23:40.640412 62736 kubeadm.go:310] error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
I0403 19:23:40.640500 62736 kubeadm.go:310] To see the stack trace of this error execute with --v=5 or higher
I0403 19:23:40.640567 62736 kubeadm.go:394] duration metric: took 3m54.924431903s to StartCluster
I0403 19:23:40.640605 62736 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I0403 19:23:40.640662 62736 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0403 19:23:40.698483 62736 cri.go:89] found id: ""
I0403 19:23:40.698512 62736 logs.go:282] 0 containers: []
W0403 19:23:40.698541 62736 logs.go:284] No container was found matching "kube-apiserver"
I0403 19:23:40.698550 62736 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I0403 19:23:40.698614 62736 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0403 19:23:40.732385 62736 cri.go:89] found id: ""
I0403 19:23:40.732411 62736 logs.go:282] 0 containers: []
W0403 19:23:40.732420 62736 logs.go:284] No container was found matching "etcd"
I0403 19:23:40.732427 62736 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I0403 19:23:40.732486 62736 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0403 19:23:40.773783 62736 cri.go:89] found id: ""
I0403 19:23:40.773819 62736 logs.go:282] 0 containers: []
W0403 19:23:40.773827 62736 logs.go:284] No container was found matching "coredns"
I0403 19:23:40.773833 62736 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I0403 19:23:40.773882 62736 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0403 19:23:40.806839 62736 cri.go:89] found id: ""
I0403 19:23:40.806866 62736 logs.go:282] 0 containers: []
W0403 19:23:40.806876 62736 logs.go:284] No container was found matching "kube-scheduler"
I0403 19:23:40.806883 62736 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I0403 19:23:40.806946 62736 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0403 19:23:40.843509 62736 cri.go:89] found id: ""
I0403 19:23:40.843534 62736 logs.go:282] 0 containers: []
W0403 19:23:40.843545 62736 logs.go:284] No container was found matching "kube-proxy"
I0403 19:23:40.843552 62736 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I0403 19:23:40.843606 62736 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0403 19:23:40.889463 62736 cri.go:89] found id: ""
I0403 19:23:40.889490 62736 logs.go:282] 0 containers: []
W0403 19:23:40.889501 62736 logs.go:284] No container was found matching "kube-controller-manager"
I0403 19:23:40.889509 62736 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I0403 19:23:40.889565 62736 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0403 19:23:40.922464 62736 cri.go:89] found id: ""
I0403 19:23:40.922496 62736 logs.go:282] 0 containers: []
W0403 19:23:40.922507 62736 logs.go:284] No container was found matching "kindnet"
I0403 19:23:40.922520 62736 logs.go:123] Gathering logs for kubelet ...
I0403 19:23:40.922533 62736 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0403 19:23:40.978707 62736 logs.go:123] Gathering logs for dmesg ...
I0403 19:23:40.978737 62736 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0403 19:23:40.992502 62736 logs.go:123] Gathering logs for describe nodes ...
I0403 19:23:40.992533 62736 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0403 19:23:41.109954 62736 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I0403 19:23:41.109976 62736 logs.go:123] Gathering logs for CRI-O ...
I0403 19:23:41.109993 62736 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I0403 19:23:41.216798 62736 logs.go:123] Gathering logs for container status ...
I0403 19:23:41.216836 62736 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0403 19:23:41.257407 62736 out.go:418] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0403 19:23:41.257470 62736 out.go:270] *
*
W0403 19:23:41.257527 62736 out.go:270] X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0403 19:23:41.257544 62736 out.go:270] *
*
W0403 19:23:41.258550 62736 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0403 19:23:41.261472 62736 out.go:201]
W0403 19:23:41.262528 62736 out.go:270] X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
X Exiting due to K8S_KUBELET_NOT_RUNNING: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.20.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Using existing apiserver-kubelet-client certificate and key on disk
[certs] Using existing front-proxy-ca certificate authority
[certs] Using existing front-proxy-client certificate and key on disk
[certs] Using existing etcd/ca certificate authority
[certs] Using existing etcd/server certificate and key on disk
[certs] Using existing etcd/peer certificate and key on disk
[certs] Using existing etcd/healthcheck-client certificate and key on disk
[certs] Using existing apiserver-etcd-client certificate and key on disk
[certs] Using the existing "sa" key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
Unfortunately, an error has occurred:
timed out waiting for the condition
This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)
If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'
Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all Kubernetes containers running in cri-o/containerd using crictl:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint /var/run/crio/crio.sock logs CONTAINERID'
stderr:
[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
W0403 19:23:41.262573 62736 out.go:270] * Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
* Suggestion: Check output of 'journalctl -xeu kubelet', try passing --extra-config=kubelet.cgroup-driver=systemd to minikube start
W0403 19:23:41.262601 62736 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/4172
* Related issue: https://github.com/kubernetes/minikube/issues/4172
I0403 19:23:41.263962 62736 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-471019 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.20.0": exit status 109
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-471019 -n old-k8s-version-471019
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-471019 -n old-k8s-version-471019: exit status 6 (239.48083ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0403 19:23:41.554323 65837 status.go:458] kubeconfig endpoint: get endpoint: "old-k8s-version-471019" does not appear in /home/jenkins/minikube-integration/20591-14371/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "old-k8s-version-471019" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (287.35s)